-- Logs begin at Wed 2022-09-28 11:34:17 UTC, end at Wed 2022-09-28 12:31:17 UTC. -- Sep 28 12:00:14.222883 dv-cinder-859193-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 28 12:00:14.230115 dv-cinder-859193-2-smb devstack@keystone.service[81584]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 28 12:00:14.234845 dv-cinder-859193-2-smb devstack@keystone.service[81584]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 28 12:00:14 2022] *** Sep 28 12:00:14.234845 dv-cinder-859193-2-smb devstack@keystone.service[81584]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 28 12:00:14.234845 dv-cinder-859193-2-smb devstack@keystone.service[81584]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 28 12:00:14.234845 dv-cinder-859193-2-smb devstack@keystone.service[81584]: nodename: dv-cinder-859193-2-smb Sep 28 12:00:14.234845 dv-cinder-859193-2-smb devstack@keystone.service[81584]: machine: x86_64 Sep 28 12:00:14.234845 dv-cinder-859193-2-smb devstack@keystone.service[81584]: clock source: unix Sep 28 12:00:14.234845 dv-cinder-859193-2-smb devstack@keystone.service[81584]: pcre jit disabled Sep 28 12:00:14.234845 dv-cinder-859193-2-smb devstack@keystone.service[81584]: detected number of CPU cores: 4 Sep 28 12:00:14.234845 dv-cinder-859193-2-smb devstack@keystone.service[81584]: current working directory: / Sep 28 12:00:14.234845 dv-cinder-859193-2-smb devstack@keystone.service[81584]: detected binary path: /usr/bin/uwsgi-core Sep 28 12:00:14.234845 dv-cinder-859193-2-smb devstack@keystone.service[81584]: your processes number limit is 47680 Sep 28 12:00:14.234845 dv-cinder-859193-2-smb devstack@keystone.service[81584]: your memory page size is 4096 bytes Sep 28 12:00:14.234845 dv-cinder-859193-2-smb devstack@keystone.service[81584]: detected max file descriptor number: 2048 Sep 28 12:00:14.234845 dv-cinder-859193-2-smb devstack@keystone.service[81584]: lock engine: pthread robust mutexes Sep 28 12:00:14.234845 dv-cinder-859193-2-smb devstack@keystone.service[81584]: thunder lock: enabled Sep 28 12:00:14.234845 dv-cinder-859193-2-smb devstack@keystone.service[81584]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 28 12:00:14.234845 dv-cinder-859193-2-smb devstack@keystone.service[81584]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 28 12:00:14.273271 dv-cinder-859193-2-smb devstack@keystone.service[81584]: Python main interpreter initialized at 0x561eff6179c0 Sep 28 12:00:14.273271 dv-cinder-859193-2-smb devstack@keystone.service[81584]: python threads support enabled Sep 28 12:00:14.273271 dv-cinder-859193-2-smb devstack@keystone.service[81584]: your server socket listen backlog is limited to 100 connections Sep 28 12:00:14.273271 dv-cinder-859193-2-smb devstack@keystone.service[81584]: your mercy for graceful operations on workers is 90 seconds Sep 28 12:00:14.273653 dv-cinder-859193-2-smb devstack@keystone.service[81584]: mapped 403077 bytes (393 KB) for 2 cores Sep 28 12:00:14.273773 dv-cinder-859193-2-smb devstack@keystone.service[81584]: *** Operational MODE: preforking *** Sep 28 12:00:14.273975 dv-cinder-859193-2-smb devstack@keystone.service[81584]: *** uWSGI is running in multiple interpreter mode *** Sep 28 12:00:14.273975 dv-cinder-859193-2-smb devstack@keystone.service[81584]: spawned uWSGI master process (pid: 81584) Sep 28 12:00:14.274182 dv-cinder-859193-2-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 28 12:00:14.276434 dv-cinder-859193-2-smb devstack@keystone.service[81584]: spawned uWSGI worker 1 (pid: 81598, cores: 1) Sep 28 12:00:14.276434 dv-cinder-859193-2-smb devstack@keystone.service[81584]: spawned uWSGI worker 2 (pid: 81599, cores: 1) Sep 28 12:00:14.276434 dv-cinder-859193-2-smb devstack@keystone.service[81584]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 28 12:00:18.544560 dv-cinder-859193-2-smb devstack@keystone.service[81599]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 12:00:18.544560 dv-cinder-859193-2-smb devstack@keystone.service[81599]: from cryptography.utils import int_from_bytes Sep 28 12:00:18.545357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 12:00:18.545357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: from cryptography.utils import int_from_bytes Sep 28 12:00:18.558201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 12:00:18.558201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: from cryptography.utils import int_from_bytes Sep 28 12:00:18.558662 dv-cinder-859193-2-smb devstack@keystone.service[81598]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 12:00:18.558662 dv-cinder-859193-2-smb devstack@keystone.service[81598]: from cryptography.utils import int_from_bytes Sep 28 12:00:18.594878 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 12:00:18.595079 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 12:00:18.595271 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] command line args: [] {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 12:00:18.595575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 12:00:18.595760 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ================================================================================ {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 12:00:18.596017 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] admin_token = **** {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.596266 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] config_dir = [] {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.596456 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.596641 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] config_source = [] {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.596824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] debug = True {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.597026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.598181 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.598181 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.598181 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.598181 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.598453 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] list_limit = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.598453 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] log_config_append = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.598572 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.598748 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] log_dir = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.598929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] log_file = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.599166 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.599418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.599691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.599942 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.600123 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.600301 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.600548 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.600800 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.601034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.601269 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.601502 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.602278 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.602515 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.602770 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.603059 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.603521 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.603786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] publish_errors = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.604007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.604268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.604414 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.604682 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.604919 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.605193 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] standard_threads = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.605470 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.605552 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 12:00:18.605722 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 12:00:18.605933 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.606026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] command line args: [] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 12:00:18.606230 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.606317 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 12:00:18.606444 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ================================================================================ {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 12:00:18.606530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] use_journal = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.606702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] admin_token = **** {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.606860 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] use_json = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.606945 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] config_dir = [] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.607129 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.607317 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] use_stderr = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.607496 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] config_source = [] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.607629 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] use_syslog = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.607727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] debug = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.607800 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.607870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.607984 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.608058 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.608129 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.608341 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.608484 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.608577 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.608807 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] list_limit = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.608975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.609055 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] log_config_append = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.609155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.609316 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] log_dir = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.609409 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.609484 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] log_file = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.609843 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.610096 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.610276 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.610414 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.610555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.610691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.610852 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.610986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.610986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.611265 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.611395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.611571 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.611701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.611791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.611873 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.611948 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.612025 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.612194 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.612330 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.612418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.612572 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.612655 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.612809 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.612895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.613060 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.613140 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.613311 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.613435 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.613625 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.613711 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.613876 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.614116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.614208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.614287 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] publish_errors = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.614360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.614521 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.614611 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.614755 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.614871 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.614956 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.615125 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.615210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.615362 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.615471 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.615632 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.615724 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] standard_threads = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.615864 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.615941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.616101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.616185 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.616264 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.616357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.616436 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] use_journal = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.616601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] use_json = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.616698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.616778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] use_stderr = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.616850 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.617176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] use_syslog = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.617888 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.618012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:00:18.618141 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.618268 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.618391 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.618518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.618643 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.618881 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.619045 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.619178 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.619314 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.619513 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.619637 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.619785 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.619912 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.620046 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.620183 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.620369 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.620470 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.620553 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.620633 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.620711 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.620785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.620856 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.620856 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.620992 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.621065 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.621262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.621409 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.621511 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.621761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.621848 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.622000 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.622188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.622325 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.622459 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.622571 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.622729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.622809 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.622966 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.623207 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.623287 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.623501 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.623719 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.623807 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.623999 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.624120 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.624227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.624461 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.624548 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.624695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.624937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.625069 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.625194 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.625332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.625576 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.625708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.625839 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.625961 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.626094 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.626219 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.626362 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.626495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.626583 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.626657 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.626728 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.626811 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.626885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.627001 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.627211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.627300 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.627473 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.627691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.627785 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.627935 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.628020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.628166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.628245 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.628398 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.628485 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.628636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.628706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.628961 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.629068 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.629135 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.629203 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.629337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.629412 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.629646 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.629780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.629919 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.630031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.630143 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.630281 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.630440 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.630564 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.630683 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.630824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.630945 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.631085 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.631195 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.631305 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.631452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.631561 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.631715 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.631825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.631963 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.632073 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.632183 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.632323 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.632442 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.632589 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.632700 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.632809 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.632948 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.633058 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.633175 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.633318 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.633470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.633586 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.633709 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.633840 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.633961 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.633961 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.634165 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.634242 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.634353 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.634353 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.634529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.634610 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.634683 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.634755 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.634902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.635023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.635150 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.635276 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.635394 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.635537 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.635676 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.635809 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.635972 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.636093 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.636208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.636324 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.636449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.636571 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.636696 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.636814 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.636930 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.637073 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.637197 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.637314 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.637502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.637629 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.637745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.637861 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.637977 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.638102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.638228 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.638228 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.638458 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.638574 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.638680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] auth.external = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.638680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.638862 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.638862 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.639090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.639208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.639324 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.639485 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.639634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] auth.password = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.639768 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.639888 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] auth.token = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.640003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.640131 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.640249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.640365 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.640527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.640646 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.640763 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.640879 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.640995 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.641139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.641269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.641388 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.641513 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.641632 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.641750 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.641867 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] credential.caching = True {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.641984 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.642107 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.642237 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.642357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.642474 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.642598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.642716 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.642834 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.642960 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.643079 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.643205 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.643324 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.643467 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.643599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.643727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.643846 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.643963 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] auth.external = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.644079 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.644196 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.644313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.644439 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.644558 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.644675 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.644825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.644968 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] auth.password = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.645088 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.645218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] auth.token = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.645337 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.645454 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.645579 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.645697 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.645880 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] federation.caching = True {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.646012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.646131 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.646248 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.646372 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.646497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.646616 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.646744 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.646863 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.646981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.647098 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.647222 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] credential.caching = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.647341 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.647488 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.647609 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.647726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.647843 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.647960 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.648086 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.648205 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.648322 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.648439 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.648555 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.648673 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.648798 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] identity.caching = True {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.648917 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.649034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.649151 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.649268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.649384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.649510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.649629 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.649746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.649862 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.649985 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.650103 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.650229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.650348 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.650510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.650633 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.650749 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.650865 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.650990 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.651116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] federation.caching = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.651233 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.651349 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.651493 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.651611 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.651811 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.651931 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.652047 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.652163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.652279 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.652394 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.652519 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.652637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.652752 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.652877 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.653000 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.653119 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.653244 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.653370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.653489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.653605 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.653721 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.653838 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.653963 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.654081 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.caching = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.654198 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.654314 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.654431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.654548 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.654673 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.654791 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.654908 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.655025 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.655142 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.655258 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.655392 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.655540 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.655658 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.655775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.655891 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.656008 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.656137 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.656256 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.656373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.656490 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.656613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.656731 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.656857 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.656975 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.657092 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.657209 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.657326 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.657442 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.657569 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.657687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.657804 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.657921 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.658038 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.658163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.658282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.658399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.658517 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.658634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.658750 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.658884 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.659004 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.659121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.659238 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.659354 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.659354 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.659649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.659760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.659866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.659981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.660098 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.660214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.660338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.660457 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.660611 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.660732 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.660849 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.660975 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.661102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.661102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.user = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.661324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.661324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.661542 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.661659 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.661785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.661904 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.662021 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.662137 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.662254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.662370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.662494 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.662613 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.662731 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.662853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.662969 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.663086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.663210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.663329 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.663460 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.663580 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.663696 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.663814 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.663942 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.664062 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.664668 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.664785 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.664903 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.665020 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.665145 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.665264 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.665380 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.665496 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.665613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.665729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.665854 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.665973 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.666090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.666206 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.666322 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.666322 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.666553 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.666673 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.666789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.666906 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.667023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.667145 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.667271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.667389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.667568 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.667686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.667803 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.667919 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.668048 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.668169 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.668285 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.668401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.668517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.668633 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.668758 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.668878 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.668994 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.669112 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.669227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.669343 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.669467 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.669586 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.669702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.669818 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.669935 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.670052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.670177 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.670296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.670412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.670529 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] resource.caching = True {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.670683 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.670804 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.670930 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.671049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.671166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.671282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.671398 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.671535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.671668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.671789 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.671905 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.672028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.672148 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.672265 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.672390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.672508 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.672629 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.672745 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.672861 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.672986 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] role.caching = True {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.673111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.673230 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] role.driver = sql {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.673346 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.673463 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.673579 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.673703 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.673821 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.673938 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.674054 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.674171 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.674288 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.674413 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.674531 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.674647 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.674763 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.674918 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.675036 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.675227 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.675350 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.675350 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.675598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.675598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.675817 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] resource.caching = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.675946 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.676066 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.676182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.676299 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.676417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.676534 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.676658 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.676777 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.676777 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.676996 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.677119 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.677237 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.677452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.677576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.677693 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.677810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.677927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.678043 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.678168 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] role.caching = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.678287 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.678403 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] role.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.678521 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.678638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.678754 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.678883 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.679002 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.679120 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.679237 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.679354 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.679485 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.679617 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.679784 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.680400 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.680519 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.680637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.680802 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.680924 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.681041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.681158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.681275 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.681392 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.681518 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.681639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.681756 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.681873 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.681990 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.682108 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.682233 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] token.caching = True {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.682353 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.682474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.682474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.682696 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.682812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.682938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.683058 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.683175 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.683293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.683409 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.683571 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.683703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.683823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.683940 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.684057 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.684174 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.684291 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.684416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.684536 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.684653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.684771 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.684888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.685005 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.685130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.685250 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.685367 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.685367 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.685588 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.685588 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.685821 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.685953 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.686072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.686190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.686307 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.686307 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.686526 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] database.connection = **** {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.686652 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.686778 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.686898 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.687015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.687133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] token.caching = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.687285 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.687413 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.687550 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.687668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.687784 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.687903 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.688020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.688150 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.688271 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.688271 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.688491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.688608 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.688725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.688884 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.689007 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.689125 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.689242 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.689360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.689477 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.689602 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.689721 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.689838 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.689955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.690073 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.690191 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.690315 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.690435 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.690552 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.690669 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.690821 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.690943 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.691074 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 12:00:18.691201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.691201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.691201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.connection = **** {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.691201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.691201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.691201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.691201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.691201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.691201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.692229 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.692229 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.692229 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.692229 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.692229 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.692229 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.692229 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.692229 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.693071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.693071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.693071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.693071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:00:18.693071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 12:00:18.717855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:18.718091 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:18.718317 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:18.719229 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:18.719502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:18.719715 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:18.727290 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:18.730197 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:18.756219 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:18.756456 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:18.757744 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:18.758028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:18.810027 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:18.810336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:18.858415 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:18.858655 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:18.858835 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:18.859073 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.014250 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.014478 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.014571 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.014702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.014809 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.014924 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.015009 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.015142 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.015234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.015356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.015456 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.015599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.038480 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.038709 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.038795 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.038931 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.039016 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.039204 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.039419 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.039657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.039871 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.042924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.043170 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.043404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.043660 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.043890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.051149 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.054459 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.064393 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.064576 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.064804 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.065028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.065246 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.065459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.065673 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.067318 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.067591 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.067825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.068054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.068278 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.068498 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.068714 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81599) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:00:19.083788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.083999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 28 12:00:19.084346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.084553 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 28 12:00:19.084759 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.084856 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.085063 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 28 12:00:19.085144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.085340 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.085556 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.085647 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.085880 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 28 12:00:19.086183 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.086445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.086703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.086960 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.095214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.095533 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.095811 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.096100 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.098747 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.099035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.099314 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.099631 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.103612 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81599) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.106514 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81599) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.106809 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.107094 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.107376 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.107687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.107953 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.108225 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.108500 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.108772 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.109047 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.109220 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.109322 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.113451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.113840 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.114255 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.114674 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.115101 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.115455 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.115735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.116013 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.116288 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.116564 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.116836 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.132742 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.134248 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81599) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.134541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.139229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81599) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.139547 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.139836 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.140316 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.141785 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.142075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.146143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81599) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.146437 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.146750 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.147039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.147322 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.152106 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81599) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.152408 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.152700 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.152991 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.153275 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.153557 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.153692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.153831 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.153982 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.154102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.159632 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.159937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.160232 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.160527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.160812 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.161096 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.161377 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.161652 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.170251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.170537 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.174425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81599) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.177584 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.177698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.177872 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.177999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.182279 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.182811 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81599) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.185494 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.185799 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.186136 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81599) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.189396 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.189704 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.189955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.190055 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.190262 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.190545 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.190839 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.193051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.196286 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.196592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.196885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.197175 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.197457 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.197740 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.206681 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81599) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.206977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.207256 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.207558 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.213521 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.213816 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.214092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.214365 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.214444 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.215980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.217526 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.217809 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.220521 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81599) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.220811 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.221098 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.221220 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.221386 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.221784 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.222758 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.224328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.224612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.227874 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.228164 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.228449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.228746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.229144 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.233476 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81599) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.233766 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.234052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.234335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.234715 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.234994 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.235275 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.240325 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.240619 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.240909 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.241196 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.241584 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.242133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.242974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.251444 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81599) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.254364 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81599) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.257310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.258394 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.258811 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.260308 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81599) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.260603 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.261005 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.261340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.264400 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.265900 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.267356 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.267515 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.267673 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.268079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.268869 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81599) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.271752 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.272156 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.272458 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.272744 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.274472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.275971 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.278849 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.279254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.279580 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.279862 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.280594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81599) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.280891 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.281179 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.287671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.287966 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.288053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81599) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.288256 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.288351 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.288618 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.288902 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.289697 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.289971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.290271 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.290554 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.290839 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.291112 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.291396 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.291687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.291977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.292250 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81599) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.295682 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:00:19.295972 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.296257 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.296549 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.296825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.297099 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.297377 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.297658 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.297947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.298218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.298498 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.298762 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.299067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.299350 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:00:19.326570 dv-cinder-859193-2-smb devstack@keystone.service[81599]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561eff6179c0 pid: 81599 (default app) Sep 28 12:00:19.329783 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a75b5b-7650-419b-bb68-68be42618901 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:19.330069 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a75b5b-7650-419b-bb68-68be42618901 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:19.330342 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a75b5b-7650-419b-bb68-68be42618901 None None] PATH_INFO: `/v3` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:19.333604 dv-cinder-859193-2-smb devstack@keystone.service[81598]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561eff6179c0 pid: 81598 (default app) Sep 28 12:00:19.334486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Wed Sep 28 12:00:19 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:26.110482 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02403dca-a393-4881-8b26-e86f9eaaaf0d None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:26.111023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02403dca-a393-4881-8b26-e86f9eaaaf0d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:26.111023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02403dca-a393-4881-8b26-e86f9eaaaf0d None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:26.115536 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:00:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:00:26.121459 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ed238-4f74-479d-82a6-d8d7738b7064 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:26.121935 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ed238-4f74-479d-82a6-d8d7738b7064 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:26.122030 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ed238-4f74-479d-82a6-d8d7738b7064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:26.191938 dv-cinder-859193-2-smb devstack@keystone.service[81599]: INFO dbcounter [None req-ea9ed238-4f74-479d-82a6-d8d7738b7064 None None] Registered counter for database keystone Sep 28 12:00:26.210492 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG oslo_db.sqlalchemy.engines [None req-ea9ed238-4f74-479d-82a6-d8d7738b7064 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81599) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:00:26.217290 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writer thread running {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:00:26.401993 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG passlib.handlers.bcrypt [None req-ea9ed238-4f74-479d-82a6-d8d7738b7064 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81599) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 28 12:00:26.402295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG passlib.handlers.bcrypt [None req-ea9ed238-4f74-479d-82a6-d8d7738b7064 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81599) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 28 12:00:26.461933 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-ea9ed238-4f74-479d-82a6-d8d7738b7064 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:00:26.463616 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-ea9ed238-4f74-479d-82a6-d8d7738b7064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:00:26.588636 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:00:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 28 12:00:27.036969 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02403dca-a393-4881-8b26-e86f9eaaaf0d None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:27.106517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: INFO dbcounter [None req-02403dca-a393-4881-8b26-e86f9eaaaf0d None None] Registered counter for database keystone Sep 28 12:00:27.128392 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG oslo_db.sqlalchemy.engines [None req-02403dca-a393-4881-8b26-e86f9eaaaf0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:00:27.135104 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writer thread running {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:00:27.252613 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02403dca-a393-4881-8b26-e86f9eaaaf0d None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:27.256871 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618c1fc-d634-423d-89b0-b5bb885695c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:27.258036 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618c1fc-d634-423d-89b0-b5bb885695c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:27.258319 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618c1fc-d634-423d-89b0-b5bb885695c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:27.258588 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618c1fc-d634-423d-89b0-b5bb885695c5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:27.266709 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618c1fc-d634-423d-89b0-b5bb885695c5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:27.317621 dv-cinder-859193-2-smb devstack@keystone.service[81598]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8618c1fc-d634-423d-89b0-b5bb885695c5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 28 12:00:27.317895 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618c1fc-d634-423d-89b0-b5bb885695c5 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:27.330869 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Sep 28 12:00:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 28 12:00:27.337799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ed238-4f74-479d-82a6-d8d7738b7064 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:27.356170 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ed238-4f74-479d-82a6-d8d7738b7064 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:27.360590 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c92958-7bf1-4644-9620-c9a11ef30733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:27.361706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c92958-7bf1-4644-9620-c9a11ef30733 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:27.361987 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c92958-7bf1-4644-9620-c9a11ef30733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:27.362258 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c92958-7bf1-4644-9620-c9a11ef30733 admin admin] PATH_INFO: `/v3/projects/041bf4405bd541158bdb50b4fa9874e6` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:27.363885 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c92958-7bf1-4644-9620-c9a11ef30733 admin admin] RBAC: Authorizing `identity:get_project(project_id=041bf4405bd541158bdb50b4fa9874e6)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:27.416556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: WARNING keystone.common.rbac_enforcer.enforcer [None req-53c92958-7bf1-4644-9620-c9a11ef30733 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 28 12:00:27.416910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c92958-7bf1-4644-9620-c9a11ef30733 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:27.421431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Sep 28 12:00:27 2022] GET /identity/v3/projects/041bf4405bd541158bdb50b4fa9874e6 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:29.542893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea9d69-7d62-49bc-abde-0ef1a3b9757d None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:29.543536 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea9d69-7d62-49bc-abde-0ef1a3b9757d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:29.543536 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea9d69-7d62-49bc-abde-0ef1a3b9757d None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:29.547552 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:00:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:00:29.553069 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ce4c8-93e4-4264-a7e6-5173029aa996 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:29.553458 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ce4c8-93e4-4264-a7e6-5173029aa996 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:29.553606 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ce4c8-93e4-4264-a7e6-5173029aa996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:29.574221 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-986ce4c8-93e4-4264-a7e6-5173029aa996 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:00:29.575760 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-986ce4c8-93e4-4264-a7e6-5173029aa996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:00:29.583365 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:00:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 28 12:00:29.853386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea9d69-7d62-49bc-abde-0ef1a3b9757d None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:29.865243 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea9d69-7d62-49bc-abde-0ef1a3b9757d None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:29.870225 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e4875-d63c-4b6c-ba2d-69dff5e34775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:29.870813 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e4875-d63c-4b6c-ba2d-69dff5e34775 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:29.871089 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e4875-d63c-4b6c-ba2d-69dff5e34775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:29.871360 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e4875-d63c-4b6c-ba2d-69dff5e34775 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:29.878868 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e4875-d63c-4b6c-ba2d-69dff5e34775 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:29.880647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e4875-d63c-4b6c-ba2d-69dff5e34775 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:29.889259 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Sep 28 12:00:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 12:00:29.894507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ce4c8-93e4-4264-a7e6-5173029aa996 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:29.903651 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ce4c8-93e4-4264-a7e6-5173029aa996 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:29.908001 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11fb35-6c0e-4e38-96f4-1b4f4f0df754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:29.908627 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11fb35-6c0e-4e38-96f4-1b4f4f0df754 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:29.908910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11fb35-6c0e-4e38-96f4-1b4f4f0df754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:29.909186 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11fb35-6c0e-4e38-96f4-1b4f4f0df754 admin admin] PATH_INFO: `/v3/users/c57b54b073714d88bce939746c445771` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:29.910492 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11fb35-6c0e-4e38-96f4-1b4f4f0df754 admin admin] RBAC: Authorizing `identity:get_user(user_id=c57b54b073714d88bce939746c445771)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:29.912361 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11fb35-6c0e-4e38-96f4-1b4f4f0df754 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:29.914389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Wed Sep 28 12:00:29 2022] GET /identity/v3/users/c57b54b073714d88bce939746c445771 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:32.123888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb779157-44b2-4c65-88f9-f7780f747091 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:32.124425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb779157-44b2-4c65-88f9-f7780f747091 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:32.124425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb779157-44b2-4c65-88f9-f7780f747091 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:32.125754 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:00:32.128604 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8abd75-480a-48fc-82c1-a17568861514 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:32.129021 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8abd75-480a-48fc-82c1-a17568861514 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:32.129163 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8abd75-480a-48fc-82c1-a17568861514 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:32.130488 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:00:32.131065 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa11742-c83e-42cc-8880-bebfbcf6520f None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:32.131348 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa11742-c83e-42cc-8880-bebfbcf6520f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:32.131646 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa11742-c83e-42cc-8880-bebfbcf6520f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:32.136445 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360d8bc-efff-4ec0-8c9f-55f111deeb2a None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:32.136733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360d8bc-efff-4ec0-8c9f-55f111deeb2a None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:32.137013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360d8bc-efff-4ec0-8c9f-55f111deeb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:32.155368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-a360d8bc-efff-4ec0-8c9f-55f111deeb2a None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:00:32.156588 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-a360d8bc-efff-4ec0-8c9f-55f111deeb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:00:32.173765 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG passlib.handlers.bcrypt [None req-cfa11742-c83e-42cc-8880-bebfbcf6520f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81598) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 28 12:00:32.174156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG passlib.handlers.bcrypt [None req-cfa11742-c83e-42cc-8880-bebfbcf6520f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81598) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 28 12:00:32.223296 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-cfa11742-c83e-42cc-8880-bebfbcf6520f None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:00:32.224898 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-cfa11742-c83e-42cc-8880-bebfbcf6520f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:00:32.238366 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 7/12] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:00:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:00:32.323022 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 6/13] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:00:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:00:32.507859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360d8bc-efff-4ec0-8c9f-55f111deeb2a None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:32.531980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:32.590262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa11742-c83e-42cc-8880-bebfbcf6520f None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:32.612475 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360d8bc-efff-4ec0-8c9f-55f111deeb2a None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:32.646501 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a106329-4598-408a-a89e-782e735f9eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:32.647114 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a106329-4598-408a-a89e-782e735f9eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:32.647396 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a106329-4598-408a-a89e-782e735f9eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:32.647796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a106329-4598-408a-a89e-782e735f9eb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:32.692697 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa11742-c83e-42cc-8880-bebfbcf6520f None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:32.695526 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:32.721579 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a106329-4598-408a-a89e-782e735f9eb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:32.723070 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a106329-4598-408a-a89e-782e735f9eb5 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:32.731632 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395b596-0982-48f2-8258-2ad6ffc91db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:32.732751 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395b596-0982-48f2-8258-2ad6ffc91db3 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:32.733040 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395b596-0982-48f2-8258-2ad6ffc91db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:32.733316 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395b596-0982-48f2-8258-2ad6ffc91db3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:32.745486 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395b596-0982-48f2-8258-2ad6ffc91db3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:00:32.746851 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:32.754071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-b395b596-0982-48f2-8258-2ad6ffc91db3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:00:32.754071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:00:32.754071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:00:32.754071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:00:32.754071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:00:32.754071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:00:32.754071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:00:32.754071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:00:32.754071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:00:32.754071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:00:32.754071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:00:32.754071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:00:32.754071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:00:32.754071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:00:32.754071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:00:32.754071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:00:32.755112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:00:32.755112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:00:32.755112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:00:32.755112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:00:32.755112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:00:32.755112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:00:32.755112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:00:32.755112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:00:32.755112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:00:32.755112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:00:32.755112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:00:32.755112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:00:32.755112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:00:32.755112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:00:32.755112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:00:32.755112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:00:32.756463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:00:32.756463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:00:32.756463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:00:32.756463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:00:32.756463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:00:32.756463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:00:32.756463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:00:32.756463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:00:32.756463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:00:32.756463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:00:32.756463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:00:32.756463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:00:32.756463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:00:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:00:32.761547 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395b596-0982-48f2-8258-2ad6ffc91db3 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:32.823335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 8/15] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:00:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:00:32.828815 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a106329-4598-408a-a89e-782e735f9eb5 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:32.861421 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395b596-0982-48f2-8258-2ad6ffc91db3 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:32.895457 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f154a-eff7-404d-b0f8-e1d9f01d6c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:32.896084 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f154a-eff7-404d-b0f8-e1d9f01d6c41 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:32.896363 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f154a-eff7-404d-b0f8-e1d9f01d6c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:32.896638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f154a-eff7-404d-b0f8-e1d9f01d6c41 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:32.897304 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f154a-eff7-404d-b0f8-e1d9f01d6c41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:00:32.897612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f154a-eff7-404d-b0f8-e1d9f01d6c41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:32.899632 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f154a-eff7-404d-b0f8-e1d9f01d6c41 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:32.911822 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 8/16] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:00:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:00:32.917503 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f154a-eff7-404d-b0f8-e1d9f01d6c41 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:32.928421 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a106329-4598-408a-a89e-782e735f9eb5 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:32.944291 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:32.951788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:32.963468 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3ebf5-c964-411a-8050-b8c560aa2a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:32.964098 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3ebf5-c964-411a-8050-b8c560aa2a2a None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:32.964370 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3ebf5-c964-411a-8050-b8c560aa2a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:32.964632 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3ebf5-c964-411a-8050-b8c560aa2a2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:32.974577 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3ebf5-c964-411a-8050-b8c560aa2a2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:32.976099 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3ebf5-c964-411a-8050-b8c560aa2a2a None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:32.994430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-65a3ebf5-c964-411a-8050-b8c560aa2a2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:00:32.994430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:00:32.994430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:00:32.994430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:00:32.994430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:00:32.994430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:00:32.994430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:00:32.994430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:00:32.994430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:00:32.994430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:00:32.994430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:00:32.994430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:00:32.994430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:00:32.994430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:00:32.994430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:00:32.994430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:00:32.995378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:00:32.995378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:00:32.995378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:00:32.995378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:00:32.995378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:00:32.995378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:00:32.995378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:00:32.995378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:00:32.995378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:00:32.995378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:00:32.995378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:00:32.995378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:00:32.995378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:00:32.995378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:00:32.995378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:00:32.995378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:00:32.995378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:00:32.996971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:00:32.996971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:00:32.996971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:00:32.996971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:00:33.001401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3ebf5-c964-411a-8050-b8c560aa2a2a None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:33.019305 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f154a-eff7-404d-b0f8-e1d9f01d6c41 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:33.051387 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9f4e8-0574-4c66-b93c-0f6a3d4172a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:33.052037 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9f4e8-0574-4c66-b93c-0f6a3d4172a3 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:33.052311 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9f4e8-0574-4c66-b93c-0f6a3d4172a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:33.052577 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9f4e8-0574-4c66-b93c-0f6a3d4172a3 None admin] PATH_INFO: `/v3/users/c57b54b073714d88bce939746c445771` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:33.054578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9f4e8-0574-4c66-b93c-0f6a3d4172a3 None admin] RBAC: Authorizing `identity:get_user(user_id=c57b54b073714d88bce939746c445771)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:33.056047 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9f4e8-0574-4c66-b93c-0f6a3d4172a3 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:33.057605 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 9/18] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:00:32 2022] GET /identity/v3/users/c57b54b073714d88bce939746c445771 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:00:33.062990 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9f4e8-0574-4c66-b93c-0f6a3d4172a3 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:33.100804 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3ebf5-c964-411a-8050-b8c560aa2a2a None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:33.135688 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4780690-d942-4d2a-b89f-7658191c35c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:33.136308 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4780690-d942-4d2a-b89f-7658191c35c2 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:33.136558 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4780690-d942-4d2a-b89f-7658191c35c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:33.136830 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4780690-d942-4d2a-b89f-7658191c35c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:33.137474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4780690-d942-4d2a-b89f-7658191c35c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:00:33.137775 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4780690-d942-4d2a-b89f-7658191c35c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:33.139161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4780690-d942-4d2a-b89f-7658191c35c2 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:33.153231 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:33.157566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:00:33.160719 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9f4e8-0574-4c66-b93c-0f6a3d4172a3 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:33.197456 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c888a-eb92-43b9-94e6-ed73b07cae87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:33.198103 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c888a-eb92-43b9-94e6-ed73b07cae87 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:33.198378 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c888a-eb92-43b9-94e6-ed73b07cae87 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:33.198645 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c888a-eb92-43b9-94e6-ed73b07cae87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:33.199823 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c888a-eb92-43b9-94e6-ed73b07cae87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:33.201296 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c888a-eb92-43b9-94e6-ed73b07cae87 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:33.202881 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 10/20] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:00:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:00:33.208997 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4780690-d942-4d2a-b89f-7658191c35c2 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:33.246178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:33.315912 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4780690-d942-4d2a-b89f-7658191c35c2 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:33.353239 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6defeb-ea75-4dbf-b5c8-24c1add76080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:33.353858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6defeb-ea75-4dbf-b5c8-24c1add76080 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:33.354134 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6defeb-ea75-4dbf-b5c8-24c1add76080 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:33.354405 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6defeb-ea75-4dbf-b5c8-24c1add76080 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:33.355126 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6defeb-ea75-4dbf-b5c8-24c1add76080 None admin] RBAC: Adding query filter params (role.id=66456d39fc0c496c8f290a436b726216, scope.domain.id=default, user.id=c57b54b073714d88bce939746c445771) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:00:33.355537 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6defeb-ea75-4dbf-b5c8-24c1add76080 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:33.356979 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6defeb-ea75-4dbf-b5c8-24c1add76080 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:33.363809 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 11/21] 10.222.0.16 () {56 vars in 1322 bytes} [Wed Sep 28 12:00:33 2022] GET /identity/v3/role_assignments?user.id=c57b54b073714d88bce939746c445771&scope.domain.id=default&role.id=66456d39fc0c496c8f290a436b726216 => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:00:35.645671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f17bd-a95d-4ef4-bfde-644d7fae0309 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:35.646196 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f17bd-a95d-4ef4-bfde-644d7fae0309 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:35.646196 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f17bd-a95d-4ef4-bfde-644d7fae0309 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:35.648544 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 11/22] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:00:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:00:35.653976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd7d7a-b015-4dd3-ab38-237c4b4c76e1 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:35.654422 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd7d7a-b015-4dd3-ab38-237c4b4c76e1 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:35.654596 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd7d7a-b015-4dd3-ab38-237c4b4c76e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:35.680154 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-00cd7d7a-b015-4dd3-ab38-237c4b4c76e1 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:00:35.681364 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-00cd7d7a-b015-4dd3-ab38-237c4b4c76e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:00:35.778020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 12/23] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:00:36.064194 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f17bd-a95d-4ef4-bfde-644d7fae0309 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:36.131082 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961f513-c735-45b2-af49-287bd3e6e05d None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:36.131759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961f513-c735-45b2-af49-287bd3e6e05d None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:36.132818 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961f513-c735-45b2-af49-287bd3e6e05d None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:36.134534 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:00:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:00:36.149389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c9d98-7651-4d7b-9a26-ad8a35c9297b None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:36.150020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c9d98-7651-4d7b-9a26-ad8a35c9297b None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:36.150508 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c9d98-7651-4d7b-9a26-ad8a35c9297b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:36.178460 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-7a0c9d98-7651-4d7b-9a26-ad8a35c9297b None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:00:36.180744 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-7a0c9d98-7651-4d7b-9a26-ad8a35c9297b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:00:36.228219 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:36.263124 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f17bd-a95d-4ef4-bfde-644d7fae0309 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:36.299524 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 14/25] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:00:36.301112 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b9236-f97c-42e3-b38a-5b581ee613cf None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:36.301588 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b9236-f97c-42e3-b38a-5b581ee613cf None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:36.302070 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b9236-f97c-42e3-b38a-5b581ee613cf None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:36.305342 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 15/26] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:00:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:00:36.306128 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81139f-ad75-407c-b79c-99b30815e220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:36.306997 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81139f-ad75-407c-b79c-99b30815e220 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:36.307489 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81139f-ad75-407c-b79c-99b30815e220 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:36.308030 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81139f-ad75-407c-b79c-99b30815e220 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:36.309774 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba0c4d-bd4d-4c5a-ae36-4a0e94c608da None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:36.310427 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba0c4d-bd4d-4c5a-ae36-4a0e94c608da None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:36.312230 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba0c4d-bd4d-4c5a-ae36-4a0e94c608da None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:36.313650 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 16/27] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:00:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:00:36.318252 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c1390-d605-4a46-819f-25b9edf70004 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:36.318842 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c1390-d605-4a46-819f-25b9edf70004 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:36.319414 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c1390-d605-4a46-819f-25b9edf70004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:36.346142 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81139f-ad75-407c-b79c-99b30815e220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:36.348062 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81139f-ad75-407c-b79c-99b30815e220 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:36.352904 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-030c1390-d605-4a46-819f-25b9edf70004 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:00:36.354459 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-030c1390-d605-4a46-819f-25b9edf70004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:00:36.378806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-db81139f-ad75-407c-b79c-99b30815e220 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:00:36.378806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:00:36.378806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:00:36.378806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:00:36.378806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:00:36.378806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:00:36.378806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:00:36.378806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:00:36.378806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:00:36.378806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:00:36.378806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:00:36.378806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:00:36.378806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:00:36.378806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:00:36.378806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:00:36.378806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:00:36.379726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:00:36.379726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:00:36.379726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:00:36.379726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:00:36.379726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:00:36.379726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:00:36.379726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:00:36.379726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:00:36.379726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:00:36.379726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:00:36.379726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:00:36.379726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:00:36.379726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:00:36.379726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:00:36.379726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:00:36.379726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:00:36.379726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:00:36.380538 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:00:36.380538 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:00:36.380538 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:00:36.383796 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 12/28] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:00:36.387548 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e4816-fe72-47b0-8e87-65b8e1b5eb14 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:36.388856 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e4816-fe72-47b0-8e87-65b8e1b5eb14 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:36.390099 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e4816-fe72-47b0-8e87-65b8e1b5eb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:36.417758 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-4b5e4816-fe72-47b0-8e87-65b8e1b5eb14 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:00:36.419132 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-4b5e4816-fe72-47b0-8e87-65b8e1b5eb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:00:36.435778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:36.495577 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 17/29] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:00:36.496230 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c1390-d605-4a46-819f-25b9edf70004 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:36.560954 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 13/30] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:00:36.617540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:36.632689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c1390-d605-4a46-819f-25b9edf70004 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:36.645095 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e4816-fe72-47b0-8e87-65b8e1b5eb14 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:36.685378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb79cc-b523-4d69-972a-45a2987b98b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:36.686109 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb79cc-b523-4d69-972a-45a2987b98b4 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:36.686314 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb79cc-b523-4d69-972a-45a2987b98b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:36.686769 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb79cc-b523-4d69-972a-45a2987b98b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:36.687885 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb79cc-b523-4d69-972a-45a2987b98b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:00:36.688680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb79cc-b523-4d69-972a-45a2987b98b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:36.690492 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb79cc-b523-4d69-972a-45a2987b98b4 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:36.708582 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 18/31] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:36.714836 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb79cc-b523-4d69-972a-45a2987b98b4 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:36.830928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e4816-fe72-47b0-8e87-65b8e1b5eb14 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:36.902732 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a70c05-2f07-4def-8192-6d82b8709a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:36.903639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a70c05-2f07-4def-8192-6d82b8709a20 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:36.904155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a70c05-2f07-4def-8192-6d82b8709a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:36.904576 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a70c05-2f07-4def-8192-6d82b8709a20 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:36.905395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a70c05-2f07-4def-8192-6d82b8709a20 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:36.906936 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a70c05-2f07-4def-8192-6d82b8709a20 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:36.919256 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb79cc-b523-4d69-972a-45a2987b98b4 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:36.962770 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017cabf-95e5-4de2-a5d5-778bb6aa6ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:36.963830 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017cabf-95e5-4de2-a5d5-778bb6aa6ba6 None admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:36.964308 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017cabf-95e5-4de2-a5d5-778bb6aa6ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:36.964773 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017cabf-95e5-4de2-a5d5-778bb6aa6ba6 None admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:36.965736 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017cabf-95e5-4de2-a5d5-778bb6aa6ba6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:36.967526 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017cabf-95e5-4de2-a5d5-778bb6aa6ba6 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:36.998415 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:37.050369 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 14/32] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Sep 28 12:00:36 2022] POST /identity/v3/roles => generated 219 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:00:37.051373 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a70c05-2f07-4def-8192-6d82b8709a20 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:37.063189 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:37.135329 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 19/33] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 28 12:00:36 2022] POST /identity/v3/projects => generated 301 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:00:37.136329 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017cabf-95e5-4de2-a5d5-778bb6aa6ba6 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:37.181947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a70c05-2f07-4def-8192-6d82b8709a20 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:37.236436 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba4b1f-caac-4808-ad63-10ff24420844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:37.238292 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba4b1f-caac-4808-ad63-10ff24420844 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:37.238962 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba4b1f-caac-4808-ad63-10ff24420844 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:37.239492 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba4b1f-caac-4808-ad63-10ff24420844 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:37.263350 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba4b1f-caac-4808-ad63-10ff24420844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:00:37.263724 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017cabf-95e5-4de2-a5d5-778bb6aa6ba6 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:37.275491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-81ba4b1f-caac-4808-ad63-10ff24420844 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:00:37.275491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:00:37.275491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:00:37.275491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:00:37.275491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:00:37.275491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:00:37.275491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:00:37.275491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:00:37.275491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:00:37.275491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:00:37.275491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:00:37.275491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:00:37.275491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:00:37.275491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:00:37.275491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:00:37.275491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:00:37.276453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:00:37.276453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:00:37.276453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:00:37.276453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:00:37.276453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:00:37.276453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:00:37.276453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:00:37.276453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:00:37.276453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:00:37.276453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:00:37.276453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:00:37.276453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:00:37.276453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:00:37.276453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:00:37.276453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:00:37.276453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:00:37.277214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:00:37.277214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:00:37.277214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:00:37.277214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:00:37.277214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:00:37.277214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:00:37.277214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:00:37.277214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:00:37.277214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:00:37.277214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:00:37.277214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:00:37.277214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:00:37.277214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 15/34] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:00:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:00:37.294549 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba4b1f-caac-4808-ad63-10ff24420844 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:37.342418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f96479-98ef-433f-9a2e-d34322216061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:37.343111 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f96479-98ef-433f-9a2e-d34322216061 None admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:37.343396 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f96479-98ef-433f-9a2e-d34322216061 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:37.343716 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f96479-98ef-433f-9a2e-d34322216061 None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:37.344472 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f96479-98ef-433f-9a2e-d34322216061 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:37.346020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f96479-98ef-433f-9a2e-d34322216061 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:37.369652 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 20/35] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Sep 28 12:00:37 2022] POST /identity/v3/roles => generated 225 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:00:37.397854 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:37.447418 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba4b1f-caac-4808-ad63-10ff24420844 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:37.489654 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60b2f6-48c7-403d-b4ca-192aa3027068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:37.490285 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60b2f6-48c7-403d-b4ca-192aa3027068 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:37.490568 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60b2f6-48c7-403d-b4ca-192aa3027068 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:37.490846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60b2f6-48c7-403d-b4ca-192aa3027068 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:37.492122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60b2f6-48c7-403d-b4ca-192aa3027068 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:00:37.492435 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60b2f6-48c7-403d-b4ca-192aa3027068 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:37.494010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60b2f6-48c7-403d-b4ca-192aa3027068 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:37.504470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 16/36] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:00:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:00:37.510568 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f96479-98ef-433f-9a2e-d34322216061 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:37.528328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9897d-d60b-401b-b212-16eb604ee302 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:37.528643 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9897d-d60b-401b-b212-16eb604ee302 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:37.528893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9897d-d60b-401b-b212-16eb604ee302 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:37.530244 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 17/37] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:00:37.537602 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2d6ed-9ab8-4e18-9471-3924af914408 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:37.537913 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2d6ed-9ab8-4e18-9471-3924af914408 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:37.538717 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2d6ed-9ab8-4e18-9471-3924af914408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:37.568447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-cbf2d6ed-9ab8-4e18-9471-3924af914408 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:00:37.570141 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-cbf2d6ed-9ab8-4e18-9471-3924af914408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:00:37.598039 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:37.654110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f96479-98ef-433f-9a2e-d34322216061 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:37.659937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 18/38] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:00:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:00:37.691935 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f8925-77ff-424b-89ce-18d67a26bb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:37.692626 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f8925-77ff-424b-89ce-18d67a26bb3e None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:37.692849 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f8925-77ff-424b-89ce-18d67a26bb3e None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:37.693127 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f8925-77ff-424b-89ce-18d67a26bb3e None admin] PATH_INFO: `/v3/users/c57b54b073714d88bce939746c445771` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:37.694258 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f8925-77ff-424b-89ce-18d67a26bb3e None admin] RBAC: Authorizing `identity:get_user(user_id=c57b54b073714d88bce939746c445771)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:37.695783 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f8925-77ff-424b-89ce-18d67a26bb3e None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:37.697357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 21/39] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:00:37 2022] GET /identity/v3/users/c57b54b073714d88bce939746c445771 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:37.702858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2d6ed-9ab8-4e18-9471-3924af914408 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:37.763011 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:37.811786 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2d6ed-9ab8-4e18-9471-3924af914408 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:37.848341 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cac81-88fe-47b9-a1cc-2c2f72cecc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:37.848977 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cac81-88fe-47b9-a1cc-2c2f72cecc79 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:37.849231 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cac81-88fe-47b9-a1cc-2c2f72cecc79 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:37.849508 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cac81-88fe-47b9-a1cc-2c2f72cecc79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:37.850705 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303cac81-88fe-47b9-a1cc-2c2f72cecc79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:37.852177 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303cac81-88fe-47b9-a1cc-2c2f72cecc79 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:37.853899 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 19/40] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:00:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:37.859459 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f8925-77ff-424b-89ce-18d67a26bb3e None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:37.913776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac1cd6-eb4d-4f13-8040-b129eb117dd9 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:37.914089 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac1cd6-eb4d-4f13-8040-b129eb117dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:37.914328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac1cd6-eb4d-4f13-8040-b129eb117dd9 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:37.916226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 20/41] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:00:37.921258 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69870ffb-3aba-42e2-9036-56a06db34554 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:37.921544 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69870ffb-3aba-42e2-9036-56a06db34554 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:37.921822 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69870ffb-3aba-42e2-9036-56a06db34554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:37.939928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-69870ffb-3aba-42e2-9036-56a06db34554 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:00:37.941125 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-69870ffb-3aba-42e2-9036-56a06db34554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:00:37.965231 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f8925-77ff-424b-89ce-18d67a26bb3e None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:37.990499 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:37.999252 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a2f84-8ea0-4ad6-8afc-cac2a3e7f442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:37.999940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a2f84-8ea0-4ad6-8afc-cac2a3e7f442 None admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:38.000220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a2f84-8ea0-4ad6-8afc-cac2a3e7f442 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:38.000496 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a2f84-8ea0-4ad6-8afc-cac2a3e7f442 None admin] PATH_INFO: `/v3/domains/default/users/c57b54b073714d88bce939746c445771/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:38.002501 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a2f84-8ea0-4ad6-8afc-cac2a3e7f442 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c57b54b073714d88bce939746c445771, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:38.003982 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a2f84-8ea0-4ad6-8afc-cac2a3e7f442 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:38.008562 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 21/42] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:00:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:00:38.009439 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69870ffb-3aba-42e2-9036-56a06db34554 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:38.022251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 22/43] 10.222.0.16 () {58 vars in 1361 bytes} [Wed Sep 28 12:00:37 2022] PUT /identity/v3/domains/default/users/c57b54b073714d88bce939746c445771/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:00:38.076750 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:38.131205 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69870ffb-3aba-42e2-9036-56a06db34554 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:38.169799 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef72f3-fe93-4051-8901-f6cf1fb0ba73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:38.170428 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef72f3-fe93-4051-8901-f6cf1fb0ba73 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:38.170707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef72f3-fe93-4051-8901-f6cf1fb0ba73 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:38.170980 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef72f3-fe93-4051-8901-f6cf1fb0ba73 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:38.171683 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef72f3-fe93-4051-8901-f6cf1fb0ba73 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:38.173076 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef72f3-fe93-4051-8901-f6cf1fb0ba73 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:38.189569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 22/44] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Sep 28 12:00:38 2022] POST /identity/v3/roles => generated 223 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:00:38.285264 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a2f84-8ea0-4ad6-8afc-cac2a3e7f442 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:38.507520 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a2f84-8ea0-4ad6-8afc-cac2a3e7f442 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:38.540600 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28d132-4abe-428c-bf8b-ccb040ddb2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:38.541160 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28d132-4abe-428c-bf8b-ccb040ddb2bd None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:38.541440 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28d132-4abe-428c-bf8b-ccb040ddb2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:38.541715 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28d132-4abe-428c-bf8b-ccb040ddb2bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:38.542805 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd28d132-4abe-428c-bf8b-ccb040ddb2bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:38.544293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd28d132-4abe-428c-bf8b-ccb040ddb2bd None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:38.545846 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 23/45] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:00:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:38.551317 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef72f3-fe93-4051-8901-f6cf1fb0ba73 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:38.649350 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef72f3-fe93-4051-8901-f6cf1fb0ba73 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:38.662457 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:38.684461 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7339b59-09d3-4931-b08e-b86e77528bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:38.685064 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7339b59-09d3-4931-b08e-b86e77528bd3 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:38.685342 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7339b59-09d3-4931-b08e-b86e77528bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:38.685613 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7339b59-09d3-4931-b08e-b86e77528bd3 None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:38.686266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7339b59-09d3-4931-b08e-b86e77528bd3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:38.687739 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7339b59-09d3-4931-b08e-b86e77528bd3 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:38.718691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 28 12:00:38 2022] POST /identity/v3/projects => generated 312 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:00:40.184750 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8f923-82b1-45f3-b987-de9dce369023 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:40.185292 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8f923-82b1-45f3-b987-de9dce369023 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:40.185292 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8f923-82b1-45f3-b987-de9dce369023 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:40.186653 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 24/47] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:00:40.191958 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d8926-3cdf-4931-b54e-f693ee4b45ae None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:40.192331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d8926-3cdf-4931-b54e-f693ee4b45ae None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:40.192654 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d8926-3cdf-4931-b54e-f693ee4b45ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:40.211405 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-c93d8926-3cdf-4931-b54e-f693ee4b45ae None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:00:40.212612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c93d8926-3cdf-4931-b54e-f693ee4b45ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:00:40.278174 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 24/48] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:00:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:00:40.547914 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8f923-82b1-45f3-b987-de9dce369023 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:40.604980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:40.650001 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8f923-82b1-45f3-b987-de9dce369023 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:40.683376 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804cd36-8a98-4ee7-bd57-c316fcf3e1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:40.684043 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804cd36-8a98-4ee7-bd57-c316fcf3e1ca None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:40.684327 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804cd36-8a98-4ee7-bd57-c316fcf3e1ca None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:40.684602 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804cd36-8a98-4ee7-bd57-c316fcf3e1ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:40.696176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0804cd36-8a98-4ee7-bd57-c316fcf3e1ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:00:40.702132 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-0804cd36-8a98-4ee7-bd57-c316fcf3e1ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:00:40.702132 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:00:40.702132 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:00:40.702132 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:00:40.702132 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:00:40.702132 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:00:40.702132 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:00:40.702132 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:00:40.702132 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:00:40.702132 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:00:40.702132 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:00:40.702132 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:00:40.702132 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:00:40.702132 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:00:40.702132 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:00:40.702132 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:00:40.702962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:00:40.702962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:00:40.702962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:00:40.702962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:00:40.702962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:00:40.702962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:00:40.702962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:00:40.702962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:00:40.702962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:00:40.702962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:00:40.702962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:00:40.702962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:00:40.702962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:00:40.702962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:00:40.702962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:00:40.702962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:00:40.703855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:00:40.703855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:00:40.703855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:00:40.703855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:00:40.703855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:00:40.703855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:00:40.703855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:00:40.703855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:00:40.703855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:00:40.703855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:00:40.703855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:00:40.703855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:00:40.703855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 25/49] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:00:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:00:40.709096 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d8926-3cdf-4931-b54e-f693ee4b45ae None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:40.809403 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:40.815751 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d8926-3cdf-4931-b54e-f693ee4b45ae None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:40.849525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6c20d-57f3-4497-9172-e6c1b6a04fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:40.850136 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6c20d-57f3-4497-9172-e6c1b6a04fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:40.850469 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6c20d-57f3-4497-9172-e6c1b6a04fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:40.850749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6c20d-57f3-4497-9172-e6c1b6a04fb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:40.851428 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6c20d-57f3-4497-9172-e6c1b6a04fb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:00:40.851765 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6c20d-57f3-4497-9172-e6c1b6a04fb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:40.853156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6c20d-57f3-4497-9172-e6c1b6a04fb6 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:40.858790 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79a611-de78-4e69-b66e-e063c1b46bd0 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:40.859074 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79a611-de78-4e69-b66e-e063c1b46bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:40.859352 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79a611-de78-4e69-b66e-e063c1b46bd0 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:40.860752 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 26/50] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:00:40.861272 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 25/51] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:00:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:40.865859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9ee0b-3613-4717-8cb8-287a56908189 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:40.866179 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9ee0b-3613-4717-8cb8-287a56908189 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:40.866726 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9ee0b-3613-4717-8cb8-287a56908189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:40.866913 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6c20d-57f3-4497-9172-e6c1b6a04fb6 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:40.885158 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-a9f9ee0b-3613-4717-8cb8-287a56908189 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:00:40.886684 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-a9f9ee0b-3613-4717-8cb8-287a56908189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:00:40.954779 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 27/52] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:00:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:00:40.965849 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6c20d-57f3-4497-9172-e6c1b6a04fb6 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:40.999329 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd7cbd-6cf5-4ddd-81ef-3c5d496c6b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:41.000048 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd7cbd-6cf5-4ddd-81ef-3c5d496c6b1a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:41.000326 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd7cbd-6cf5-4ddd-81ef-3c5d496c6b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:41.000595 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd7cbd-6cf5-4ddd-81ef-3c5d496c6b1a None admin] PATH_INFO: `/v3/users/c57b54b073714d88bce939746c445771` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:41.001741 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd7cbd-6cf5-4ddd-81ef-3c5d496c6b1a None admin] RBAC: Authorizing `identity:get_user(user_id=c57b54b073714d88bce939746c445771)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:41.003173 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd7cbd-6cf5-4ddd-81ef-3c5d496c6b1a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:41.004775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:00:40 2022] GET /identity/v3/users/c57b54b073714d88bce939746c445771 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:00:41.010660 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9ee0b-3613-4717-8cb8-287a56908189 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:41.055609 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:41.107037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9ee0b-3613-4717-8cb8-287a56908189 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:41.139733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd243c44-b4e8-4ba9-a20f-e8c753d9b572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:41.140356 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd243c44-b4e8-4ba9-a20f-e8c753d9b572 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:41.140635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd243c44-b4e8-4ba9-a20f-e8c753d9b572 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:41.140905 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd243c44-b4e8-4ba9-a20f-e8c753d9b572 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:41.142007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd243c44-b4e8-4ba9-a20f-e8c753d9b572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:41.143488 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd243c44-b4e8-4ba9-a20f-e8c753d9b572 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:41.145030 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 28/54] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:00:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:41.151295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd7cbd-6cf5-4ddd-81ef-3c5d496c6b1a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:41.178049 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:41.228335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd243c44-b4e8-4ba9-a20f-e8c753d9b572 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:41.254264 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd7cbd-6cf5-4ddd-81ef-3c5d496c6b1a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:41.287538 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9570e68-a503-4d3f-8589-e6fe9d5a3762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:41.288184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9570e68-a503-4d3f-8589-e6fe9d5a3762 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:41.288462 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9570e68-a503-4d3f-8589-e6fe9d5a3762 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:41.288737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9570e68-a503-4d3f-8589-e6fe9d5a3762 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:41.289461 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9570e68-a503-4d3f-8589-e6fe9d5a3762 None admin] RBAC: Adding query filter params (role.id=66456d39fc0c496c8f290a436b726216, scope.domain.id=default, user.id=c57b54b073714d88bce939746c445771) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:00:41.289771 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9570e68-a503-4d3f-8589-e6fe9d5a3762 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:41.291202 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9570e68-a503-4d3f-8589-e6fe9d5a3762 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:41.299610 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1322 bytes} [Wed Sep 28 12:00:41 2022] GET /identity/v3/role_assignments?user.id=c57b54b073714d88bce939746c445771&scope.domain.id=default&role.id=66456d39fc0c496c8f290a436b726216 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:41.331249 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd243c44-b4e8-4ba9-a20f-e8c753d9b572 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:41.346838 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:41.370004 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59899a92-37f8-40ad-83ec-8977da9e22b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:41.370570 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59899a92-37f8-40ad-83ec-8977da9e22b6 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:41.370853 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59899a92-37f8-40ad-83ec-8977da9e22b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:41.371129 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59899a92-37f8-40ad-83ec-8977da9e22b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:41.372337 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59899a92-37f8-40ad-83ec-8977da9e22b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:41.373834 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59899a92-37f8-40ad-83ec-8977da9e22b6 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:41.375491 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 29/56] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:00:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:00:41.381209 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9570e68-a503-4d3f-8589-e6fe9d5a3762 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:41.580496 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:41.590367 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9570e68-a503-4d3f-8589-e6fe9d5a3762 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:41.623699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d460edd-80f7-4d72-b19d-4fe075332d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:41.624252 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d460edd-80f7-4d72-b19d-4fe075332d24 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:41.624535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d460edd-80f7-4d72-b19d-4fe075332d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:41.624811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d460edd-80f7-4d72-b19d-4fe075332d24 None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:41.625461 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d460edd-80f7-4d72-b19d-4fe075332d24 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:41.626898 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d460edd-80f7-4d72-b19d-4fe075332d24 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:41.651501 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 28/57] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Sep 28 12:00:41 2022] POST /identity/v3/projects => generated 298 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:00:43.779845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202e263-0476-4e3c-a1f6-423b3b6b59ab None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:43.780325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202e263-0476-4e3c-a1f6-423b3b6b59ab None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:43.780408 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202e263-0476-4e3c-a1f6-423b3b6b59ab None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:43.781747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 30/58] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:00:43.787092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69de95-7582-446b-8b7d-52ed451794d4 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:43.787497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69de95-7582-446b-8b7d-52ed451794d4 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:43.787693 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69de95-7582-446b-8b7d-52ed451794d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:43.806320 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-ba69de95-7582-446b-8b7d-52ed451794d4 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:00:43.807547 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ba69de95-7582-446b-8b7d-52ed451794d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:00:43.872020 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 29/59] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:00:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:00:44.139749 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202e263-0476-4e3c-a1f6-423b3b6b59ab None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:44.238565 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202e263-0476-4e3c-a1f6-423b3b6b59ab None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:44.273322 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ba395-9cda-4fac-b810-965fa17f667b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:44.273936 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ba395-9cda-4fac-b810-965fa17f667b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:44.274220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ba395-9cda-4fac-b810-965fa17f667b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:44.274496 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ba395-9cda-4fac-b810-965fa17f667b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:44.275638 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ba395-9cda-4fac-b810-965fa17f667b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:44.277094 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ba395-9cda-4fac-b810-965fa17f667b None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:44.278639 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 31/60] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:00:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:44.283917 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69de95-7582-446b-8b7d-52ed451794d4 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:44.352137 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:44.382433 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69de95-7582-446b-8b7d-52ed451794d4 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:44.413905 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdf784-c5c7-4e58-bbbe-357154972a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:44.414447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdf784-c5c7-4e58-bbbe-357154972a11 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:44.414726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdf784-c5c7-4e58-bbbe-357154972a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:44.414994 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdf784-c5c7-4e58-bbbe-357154972a11 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:44.415668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fdf784-c5c7-4e58-bbbe-357154972a11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:44.417102 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fdf784-c5c7-4e58-bbbe-357154972a11 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:44.443165 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 30/61] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 28 12:00:44 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:00:47.637769 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046d178-3f97-4ad7-bc44-3c7d4855b72a None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:47.638777 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046d178-3f97-4ad7-bc44-3c7d4855b72a None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:47.639304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046d178-3f97-4ad7-bc44-3c7d4855b72a None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:47.640911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 32/62] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:00:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:00:47.646136 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ddb6c-7048-4a19-b570-b7c9fa2b0b43 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:47.647026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ddb6c-7048-4a19-b570-b7c9fa2b0b43 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:47.647543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ddb6c-7048-4a19-b570-b7c9fa2b0b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:47.666774 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5af92e-7f79-4f93-973e-6db4bc3d1d65 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:47.667413 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5af92e-7f79-4f93-973e-6db4bc3d1d65 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:47.667929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5af92e-7f79-4f93-973e-6db4bc3d1d65 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:47.669805 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 33/63] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:00:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:00:47.672499 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-203ddb6c-7048-4a19-b570-b7c9fa2b0b43 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:00:47.673745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-203ddb6c-7048-4a19-b570-b7c9fa2b0b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:00:47.675850 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd4bb5-2bb1-4c8c-a8ed-b6d4b74f3cfa None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:47.676349 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd4bb5-2bb1-4c8c-a8ed-b6d4b74f3cfa None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:47.676820 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd4bb5-2bb1-4c8c-a8ed-b6d4b74f3cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:47.695793 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-0cbd4bb5-2bb1-4c8c-a8ed-b6d4b74f3cfa None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:00:47.697313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-0cbd4bb5-2bb1-4c8c-a8ed-b6d4b74f3cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:00:47.758770 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:47.794231 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 31/64] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:00:47.797437 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 34/65] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:00:47.950290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b1685-b0dd-4433-98a1-889e6241d610 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:47.950603 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b1685-b0dd-4433-98a1-889e6241d610 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:47.950811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b1685-b0dd-4433-98a1-889e6241d610 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:47.952320 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 32/66] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:00:47.957250 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb40158-5b8c-423c-b367-9c813d82ef1d None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:47.957545 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb40158-5b8c-423c-b367-9c813d82ef1d None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:47.957830 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb40158-5b8c-423c-b367-9c813d82ef1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:47.984407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-dcb40158-5b8c-423c-b367-9c813d82ef1d None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:00:47.985612 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-dcb40158-5b8c-423c-b367-9c813d82ef1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:00:48.077137 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 35/67] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:00:48.121735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b1685-b0dd-4433-98a1-889e6241d610 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:48.182302 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc72d7e-8b0a-4e98-9edf-fff74879f969 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:48.182635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc72d7e-8b0a-4e98-9edf-fff74879f969 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:48.182892 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc72d7e-8b0a-4e98-9edf-fff74879f969 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:48.184265 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 36/68] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:00:48.197099 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edd0d7-85e8-430e-aedc-217e087f9913 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:48.197795 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edd0d7-85e8-430e-aedc-217e087f9913 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:48.198602 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edd0d7-85e8-430e-aedc-217e087f9913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:48.202553 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:48.236193 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-11edd0d7-85e8-430e-aedc-217e087f9913 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:00:48.237402 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-11edd0d7-85e8-430e-aedc-217e087f9913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:00:48.269600 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b1685-b0dd-4433-98a1-889e6241d610 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:48.306786 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb444e52-1d92-416f-b13e-e7636562638b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:48.307725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb444e52-1d92-416f-b13e-e7636562638b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:48.308151 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb444e52-1d92-416f-b13e-e7636562638b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:48.308568 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb444e52-1d92-416f-b13e-e7636562638b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:48.319660 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb444e52-1d92-416f-b13e-e7636562638b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:00:48.325240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-fb444e52-1d92-416f-b13e-e7636562638b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:00:48.325240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:00:48.325240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:00:48.325240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:00:48.325240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:00:48.325240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:00:48.325240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:00:48.325240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:00:48.325240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:00:48.325240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:00:48.325240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:00:48.325240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:00:48.325240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:00:48.325240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:00:48.325240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:00:48.325240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:00:48.326218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:00:48.326218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:00:48.326218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:00:48.326218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:00:48.326218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:00:48.326218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:00:48.326218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:00:48.326218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:00:48.326218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:00:48.326218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:00:48.326218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:00:48.326218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:00:48.326218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:00:48.326218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:00:48.326218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:00:48.326218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:00:48.326992 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:00:48.326992 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:00:48.326992 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:00:48.326992 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:00:48.326992 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:00:48.326992 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:00:48.326992 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:00:48.326992 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:00:48.326992 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:00:48.326992 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:00:48.326992 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:00:48.326992 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:00:48.329615 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 33/69] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:00:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:00:48.335485 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb444e52-1d92-416f-b13e-e7636562638b None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:48.335767 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 37/70] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:00:48.337596 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11edd0d7-85e8-430e-aedc-217e087f9913 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:48.411980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:48.471615 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb444e52-1d92-416f-b13e-e7636562638b None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:48.483722 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11edd0d7-85e8-430e-aedc-217e087f9913 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:48.495731 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:48.518387 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b479df-bcbb-48f1-9cd5-a67d69e328a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:48.519031 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b479df-bcbb-48f1-9cd5-a67d69e328a8 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:48.519311 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b479df-bcbb-48f1-9cd5-a67d69e328a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:48.519613 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b479df-bcbb-48f1-9cd5-a67d69e328a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:48.525172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7929b-ae4e-450b-9072-4e2806e78fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:48.526013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7929b-ae4e-450b-9072-4e2806e78fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:48.526609 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7929b-ae4e-450b-9072-4e2806e78fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:48.527080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7929b-ae4e-450b-9072-4e2806e78fd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:48.528091 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7929b-ae4e-450b-9072-4e2806e78fd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:00:48.528649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7929b-ae4e-450b-9072-4e2806e78fd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:48.530372 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7929b-ae4e-450b-9072-4e2806e78fd6 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:48.530574 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b479df-bcbb-48f1-9cd5-a67d69e328a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:00:48.536212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-84b479df-bcbb-48f1-9cd5-a67d69e328a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:00:48.536212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:00:48.536212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:00:48.536212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:00:48.536212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:00:48.536212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:00:48.536212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:00:48.536212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:00:48.536212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:00:48.536212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:00:48.536212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:00:48.536212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:00:48.536212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:00:48.536212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:00:48.536212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:00:48.536212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:00:48.537077 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:00:48.537077 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:00:48.537077 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:00:48.537077 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:00:48.537077 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:00:48.537077 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:00:48.537077 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:00:48.537077 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:00:48.537077 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:00:48.537077 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:00:48.537077 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:00:48.537077 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:00:48.537077 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:00:48.537077 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:00:48.537077 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:00:48.537077 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:00:48.538412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:00:48.538412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:00:48.538412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:00:48.538412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:00:48.538412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:00:48.538412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:00:48.538412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:00:48.538412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:00:48.538412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:00:48.538412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:00:48.538412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:00:48.538412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:00:48.538412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 34/71] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:00:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:00:48.539054 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b479df-bcbb-48f1-9cd5-a67d69e328a8 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:48.547487 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 38/72] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:00:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:00:48.548734 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7929b-ae4e-450b-9072-4e2806e78fd6 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:48.660311 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b479df-bcbb-48f1-9cd5-a67d69e328a8 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:48.666847 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7929b-ae4e-450b-9072-4e2806e78fd6 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:48.668513 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:48.699173 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ac5ef-f074-4fe5-990e-2c858a8a82f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:48.702423 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ac5ef-f074-4fe5-990e-2c858a8a82f8 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:48.702423 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ac5ef-f074-4fe5-990e-2c858a8a82f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:48.702423 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ac5ef-f074-4fe5-990e-2c858a8a82f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:48.709006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784970b-e211-4d85-857e-148af80cca0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:48.710323 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784970b-e211-4d85-857e-148af80cca0d None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:48.710638 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784970b-e211-4d85-857e-148af80cca0d None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:48.710993 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784970b-e211-4d85-857e-148af80cca0d None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:48.711708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784970b-e211-4d85-857e-148af80cca0d None admin] RBAC: Adding query filter params (name=member) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:00:48.712016 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784970b-e211-4d85-857e-148af80cca0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:48.713407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784970b-e211-4d85-857e-148af80cca0d None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:48.713802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ac5ef-f074-4fe5-990e-2c858a8a82f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:00:48.719158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-004ac5ef-f074-4fe5-990e-2c858a8a82f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:00:48.719158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:00:48.719158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:00:48.719158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:00:48.719158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:00:48.719158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:00:48.719158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:00:48.719158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:00:48.719158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:00:48.719158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:00:48.719158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:00:48.719158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:00:48.719158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:00:48.719158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:00:48.719158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:00:48.719158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:00:48.720166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:00:48.720166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:00:48.720166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:00:48.720166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:00:48.720166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:00:48.720166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:00:48.720166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:00:48.720166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:00:48.720166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:00:48.720166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:00:48.720166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:00:48.720166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:00:48.720166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:00:48.720166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:00:48.720166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:00:48.720166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:00:48.724449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:00:48.724449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:00:48.724449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:00:48.724449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:00:48.724449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:00:48.724449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:00:48.724449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:00:48.724449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:00:48.724449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:00:48.724449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:00:48.724449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:00:48.724449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:00:48.724449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 35/73] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 28 12:00:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:00:48.724449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ac5ef-f074-4fe5-990e-2c858a8a82f8 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:48.727604 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 39/74] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:00:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:48.728664 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784970b-e211-4d85-857e-148af80cca0d None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:48.773188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:48.833283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ac5ef-f074-4fe5-990e-2c858a8a82f8 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:48.835747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784970b-e211-4d85-857e-148af80cca0d None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:48.868475 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6421d-c48c-4796-8272-7031fa9cbdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:48.868920 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901426c-ae67-4ea1-b389-d38cc14803ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:48.869108 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6421d-c48c-4796-8272-7031fa9cbdd7 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:48.869389 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6421d-c48c-4796-8272-7031fa9cbdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:48.869554 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901426c-ae67-4ea1-b389-d38cc14803ba None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:48.869658 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6421d-c48c-4796-8272-7031fa9cbdd7 None admin] PATH_INFO: `/v3/users/c57b54b073714d88bce939746c445771` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:48.869838 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901426c-ae67-4ea1-b389-d38cc14803ba None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:48.870172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901426c-ae67-4ea1-b389-d38cc14803ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:48.870787 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6421d-c48c-4796-8272-7031fa9cbdd7 None admin] RBAC: Authorizing `identity:get_user(user_id=c57b54b073714d88bce939746c445771)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:48.872287 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6421d-c48c-4796-8272-7031fa9cbdd7 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:48.873890 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 36/75] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:00:48 2022] GET /identity/v3/users/c57b54b073714d88bce939746c445771 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:48.874651 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6421d-c48c-4796-8272-7031fa9cbdd7 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:48.883289 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901426c-ae67-4ea1-b389-d38cc14803ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:00:48.889728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-2901426c-ae67-4ea1-b389-d38cc14803ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:00:48.889728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:00:48.889728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:00:48.889728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:00:48.889728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:00:48.889728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:00:48.889728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:00:48.889728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:00:48.889728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:00:48.889728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:00:48.889728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:00:48.889728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:00:48.889728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:00:48.889728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:00:48.889728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:00:48.889728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:00:48.890751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:00:48.890751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:00:48.890751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:00:48.890751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:00:48.890751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:00:48.890751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:00:48.890751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:00:48.890751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:00:48.890751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:00:48.890751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:00:48.890751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:00:48.890751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:00:48.890751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:00:48.890751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:00:48.890751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:00:48.890751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:00:48.891612 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:00:48.891612 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:00:48.891612 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:00:48.891612 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:00:48.891612 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:00:48.891612 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:00:48.891612 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:00:48.891612 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:00:48.891612 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:00:48.891612 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:00:48.891612 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:00:48.891612 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:00:48.891612 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 40/76] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:00:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:00:48.892262 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901426c-ae67-4ea1-b389-d38cc14803ba None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:48.916945 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:48.978373 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6421d-c48c-4796-8272-7031fa9cbdd7 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:48.985157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:48.992512 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901426c-ae67-4ea1-b389-d38cc14803ba None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:49.014597 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa54485-e38d-43e5-8e3b-f9e46d670114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:49.015190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa54485-e38d-43e5-8e3b-f9e46d670114 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:49.015491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa54485-e38d-43e5-8e3b-f9e46d670114 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:49.015764 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa54485-e38d-43e5-8e3b-f9e46d670114 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:49.016417 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa54485-e38d-43e5-8e3b-f9e46d670114 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:00:49.016716 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa54485-e38d-43e5-8e3b-f9e46d670114 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:49.018079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa54485-e38d-43e5-8e3b-f9e46d670114 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:49.025933 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 37/77] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:00:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:49.026041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84d9a1-70a5-4210-a824-bce05fccdceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:49.026392 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84d9a1-70a5-4210-a824-bce05fccdceb None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:49.026671 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84d9a1-70a5-4210-a824-bce05fccdceb None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:49.027011 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84d9a1-70a5-4210-a824-bce05fccdceb None admin] PATH_INFO: `/v3/users/487e6099c4e64a10bbdf6b7df5e94d5c` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:49.027100 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb64c92-2806-4bf1-948b-13b6daa38bf6 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:49.027325 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb64c92-2806-4bf1-948b-13b6daa38bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:49.027628 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb64c92-2806-4bf1-948b-13b6daa38bf6 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:49.028823 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 38/78] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:00:49.029515 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb64c92-2806-4bf1-948b-13b6daa38bf6 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:49.044269 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84d9a1-70a5-4210-a824-bce05fccdceb None admin] RBAC: Authorizing `identity:get_user(user_id=487e6099c4e64a10bbdf6b7df5e94d5c)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:49.045718 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84d9a1-70a5-4210-a824-bce05fccdceb None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:49.047347 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 41/79] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:00:48 2022] GET /identity/v3/users/487e6099c4e64a10bbdf6b7df5e94d5c => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:49.048132 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84d9a1-70a5-4210-a824-bce05fccdceb None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:49.128301 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:49.134865 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb64c92-2806-4bf1-948b-13b6daa38bf6 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:49.146962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84d9a1-70a5-4210-a824-bce05fccdceb None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:49.168203 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbffd29-baed-4a44-a62d-58e2ad593c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:49.168800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbffd29-baed-4a44-a62d-58e2ad593c27 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:49.169078 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbffd29-baed-4a44-a62d-58e2ad593c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:49.169377 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbffd29-baed-4a44-a62d-58e2ad593c27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:49.180472 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70565ce3-2480-436e-8c73-8b2ce6576437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:49.181072 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70565ce3-2480-436e-8c73-8b2ce6576437 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:49.181351 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70565ce3-2480-436e-8c73-8b2ce6576437 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:49.181624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70565ce3-2480-436e-8c73-8b2ce6576437 None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:49.182311 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70565ce3-2480-436e-8c73-8b2ce6576437 None admin] RBAC: Adding query filter params (name=member) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:00:49.182619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70565ce3-2480-436e-8c73-8b2ce6576437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:49.184033 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70565ce3-2480-436e-8c73-8b2ce6576437 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:49.191904 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 42/80] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:00:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:49.193045 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70565ce3-2480-436e-8c73-8b2ce6576437 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:49.207159 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:49.241075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbffd29-baed-4a44-a62d-58e2ad593c27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:49.242775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbffd29-baed-4a44-a62d-58e2ad593c27 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:49.298733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70565ce3-2480-436e-8c73-8b2ce6576437 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:49.332021 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca648f1-e380-412e-9398-6b26e237d6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:49.332645 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca648f1-e380-412e-9398-6b26e237d6a8 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:49.332927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca648f1-e380-412e-9398-6b26e237d6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:49.333206 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca648f1-e380-412e-9398-6b26e237d6a8 None admin] PATH_INFO: `/v3/users/487e6099c4e64a10bbdf6b7df5e94d5c` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:49.334427 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca648f1-e380-412e-9398-6b26e237d6a8 None admin] RBAC: Authorizing `identity:get_user(user_id=487e6099c4e64a10bbdf6b7df5e94d5c)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:49.336379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca648f1-e380-412e-9398-6b26e237d6a8 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:49.337984 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 43/81] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:00:49 2022] GET /identity/v3/users/487e6099c4e64a10bbdf6b7df5e94d5c => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:49.339121 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fe9d7-511f-49dc-b30f-9f6e75925cb1 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:49.339235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 39/82] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:00:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:00:49.339402 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fe9d7-511f-49dc-b30f-9f6e75925cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:49.339699 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fe9d7-511f-49dc-b30f-9f6e75925cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:49.340059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbffd29-baed-4a44-a62d-58e2ad593c27 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:49.357713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-146fe9d7-511f-49dc-b30f-9f6e75925cb1 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:00:49.359018 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-146fe9d7-511f-49dc-b30f-9f6e75925cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:00:49.366748 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:49.407779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:49.426709 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 44/83] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:00:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:00:49.427571 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fe9d7-511f-49dc-b30f-9f6e75925cb1 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:49.441543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbffd29-baed-4a44-a62d-58e2ad593c27 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:49.481283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b731a9-d193-4ce6-9715-041c29623cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:49.481894 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b731a9-d193-4ce6-9715-041c29623cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:49.482172 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b731a9-d193-4ce6-9715-041c29623cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:49.482444 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b731a9-d193-4ce6-9715-041c29623cf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:49.531392 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fe9d7-511f-49dc-b30f-9f6e75925cb1 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:49.555661 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b731a9-d193-4ce6-9715-041c29623cf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:49.557127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b731a9-d193-4ce6-9715-041c29623cf2 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:49.566950 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b401f-7c6a-4dce-995e-f6a4e5cc466b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:49.567616 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b401f-7c6a-4dce-995e-f6a4e5cc466b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:49.567902 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b401f-7c6a-4dce-995e-f6a4e5cc466b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:49.568181 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b401f-7c6a-4dce-995e-f6a4e5cc466b None admin] PATH_INFO: `/v3/users/487e6099c4e64a10bbdf6b7df5e94d5c` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:49.569323 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b401f-7c6a-4dce-995e-f6a4e5cc466b None admin] RBAC: Authorizing `identity:get_user(user_id=487e6099c4e64a10bbdf6b7df5e94d5c)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:49.570772 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b401f-7c6a-4dce-995e-f6a4e5cc466b None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:49.572411 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 45/84] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:00:49 2022] GET /identity/v3/users/487e6099c4e64a10bbdf6b7df5e94d5c => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:49.573177 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b401f-7c6a-4dce-995e-f6a4e5cc466b None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:49.587672 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:49.629451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:49.665731 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 40/85] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:00:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:00:49.671139 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b731a9-d193-4ce6-9715-041c29623cf2 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:49.681544 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b401f-7c6a-4dce-995e-f6a4e5cc466b None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:49.716085 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6426d4-7bac-4aa5-910a-ec43b7f4c940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:49.716702 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6426d4-7bac-4aa5-910a-ec43b7f4c940 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:49.716984 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6426d4-7bac-4aa5-910a-ec43b7f4c940 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:49.717263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6426d4-7bac-4aa5-910a-ec43b7f4c940 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:49.776091 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b731a9-d193-4ce6-9715-041c29623cf2 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:49.786731 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6426d4-7bac-4aa5-910a-ec43b7f4c940 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:49.788201 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6426d4-7bac-4aa5-910a-ec43b7f4c940 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:49.798851 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:49.811078 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05521a5f-1988-49a6-b78f-2a28ada07a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:49.811750 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05521a5f-1988-49a6-b78f-2a28ada07a5e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:49.812033 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05521a5f-1988-49a6-b78f-2a28ada07a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:49.812340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05521a5f-1988-49a6-b78f-2a28ada07a5e None admin] PATH_INFO: `/v3/projects/0976a5e8d4d942399b8522e367e466ba` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:49.813474 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05521a5f-1988-49a6-b78f-2a28ada07a5e None admin] RBAC: Authorizing `identity:get_project(project_id=0976a5e8d4d942399b8522e367e466ba)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:49.814919 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05521a5f-1988-49a6-b78f-2a28ada07a5e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:49.816596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 41/86] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:00:49 2022] GET /identity/v3/projects/0976a5e8d4d942399b8522e367e466ba => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:49.817363 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05521a5f-1988-49a6-b78f-2a28ada07a5e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:49.856093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:49.898704 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 46/87] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:00:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:00:49.899601 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6426d4-7bac-4aa5-910a-ec43b7f4c940 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:49.936825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05521a5f-1988-49a6-b78f-2a28ada07a5e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:49.971179 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c57ba-2088-47b9-8f25-4a7869affd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:49.971810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c57ba-2088-47b9-8f25-4a7869affd44 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:49.972091 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c57ba-2088-47b9-8f25-4a7869affd44 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:49.972361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c57ba-2088-47b9-8f25-4a7869affd44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:49.997073 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6426d4-7bac-4aa5-910a-ec43b7f4c940 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:50.008000 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:50.031139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c99dbf-0c44-48ee-bca2-eb2f814e127d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:50.031794 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c99dbf-0c44-48ee-bca2-eb2f814e127d None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:50.032076 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c99dbf-0c44-48ee-bca2-eb2f814e127d None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:50.032353 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c99dbf-0c44-48ee-bca2-eb2f814e127d None admin] PATH_INFO: `/v3/projects/0976a5e8d4d942399b8522e367e466ba` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:50.033483 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c99dbf-0c44-48ee-bca2-eb2f814e127d None admin] RBAC: Authorizing `identity:get_project(project_id=0976a5e8d4d942399b8522e367e466ba)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:50.034966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c99dbf-0c44-48ee-bca2-eb2f814e127d None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:50.036631 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 47/88] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:00:49 2022] GET /identity/v3/projects/0976a5e8d4d942399b8522e367e466ba => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:50.037942 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c99dbf-0c44-48ee-bca2-eb2f814e127d None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:50.044444 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c57ba-2088-47b9-8f25-4a7869affd44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:50.045903 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c57ba-2088-47b9-8f25-4a7869affd44 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:50.079269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:50.138746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c99dbf-0c44-48ee-bca2-eb2f814e127d None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:50.144327 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 42/89] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:00:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:00:50.145266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c57ba-2088-47b9-8f25-4a7869affd44 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:50.175101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac65da6-e8d1-4bd6-adbc-1dceb365b527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:50.175786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac65da6-e8d1-4bd6-adbc-1dceb365b527 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:50.176070 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac65da6-e8d1-4bd6-adbc-1dceb365b527 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:50.176343 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac65da6-e8d1-4bd6-adbc-1dceb365b527 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:50.177449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac65da6-e8d1-4bd6-adbc-1dceb365b527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:50.179493 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac65da6-e8d1-4bd6-adbc-1dceb365b527 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:50.183483 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 48/90] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:00:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:50.183483 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac65da6-e8d1-4bd6-adbc-1dceb365b527 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:50.233602 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:50.247092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c57ba-2088-47b9-8f25-4a7869affd44 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:50.281602 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd6bd4-9b89-4097-aa84-f834479b9d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:50.282214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd6bd4-9b89-4097-aa84-f834479b9d6b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:50.282494 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd6bd4-9b89-4097-aa84-f834479b9d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:50.282772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd6bd4-9b89-4097-aa84-f834479b9d6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:50.283535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd6bd4-9b89-4097-aa84-f834479b9d6b None admin] RBAC: Adding query filter params (role.id=66456d39fc0c496c8f290a436b726216, scope.project.id=0976a5e8d4d942399b8522e367e466ba, user.id=c57b54b073714d88bce939746c445771) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:00:50.283850 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd6bd4-9b89-4097-aa84-f834479b9d6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:50.285287 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd6bd4-9b89-4097-aa84-f834479b9d6b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:50.285927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac65da6-e8d1-4bd6-adbc-1dceb365b527 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:50.289217 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:50.292126 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 43/91] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:00:50 2022] GET /identity/v3/role_assignments?user.id=c57b54b073714d88bce939746c445771&scope.project.id=0976a5e8d4d942399b8522e367e466ba&role.id=66456d39fc0c496c8f290a436b726216 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:50.293030 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd6bd4-9b89-4097-aa84-f834479b9d6b None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:50.335822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32af2a4-a905-48a9-8f6d-78862acf566d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:50.336603 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32af2a4-a905-48a9-8f6d-78862acf566d None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:50.336977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32af2a4-a905-48a9-8f6d-78862acf566d None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:50.337330 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32af2a4-a905-48a9-8f6d-78862acf566d None admin] PATH_INFO: `/v3/projects/0976a5e8d4d942399b8522e367e466ba` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:50.338525 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32af2a4-a905-48a9-8f6d-78862acf566d None admin] RBAC: Authorizing `identity:get_project(project_id=0976a5e8d4d942399b8522e367e466ba)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:50.340060 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32af2a4-a905-48a9-8f6d-78862acf566d None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:50.341770 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 49/92] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:00:50 2022] GET /identity/v3/projects/0976a5e8d4d942399b8522e367e466ba => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:50.342559 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32af2a4-a905-48a9-8f6d-78862acf566d None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:50.404591 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd6bd4-9b89-4097-aa84-f834479b9d6b None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:50.443217 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df262afa-32a8-48ff-8631-31523b1f67c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:50.444102 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df262afa-32a8-48ff-8631-31523b1f67c4 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:50.444388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df262afa-32a8-48ff-8631-31523b1f67c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:50.444661 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df262afa-32a8-48ff-8631-31523b1f67c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:50.445404 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df262afa-32a8-48ff-8631-31523b1f67c4 None admin] RBAC: Adding query filter params (role.id=9aa9b054939e4fc1ad0387e43c500693, scope.project.id=0976a5e8d4d942399b8522e367e466ba, user.id=487e6099c4e64a10bbdf6b7df5e94d5c) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:00:50.445718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df262afa-32a8-48ff-8631-31523b1f67c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:50.447321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df262afa-32a8-48ff-8631-31523b1f67c4 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:50.463721 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 44/93] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:00:50 2022] GET /identity/v3/role_assignments?user.id=487e6099c4e64a10bbdf6b7df5e94d5c&scope.project.id=0976a5e8d4d942399b8522e367e466ba&role.id=9aa9b054939e4fc1ad0387e43c500693 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:50.463721 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df262afa-32a8-48ff-8631-31523b1f67c4 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:50.473367 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32af2a4-a905-48a9-8f6d-78862acf566d None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:50.489930 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:50.518176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59ee54-b577-4aac-9a8f-69d078487d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:50.519338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59ee54-b577-4aac-9a8f-69d078487d0b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:50.519735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59ee54-b577-4aac-9a8f-69d078487d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:50.520351 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59ee54-b577-4aac-9a8f-69d078487d0b None admin] PATH_INFO: `/v3/projects/3f1f1193bc99470eb4863f0a1a231bdf` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:50.522500 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59ee54-b577-4aac-9a8f-69d078487d0b None admin] RBAC: Authorizing `identity:get_project(project_id=3f1f1193bc99470eb4863f0a1a231bdf)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:50.524912 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59ee54-b577-4aac-9a8f-69d078487d0b None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:50.527202 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 50/94] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:00:50 2022] GET /identity/v3/projects/3f1f1193bc99470eb4863f0a1a231bdf => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:50.533187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59ee54-b577-4aac-9a8f-69d078487d0b None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:50.543114 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:50.586836 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df262afa-32a8-48ff-8631-31523b1f67c4 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:50.635910 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa040800-47f5-496e-91a7-1f2ac7589ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:50.636678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa040800-47f5-496e-91a7-1f2ac7589ba3 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:50.637063 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa040800-47f5-496e-91a7-1f2ac7589ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:50.637405 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa040800-47f5-496e-91a7-1f2ac7589ba3 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:50.638151 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa040800-47f5-496e-91a7-1f2ac7589ba3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:50.639716 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa040800-47f5-496e-91a7-1f2ac7589ba3 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:50.672185 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 45/95] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 28 12:00:50 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:00:50.679466 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa040800-47f5-496e-91a7-1f2ac7589ba3 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:50.682573 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59ee54-b577-4aac-9a8f-69d078487d0b None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:50.747754 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4518f-f646-45f4-be80-a84e37760e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:50.748422 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4518f-f646-45f4-be80-a84e37760e52 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:50.748939 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4518f-f646-45f4-be80-a84e37760e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:50.749362 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4518f-f646-45f4-be80-a84e37760e52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:50.750189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4518f-f646-45f4-be80-a84e37760e52 None admin] RBAC: Adding query filter params (role.id=67ed180941fd45af996b858232628221, scope.project.id=0976a5e8d4d942399b8522e367e466ba, user.id=487e6099c4e64a10bbdf6b7df5e94d5c) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:00:50.750507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4518f-f646-45f4-be80-a84e37760e52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:50.752427 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4518f-f646-45f4-be80-a84e37760e52 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:50.762001 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 51/96] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:00:50 2022] GET /identity/v3/role_assignments?user.id=487e6099c4e64a10bbdf6b7df5e94d5c&scope.project.id=0976a5e8d4d942399b8522e367e466ba&role.id=67ed180941fd45af996b858232628221 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:50.912168 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa040800-47f5-496e-91a7-1f2ac7589ba3 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:50.948569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:50.967755 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eaf941-ec92-4a8f-af79-82bef96588ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:50.968392 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eaf941-ec92-4a8f-af79-82bef96588ab None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:50.968959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eaf941-ec92-4a8f-af79-82bef96588ab None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:50.969245 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eaf941-ec92-4a8f-af79-82bef96588ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:50.970059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eaf941-ec92-4a8f-af79-82bef96588ab None admin] RBAC: Adding query filter params (role.id=9aa9b054939e4fc1ad0387e43c500693, scope.project.id=3f1f1193bc99470eb4863f0a1a231bdf, user.id=487e6099c4e64a10bbdf6b7df5e94d5c) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:00:50.970380 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eaf941-ec92-4a8f-af79-82bef96588ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:50.971908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eaf941-ec92-4a8f-af79-82bef96588ab None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:50.979208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 46/97] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:00:50 2022] GET /identity/v3/role_assignments?user.id=487e6099c4e64a10bbdf6b7df5e94d5c&scope.project.id=3f1f1193bc99470eb4863f0a1a231bdf&role.id=9aa9b054939e4fc1ad0387e43c500693 => generated 259 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:52.858688 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8a511-96c9-4377-82c9-e491863b989e None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:52.859747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8a511-96c9-4377-82c9-e491863b989e None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:52.860241 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8a511-96c9-4377-82c9-e491863b989e None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:52.861798 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 52/98] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:00:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:00:52.867889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06aad8-e79e-4f51-80a3-a82a2a09a113 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:52.868815 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06aad8-e79e-4f51-80a3-a82a2a09a113 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:52.869291 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06aad8-e79e-4f51-80a3-a82a2a09a113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:52.896459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-8c06aad8-e79e-4f51-80a3-a82a2a09a113 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:00:52.898185 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8c06aad8-e79e-4f51-80a3-a82a2a09a113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:00:52.982185 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 47/99] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:00:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:00:53.057088 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a6afc-ba34-47c9-812c-5d1b27fd0864 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:53.057705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a6afc-ba34-47c9-812c-5d1b27fd0864 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:53.058204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a6afc-ba34-47c9-812c-5d1b27fd0864 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:53.059856 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 53/100] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:00:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:00:53.065337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b9d2e-a412-408a-904b-8b8b90717e26 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:53.065890 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b9d2e-a412-408a-904b-8b8b90717e26 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:53.066366 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b9d2e-a412-408a-904b-8b8b90717e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:53.097693 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-aa6b9d2e-a412-408a-904b-8b8b90717e26 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:00:53.099321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-aa6b9d2e-a412-408a-904b-8b8b90717e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:00:53.191851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 48/101] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:00:53.517660 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a6afc-ba34-47c9-812c-5d1b27fd0864 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:53.557503 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ec494-28c4-400d-b0c7-0d9861d51b1b None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:53.558171 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ec494-28c4-400d-b0c7-0d9861d51b1b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:53.558652 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ec494-28c4-400d-b0c7-0d9861d51b1b None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:53.564826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 49/102] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:00:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:00:53.570934 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc3024-966a-4acb-a789-e4978e4804d9 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:53.571623 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc3024-966a-4acb-a789-e4978e4804d9 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:53.572128 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc3024-966a-4acb-a789-e4978e4804d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:53.618276 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-dfbc3024-966a-4acb-a789-e4978e4804d9 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:00:53.619853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-dfbc3024-966a-4acb-a789-e4978e4804d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:00:53.627788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:53.724316 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:53.739866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a6afc-ba34-47c9-812c-5d1b27fd0864 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:53.768282 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 50/103] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:00:53.769236 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc3024-966a-4acb-a789-e4978e4804d9 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:53.776574 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfeb5bf-e138-4f9d-a134-cc4aee0c1f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:53.777216 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfeb5bf-e138-4f9d-a134-cc4aee0c1f13 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:53.777506 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfeb5bf-e138-4f9d-a134-cc4aee0c1f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:53.777781 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfeb5bf-e138-4f9d-a134-cc4aee0c1f13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:53.788822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfeb5bf-e138-4f9d-a134-cc4aee0c1f13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:00:53.794150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-cdfeb5bf-e138-4f9d-a134-cc4aee0c1f13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:00:53.794150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:00:53.794150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:00:53.794150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:00:53.794150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:00:53.794150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:00:53.794150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:00:53.794150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:00:53.794150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:00:53.794150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:00:53.794150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:00:53.794150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:00:53.794150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:00:53.794150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:00:53.794150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:00:53.794150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:00:53.794999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:00:53.794999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:00:53.794999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:00:53.794999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:00:53.794999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:00:53.794999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:00:53.794999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:00:53.794999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:00:53.794999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:00:53.794999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:00:53.794999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:00:53.794999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:00:53.794999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:00:53.794999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:00:53.794999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:00:53.794999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:00:53.795793 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:00:53.795793 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:00:53.795793 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:00:53.795793 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:00:53.795793 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:00:53.795793 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:00:53.795793 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:00:53.795793 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:00:53.795793 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:00:53.795793 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:00:53.795793 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:00:53.795793 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:00:53.795793 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 54/104] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:00:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:00:53.796438 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677ec27-01cb-4883-bd58-65789d7a435c None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:53.797223 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677ec27-01cb-4883-bd58-65789d7a435c None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:53.797223 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677ec27-01cb-4883-bd58-65789d7a435c None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:53.798560 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 55/105] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:00:53.803906 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677ec27-01cb-4883-bd58-65789d7a435c None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:53.887294 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc3024-966a-4acb-a789-e4978e4804d9 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:53.909421 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677ec27-01cb-4883-bd58-65789d7a435c None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:53.931854 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:53.956833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bb460-3c0b-4a8d-8bc5-70c0a40ff110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:53.957495 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bb460-3c0b-4a8d-8bc5-70c0a40ff110 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:53.957783 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bb460-3c0b-4a8d-8bc5-70c0a40ff110 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:53.958061 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bb460-3c0b-4a8d-8bc5-70c0a40ff110 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:53.960762 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9775ff-fa42-4f3a-8cab-006441896e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:53.962614 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9775ff-fa42-4f3a-8cab-006441896e68 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:53.962899 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9775ff-fa42-4f3a-8cab-006441896e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:53.963176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9775ff-fa42-4f3a-8cab-006441896e68 None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:53.963887 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9775ff-fa42-4f3a-8cab-006441896e68 None admin] RBAC: Adding query filter params (name=member) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:00:53.964197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9775ff-fa42-4f3a-8cab-006441896e68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:53.966427 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9775ff-fa42-4f3a-8cab-006441896e68 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:53.980101 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4bb460-3c0b-4a8d-8bc5-70c0a40ff110 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:00:53.985703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-6d4bb460-3c0b-4a8d-8bc5-70c0a40ff110 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:00:53.985703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:00:53.985703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:00:53.985703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:00:53.985703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:00:53.985703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:00:53.985703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:00:53.985703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:00:53.985703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:00:53.985703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:00:53.985703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:00:53.985703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:00:53.985703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:00:53.985703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:00:53.985703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:00:53.985703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:00:53.986530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:00:53.986530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:00:53.986530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:00:53.986530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:00:53.986530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:00:53.986530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:00:53.986530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:00:53.986530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:00:53.986530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:00:53.986530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:00:53.986530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:00:53.986530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:00:53.986530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:00:53.986530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:00:53.986530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:00:53.986530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:00:53.987290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:00:53.987290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:00:53.987290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:00:53.987290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:00:53.987290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:00:53.987290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:00:53.987290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:00:53.987290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:00:53.987290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:00:53.987290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:00:53.987290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:00:53.987290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:00:53.987290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 51/106] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:00:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:00:53.989005 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 56/107] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:00:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:53.990111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47765d4-1d06-428b-b3fd-24142aa112cd None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:53.990941 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47765d4-1d06-428b-b3fd-24142aa112cd None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:53.991500 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47765d4-1d06-428b-b3fd-24142aa112cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:53.993656 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9775ff-fa42-4f3a-8cab-006441896e68 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:54.037424 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-a47765d4-1d06-428b-b3fd-24142aa112cd None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:00:54.038634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a47765d4-1d06-428b-b3fd-24142aa112cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:00:54.107675 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:54.144186 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9775ff-fa42-4f3a-8cab-006441896e68 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:54.158677 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 52/108] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:00:54.159916 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47765d4-1d06-428b-b3fd-24142aa112cd None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:54.182824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b877af4-1bfe-4237-8fcd-6ab8d9c86098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:54.183808 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b877af4-1bfe-4237-8fcd-6ab8d9c86098 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:54.184284 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b877af4-1bfe-4237-8fcd-6ab8d9c86098 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:54.184747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b877af4-1bfe-4237-8fcd-6ab8d9c86098 None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:54.185596 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b877af4-1bfe-4237-8fcd-6ab8d9c86098 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:00:54.186155 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b877af4-1bfe-4237-8fcd-6ab8d9c86098 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:54.189163 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b877af4-1bfe-4237-8fcd-6ab8d9c86098 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:54.198573 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 57/109] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:00:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:54.199786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b877af4-1bfe-4237-8fcd-6ab8d9c86098 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:54.232819 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:54.279454 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47765d4-1d06-428b-b3fd-24142aa112cd None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:54.307320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b877af4-1bfe-4237-8fcd-6ab8d9c86098 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:54.327730 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f965b2-3249-4371-92c1-f81c02a7256b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:54.328379 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f965b2-3249-4371-92c1-f81c02a7256b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:54.328659 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f965b2-3249-4371-92c1-f81c02a7256b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:54.328930 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f965b2-3249-4371-92c1-f81c02a7256b None admin] PATH_INFO: `/v3/users/487e6099c4e64a10bbdf6b7df5e94d5c` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:54.330241 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f965b2-3249-4371-92c1-f81c02a7256b None admin] RBAC: Authorizing `identity:get_user(user_id=487e6099c4e64a10bbdf6b7df5e94d5c)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:54.331622 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f965b2-3249-4371-92c1-f81c02a7256b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:54.333207 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 53/110] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:00:54 2022] GET /identity/v3/users/487e6099c4e64a10bbdf6b7df5e94d5c => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:54.333961 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f965b2-3249-4371-92c1-f81c02a7256b None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:54.367917 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32ec9a-bfe6-4244-b22b-138ca7e101eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:54.368551 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32ec9a-bfe6-4244-b22b-138ca7e101eb None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:54.368833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32ec9a-bfe6-4244-b22b-138ca7e101eb None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:54.369106 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32ec9a-bfe6-4244-b22b-138ca7e101eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:54.392527 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32ec9a-bfe6-4244-b22b-138ca7e101eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:00:54.397941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-8e32ec9a-bfe6-4244-b22b-138ca7e101eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:00:54.397941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:00:54.397941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:00:54.397941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:00:54.397941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:00:54.397941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:00:54.397941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:00:54.397941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:00:54.397941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:00:54.397941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:00:54.397941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:00:54.397941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:00:54.397941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:00:54.397941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:00:54.397941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:00:54.397941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:00:54.398792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:00:54.398792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:00:54.398792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:00:54.398792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:00:54.398792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:00:54.398792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:00:54.398792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:00:54.398792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:00:54.398792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:00:54.398792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:00:54.398792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:00:54.398792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:00:54.398792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:00:54.398792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:00:54.398792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:00:54.398792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:00:54.399634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:00:54.399634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:00:54.399634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:00:54.399634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:00:54.399634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:00:54.399634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:00:54.399634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:00:54.399634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:00:54.399634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:00:54.399634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:00:54.399634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:00:54.399634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:00:54.399634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 58/111] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 28 12:00:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:00:54.400253 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32ec9a-bfe6-4244-b22b-138ca7e101eb None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:54.406768 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:54.532804 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f965b2-3249-4371-92c1-f81c02a7256b None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:54.570478 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260da18-553f-432f-89bc-a4b726904aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:54.571224 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260da18-553f-432f-89bc-a4b726904aba None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:54.571329 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260da18-553f-432f-89bc-a4b726904aba None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:54.571682 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260da18-553f-432f-89bc-a4b726904aba None admin] PATH_INFO: `/v3/users/c57b54b073714d88bce939746c445771` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:54.572894 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260da18-553f-432f-89bc-a4b726904aba None admin] RBAC: Authorizing `identity:get_user(user_id=c57b54b073714d88bce939746c445771)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:54.574420 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260da18-553f-432f-89bc-a4b726904aba None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:54.574928 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:54.577015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 54/112] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:00:54 2022] GET /identity/v3/users/c57b54b073714d88bce939746c445771 => generated 247 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:54.577694 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260da18-553f-432f-89bc-a4b726904aba None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:54.587793 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32ec9a-bfe6-4244-b22b-138ca7e101eb None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:54.628447 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63276a89-3013-454c-87df-521a10a6250d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:54.629628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63276a89-3013-454c-87df-521a10a6250d None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:54.630012 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63276a89-3013-454c-87df-521a10a6250d None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:54.630292 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63276a89-3013-454c-87df-521a10a6250d None admin] PATH_INFO: `/v3/projects/0976a5e8d4d942399b8522e367e466ba` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:54.631557 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63276a89-3013-454c-87df-521a10a6250d None admin] RBAC: Authorizing `identity:get_project(project_id=0976a5e8d4d942399b8522e367e466ba)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:54.633024 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63276a89-3013-454c-87df-521a10a6250d None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:54.639359 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 59/113] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:00:54 2022] GET /identity/v3/projects/0976a5e8d4d942399b8522e367e466ba => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:54.639359 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63276a89-3013-454c-87df-521a10a6250d None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:54.685555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:54.689379 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260da18-553f-432f-89bc-a4b726904aba None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:54.725367 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88001be5-84bd-4990-919b-d3293299d3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:54.726039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88001be5-84bd-4990-919b-d3293299d3ce None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:54.726323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88001be5-84bd-4990-919b-d3293299d3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:54.726598 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88001be5-84bd-4990-919b-d3293299d3ce None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:54.727711 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88001be5-84bd-4990-919b-d3293299d3ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:00:54.728025 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88001be5-84bd-4990-919b-d3293299d3ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:54.730945 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88001be5-84bd-4990-919b-d3293299d3ce None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:54.740087 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 55/114] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:00:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:54.741858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88001be5-84bd-4990-919b-d3293299d3ce None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:54.742513 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63276a89-3013-454c-87df-521a10a6250d None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:54.777393 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f19d2c-9f44-4178-bfd3-ddf87c465554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:54.778033 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f19d2c-9f44-4178-bfd3-ddf87c465554 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:54.778316 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f19d2c-9f44-4178-bfd3-ddf87c465554 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:54.778588 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f19d2c-9f44-4178-bfd3-ddf87c465554 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:54.790100 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f19d2c-9f44-4178-bfd3-ddf87c465554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:00:54.795355 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-c5f19d2c-9f44-4178-bfd3-ddf87c465554 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:00:54.795355 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:00:54.795355 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:00:54.795355 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:00:54.795355 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:00:54.795355 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:00:54.795355 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:00:54.795355 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:00:54.795355 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:00:54.795355 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:00:54.795355 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:00:54.795355 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:00:54.795355 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:00:54.795355 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:00:54.795355 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:00:54.795355 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:00:54.796389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:00:54.796389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:00:54.796389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:00:54.796389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:00:54.796389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:00:54.796389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:00:54.796389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:00:54.796389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:00:54.796389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:00:54.796389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:00:54.796389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:00:54.796389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:00:54.796389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:00:54.796389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:00:54.796389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:00:54.796389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:00:54.797209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:00:54.797209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:00:54.797209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:00:54.797209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:00:54.797209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:00:54.797209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:00:54.797209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:00:54.797209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:00:54.797209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:00:54.797209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:00:54.797209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:00:54.797209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:00:54.797209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 60/115] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:00:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:00:54.800237 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c01130-10fb-4fda-9e5f-6de2185748f6 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:54.800992 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c01130-10fb-4fda-9e5f-6de2185748f6 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:54.801489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c01130-10fb-4fda-9e5f-6de2185748f6 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:54.803520 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 61/116] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:00:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:00:54.804387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c01130-10fb-4fda-9e5f-6de2185748f6 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:54.824370 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:54.863624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88001be5-84bd-4990-919b-d3293299d3ce None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:54.911166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0985947-4b7e-478f-b481-7d907e05523e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:54.913398 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0985947-4b7e-478f-b481-7d907e05523e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:54.913829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0985947-4b7e-478f-b481-7d907e05523e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:54.914284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0985947-4b7e-478f-b481-7d907e05523e None admin] PATH_INFO: `/v3/projects/0976a5e8d4d942399b8522e367e466ba` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:54.915728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c01130-10fb-4fda-9e5f-6de2185748f6 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:54.916206 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0985947-4b7e-478f-b481-7d907e05523e None admin] RBAC: Authorizing `identity:get_project(project_id=0976a5e8d4d942399b8522e367e466ba)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:54.918234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0985947-4b7e-478f-b481-7d907e05523e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:54.921167 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 56/117] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:00:54 2022] GET /identity/v3/projects/0976a5e8d4d942399b8522e367e466ba => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:54.922179 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0985947-4b7e-478f-b481-7d907e05523e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:54.965054 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:54.968345 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b52321-9c4b-4222-b748-b8d86459523d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:54.969015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b52321-9c4b-4222-b748-b8d86459523d None admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:54.969295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b52321-9c4b-4222-b748-b8d86459523d None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:54.969578 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b52321-9c4b-4222-b748-b8d86459523d None admin] PATH_INFO: `/v3/projects/0976a5e8d4d942399b8522e367e466ba/users/487e6099c4e64a10bbdf6b7df5e94d5c/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:54.971608 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b52321-9c4b-4222-b748-b8d86459523d None admin] RBAC: Authorizing `identity:create_grant(project_id=0976a5e8d4d942399b8522e367e466ba, user_id=487e6099c4e64a10bbdf6b7df5e94d5c, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:54.973074 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b52321-9c4b-4222-b748-b8d86459523d None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:54.986420 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 62/118] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 28 12:00:54 2022] PUT /identity/v3/projects/0976a5e8d4d942399b8522e367e466ba/users/487e6099c4e64a10bbdf6b7df5e94d5c/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:00:54.987191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b52321-9c4b-4222-b748-b8d86459523d None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:55.050872 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0985947-4b7e-478f-b481-7d907e05523e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:55.088161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:55.093960 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd9903-d605-4c35-9bd7-348f3e09e8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:55.094625 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd9903-d605-4c35-9bd7-348f3e09e8c4 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:55.094907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd9903-d605-4c35-9bd7-348f3e09e8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:55.095395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd9903-d605-4c35-9bd7-348f3e09e8c4 None admin] PATH_INFO: `/v3/users/487e6099c4e64a10bbdf6b7df5e94d5c` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:55.096900 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd9903-d605-4c35-9bd7-348f3e09e8c4 None admin] RBAC: Authorizing `identity:get_user(user_id=487e6099c4e64a10bbdf6b7df5e94d5c)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:55.098404 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd9903-d605-4c35-9bd7-348f3e09e8c4 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:55.105957 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 57/119] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:00:54 2022] GET /identity/v3/users/487e6099c4e64a10bbdf6b7df5e94d5c => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:55.105957 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1746a-a426-4721-b9de-9d985aa86b0b None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:55.105957 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1746a-a426-4721-b9de-9d985aa86b0b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:55.105957 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1746a-a426-4721-b9de-9d985aa86b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:55.124406 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-ead1746a-a426-4721-b9de-9d985aa86b0b None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:00:55.125657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ead1746a-a426-4721-b9de-9d985aa86b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:00:55.126525 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b52321-9c4b-4222-b748-b8d86459523d None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:55.165428 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e4b33-138b-48d6-af6c-310f940a6d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:55.166142 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e4b33-138b-48d6-af6c-310f940a6d69 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:55.166424 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e4b33-138b-48d6-af6c-310f940a6d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:55.166693 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e4b33-138b-48d6-af6c-310f940a6d69 None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:55.167362 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e4b33-138b-48d6-af6c-310f940a6d69 None admin] RBAC: Adding query filter params (name=member) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:00:55.168580 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e4b33-138b-48d6-af6c-310f940a6d69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:55.169988 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e4b33-138b-48d6-af6c-310f940a6d69 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:55.180325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 63/120] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:00:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:55.181537 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e4b33-138b-48d6-af6c-310f940a6d69 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:55.207083 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 58/121] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:00:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:00:55.208499 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dafd7-db8e-4c9a-a90b-17d05ed1b961 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:55.208810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dafd7-db8e-4c9a-a90b-17d05ed1b961 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:55.213248 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dafd7-db8e-4c9a-a90b-17d05ed1b961 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:55.214900 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 59/122] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:00:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:00:55.215799 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dafd7-db8e-4c9a-a90b-17d05ed1b961 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:55.256398 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:55.330310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e4b33-138b-48d6-af6c-310f940a6d69 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:55.351959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dafd7-db8e-4c9a-a90b-17d05ed1b961 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:55.369320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816ac28-ebef-4ef9-8428-e91e1061d4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:55.370552 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816ac28-ebef-4ef9-8428-e91e1061d4aa None admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:55.371149 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816ac28-ebef-4ef9-8428-e91e1061d4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:55.371733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816ac28-ebef-4ef9-8428-e91e1061d4aa None admin] PATH_INFO: `/v3/projects/0976a5e8d4d942399b8522e367e466ba/users/c57b54b073714d88bce939746c445771/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:55.373852 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816ac28-ebef-4ef9-8428-e91e1061d4aa None admin] RBAC: Authorizing `identity:create_grant(project_id=0976a5e8d4d942399b8522e367e466ba, user_id=c57b54b073714d88bce939746c445771, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:55.375514 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816ac28-ebef-4ef9-8428-e91e1061d4aa None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:55.393758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:55.396801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd670450-3e4c-4dcc-a825-2479a9bde09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:55.397795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd670450-3e4c-4dcc-a825-2479a9bde09f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:55.398255 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd670450-3e4c-4dcc-a825-2479a9bde09f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:55.398557 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 64/123] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 28 12:00:55 2022] PUT /identity/v3/projects/0976a5e8d4d942399b8522e367e466ba/users/c57b54b073714d88bce939746c445771/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:00:55.399089 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd670450-3e4c-4dcc-a825-2479a9bde09f None admin] PATH_INFO: `/v3/projects/0976a5e8d4d942399b8522e367e466ba` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:55.400166 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816ac28-ebef-4ef9-8428-e91e1061d4aa None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:55.401825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd670450-3e4c-4dcc-a825-2479a9bde09f None admin] RBAC: Authorizing `identity:get_project(project_id=0976a5e8d4d942399b8522e367e466ba)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:55.404030 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd670450-3e4c-4dcc-a825-2479a9bde09f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:55.407920 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 60/124] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:00:55 2022] GET /identity/v3/projects/0976a5e8d4d942399b8522e367e466ba => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:55.409464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abdab0-2baf-4265-9060-9574343c22df None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:55.409895 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abdab0-2baf-4265-9060-9574343c22df None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:55.410316 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abdab0-2baf-4265-9060-9574343c22df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:55.437699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-29abdab0-2baf-4265-9060-9574343c22df None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:00:55.439128 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-29abdab0-2baf-4265-9060-9574343c22df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:00:55.528803 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 61/125] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:00:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:00:55.535460 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abdab0-2baf-4265-9060-9574343c22df None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:55.569991 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816ac28-ebef-4ef9-8428-e91e1061d4aa None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:55.592829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:55.635559 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a6148-fb35-4bfc-86f4-6e5350afadde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:55.636129 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a6148-fb35-4bfc-86f4-6e5350afadde None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:55.636419 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a6148-fb35-4bfc-86f4-6e5350afadde None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:55.636703 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a6148-fb35-4bfc-86f4-6e5350afadde None admin] PATH_INFO: `/v3/users/487e6099c4e64a10bbdf6b7df5e94d5c` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:55.638280 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a6148-fb35-4bfc-86f4-6e5350afadde None admin] RBAC: Authorizing `identity:get_user(user_id=487e6099c4e64a10bbdf6b7df5e94d5c)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:55.639797 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a6148-fb35-4bfc-86f4-6e5350afadde None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:55.644398 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 65/126] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:00:55 2022] GET /identity/v3/users/487e6099c4e64a10bbdf6b7df5e94d5c => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:55.644398 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a6148-fb35-4bfc-86f4-6e5350afadde None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:55.699854 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abdab0-2baf-4265-9060-9574343c22df None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:55.725900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:55.745131 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a67c9-e36c-4f66-a387-e693f8cdc311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:55.746478 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a67c9-e36c-4f66-a387-e693f8cdc311 None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:55.747045 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a67c9-e36c-4f66-a387-e693f8cdc311 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:55.747603 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a67c9-e36c-4f66-a387-e693f8cdc311 None admin] PATH_INFO: `/v3/projects/0976a5e8d4d942399b8522e367e466ba/users/487e6099c4e64a10bbdf6b7df5e94d5c/roles/67ed180941fd45af996b858232628221` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:55.750156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a67c9-e36c-4f66-a387-e693f8cdc311 None admin] RBAC: Authorizing `identity:create_grant(project_id=0976a5e8d4d942399b8522e367e466ba, user_id=487e6099c4e64a10bbdf6b7df5e94d5c, role_id=67ed180941fd45af996b858232628221)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:55.751777 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a67c9-e36c-4f66-a387-e693f8cdc311 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:55.772266 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a6148-fb35-4bfc-86f4-6e5350afadde None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:55.789617 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 62/127] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 28 12:00:55 2022] PUT /identity/v3/projects/0976a5e8d4d942399b8522e367e466ba/users/487e6099c4e64a10bbdf6b7df5e94d5c/roles/67ed180941fd45af996b858232628221 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:00:55.790672 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a67c9-e36c-4f66-a387-e693f8cdc311 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:55.816149 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56846dc-dc0d-45bf-a9c2-f6280dd077a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:55.816971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56846dc-dc0d-45bf-a9c2-f6280dd077a9 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:55.817450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56846dc-dc0d-45bf-a9c2-f6280dd077a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:55.817867 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56846dc-dc0d-45bf-a9c2-f6280dd077a9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:55.833687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56846dc-dc0d-45bf-a9c2-f6280dd077a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:00:55.841065 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-f56846dc-dc0d-45bf-a9c2-f6280dd077a9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:00:55.841065 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:00:55.841065 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:00:55.841065 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:00:55.841065 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:00:55.841065 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:00:55.841065 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:00:55.841065 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:00:55.841065 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:00:55.841065 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:00:55.841065 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:00:55.841065 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:00:55.841065 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:00:55.841065 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:00:55.841065 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:00:55.841065 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:00:55.842083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:00:55.842083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:00:55.842083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:00:55.842083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:00:55.842083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:00:55.842083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:00:55.842083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:00:55.842083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:00:55.842083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:00:55.842083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:00:55.842083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:00:55.842083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:00:55.842083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:00:55.842083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:00:55.842083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:00:55.842083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:00:55.842856 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:00:55.842856 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:00:55.842856 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:00:55.842856 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:00:55.842856 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:00:55.842856 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:00:55.842856 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:00:55.842856 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:00:55.842856 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:00:55.842856 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:00:55.842856 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:00:55.842856 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:00:55.843456 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 66/128] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:00:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:00:55.844579 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56846dc-dc0d-45bf-a9c2-f6280dd077a9 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:55.983946 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56846dc-dc0d-45bf-a9c2-f6280dd077a9 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:56.018181 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:56.034825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:56.041549 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a67c9-e36c-4f66-a387-e693f8cdc311 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:56.046784 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423140f-4ef0-493e-90da-2d4092e561d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:56.047817 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423140f-4ef0-493e-90da-2d4092e561d0 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:56.048306 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423140f-4ef0-493e-90da-2d4092e561d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:56.048774 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423140f-4ef0-493e-90da-2d4092e561d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:56.050611 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423140f-4ef0-493e-90da-2d4092e561d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:56.052890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423140f-4ef0-493e-90da-2d4092e561d0 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:56.055142 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 67/129] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:00:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:56.056138 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423140f-4ef0-493e-90da-2d4092e561d0 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:56.083593 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3f509-51fb-493b-836f-af566ec56b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:56.084814 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3f509-51fb-493b-836f-af566ec56b86 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:56.085098 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3f509-51fb-493b-836f-af566ec56b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:56.085375 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3f509-51fb-493b-836f-af566ec56b86 None admin] PATH_INFO: `/v3/projects/3f1f1193bc99470eb4863f0a1a231bdf` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:56.092171 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3f509-51fb-493b-836f-af566ec56b86 None admin] RBAC: Authorizing `identity:get_project(project_id=3f1f1193bc99470eb4863f0a1a231bdf)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:56.093640 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3f509-51fb-493b-836f-af566ec56b86 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:56.095340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 63/130] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:00:55 2022] GET /identity/v3/projects/3f1f1193bc99470eb4863f0a1a231bdf => generated 312 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:56.096276 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3f509-51fb-493b-836f-af566ec56b86 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:56.183145 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423140f-4ef0-493e-90da-2d4092e561d0 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:56.221272 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665de8b-da50-4753-8374-d3ff15b27082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:56.222484 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665de8b-da50-4753-8374-d3ff15b27082 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:56.222960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665de8b-da50-4753-8374-d3ff15b27082 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:56.223468 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665de8b-da50-4753-8374-d3ff15b27082 None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:56.224862 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665de8b-da50-4753-8374-d3ff15b27082 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:00:56.225385 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665de8b-da50-4753-8374-d3ff15b27082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:56.226955 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665de8b-da50-4753-8374-d3ff15b27082 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:56.236219 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 68/131] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:00:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:56.237581 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665de8b-da50-4753-8374-d3ff15b27082 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:56.304531 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3f509-51fb-493b-836f-af566ec56b86 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:56.341348 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d8551-df13-48fb-8258-fc6a3935d51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:56.342311 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d8551-df13-48fb-8258-fc6a3935d51b None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:56.342785 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d8551-df13-48fb-8258-fc6a3935d51b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:56.343274 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d8551-df13-48fb-8258-fc6a3935d51b None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:56.344222 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d8551-df13-48fb-8258-fc6a3935d51b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:56.345863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d8551-df13-48fb-8258-fc6a3935d51b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:56.359808 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:56.376434 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 64/132] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 28 12:00:56 2022] POST /identity/v3/projects => generated 302 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:00:56.377626 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d8551-df13-48fb-8258-fc6a3935d51b None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:56.394068 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:56.493629 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665de8b-da50-4753-8374-d3ff15b27082 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:56.510980 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d8551-df13-48fb-8258-fc6a3935d51b None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:56.557270 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431b127-8a74-4c23-83e1-ca1cf851150f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:56.558429 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431b127-8a74-4c23-83e1-ca1cf851150f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:56.559037 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431b127-8a74-4c23-83e1-ca1cf851150f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:56.559764 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431b127-8a74-4c23-83e1-ca1cf851150f None admin] PATH_INFO: `/v3/users/355241918e4c42e7ae4e9983c4e93cf1` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:56.581888 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb2874-5a59-41fa-b3ca-c79fa70be7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:56.582898 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb2874-5a59-41fa-b3ca-c79fa70be7cf None admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:56.583418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb2874-5a59-41fa-b3ca-c79fa70be7cf None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:56.583927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb2874-5a59-41fa-b3ca-c79fa70be7cf None admin] PATH_INFO: `/v3/projects/3f1f1193bc99470eb4863f0a1a231bdf/users/487e6099c4e64a10bbdf6b7df5e94d5c/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:56.586681 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb2874-5a59-41fa-b3ca-c79fa70be7cf None admin] RBAC: Authorizing `identity:create_grant(project_id=3f1f1193bc99470eb4863f0a1a231bdf, user_id=487e6099c4e64a10bbdf6b7df5e94d5c, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:56.592305 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431b127-8a74-4c23-83e1-ca1cf851150f None admin] RBAC: Authorizing `identity:get_user(user_id=355241918e4c42e7ae4e9983c4e93cf1)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:56.593174 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb2874-5a59-41fa-b3ca-c79fa70be7cf None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:56.594328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431b127-8a74-4c23-83e1-ca1cf851150f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:56.596550 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 65/133] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:00:56 2022] GET /identity/v3/users/355241918e4c42e7ae4e9983c4e93cf1 => generated 289 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:56.602699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431b127-8a74-4c23-83e1-ca1cf851150f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:56.638056 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 69/134] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 28 12:00:56 2022] PUT /identity/v3/projects/3f1f1193bc99470eb4863f0a1a231bdf/users/487e6099c4e64a10bbdf6b7df5e94d5c/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:00:56.678462 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:56.721403 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431b127-8a74-4c23-83e1-ca1cf851150f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:56.760118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c49478-d969-461f-bd8b-3232a706cd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:56.760660 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c49478-d969-461f-bd8b-3232a706cd1c None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:56.760939 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c49478-d969-461f-bd8b-3232a706cd1c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:56.761209 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c49478-d969-461f-bd8b-3232a706cd1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:56.842836 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c49478-d969-461f-bd8b-3232a706cd1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:56.844378 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c49478-d969-461f-bd8b-3232a706cd1c None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:56.913011 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:56.958228 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 66/135] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:00:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 28 12:00:56.964540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb2874-5a59-41fa-b3ca-c79fa70be7cf None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:57.076782 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb2874-5a59-41fa-b3ca-c79fa70be7cf None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:57.094772 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:57.114613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5a117-518b-4f8f-9a80-1fc7e6ae3765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:57.116717 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5a117-518b-4f8f-9a80-1fc7e6ae3765 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:57.117386 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5a117-518b-4f8f-9a80-1fc7e6ae3765 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:57.118178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5a117-518b-4f8f-9a80-1fc7e6ae3765 None admin] PATH_INFO: `/v3/projects/0976a5e8d4d942399b8522e367e466ba` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:57.119490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5a117-518b-4f8f-9a80-1fc7e6ae3765 None admin] RBAC: Authorizing `identity:get_project(project_id=0976a5e8d4d942399b8522e367e466ba)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:57.120972 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5a117-518b-4f8f-9a80-1fc7e6ae3765 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:57.123074 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 70/136] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:00:56 2022] GET /identity/v3/projects/0976a5e8d4d942399b8522e367e466ba => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:57.128901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c49478-d969-461f-bd8b-3232a706cd1c None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:57.271386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c49478-d969-461f-bd8b-3232a706cd1c None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:57.322161 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a251ee-8c9a-49ff-8d8b-13c04c95ac27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:57.323246 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a251ee-8c9a-49ff-8d8b-13c04c95ac27 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:57.323794 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a251ee-8c9a-49ff-8d8b-13c04c95ac27 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:57.324237 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a251ee-8c9a-49ff-8d8b-13c04c95ac27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:57.325236 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a251ee-8c9a-49ff-8d8b-13c04c95ac27 None admin] RBAC: Adding query filter params (role.id=9f66f016692f4bff811f91c9fb372e57, scope.project.id=0976a5e8d4d942399b8522e367e466ba, user.id=355241918e4c42e7ae4e9983c4e93cf1) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:00:57.325549 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a251ee-8c9a-49ff-8d8b-13c04c95ac27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:57.327262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a251ee-8c9a-49ff-8d8b-13c04c95ac27 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:57.338082 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 67/137] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:00:57 2022] GET /identity/v3/role_assignments?user.id=355241918e4c42e7ae4e9983c4e93cf1&scope.project.id=0976a5e8d4d942399b8522e367e466ba&role.id=9f66f016692f4bff811f91c9fb372e57 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:57.896178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95725d39-66c5-4f2f-a94a-caf524ad175e None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:57.897095 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95725d39-66c5-4f2f-a94a-caf524ad175e None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:57.897297 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95725d39-66c5-4f2f-a94a-caf524ad175e None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:57.898803 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 71/138] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:00:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:00:57.904595 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70836705-8b72-4fc6-a566-e07876e97681 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:57.904876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70836705-8b72-4fc6-a566-e07876e97681 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:57.905147 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70836705-8b72-4fc6-a566-e07876e97681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:57.923466 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-70836705-8b72-4fc6-a566-e07876e97681 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:00:57.924672 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-70836705-8b72-4fc6-a566-e07876e97681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:00:57.949897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:58.002095 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 68/139] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:00:58.394041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52d18d-efda-4275-b796-a8f5965efeba None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:58.394590 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52d18d-efda-4275-b796-a8f5965efeba None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:58.394590 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52d18d-efda-4275-b796-a8f5965efeba None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:58.396305 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 72/140] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:00:58.413503 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c06558-01d5-4921-a200-f57efe65bf4a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:58.414412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c06558-01d5-4921-a200-f57efe65bf4a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:58.414898 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c06558-01d5-4921-a200-f57efe65bf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:58.445026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-81c06558-01d5-4921-a200-f57efe65bf4a None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:00:58.446533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-81c06558-01d5-4921-a200-f57efe65bf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:00:58.467739 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52d18d-efda-4275-b796-a8f5965efeba None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:58.649195 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 69/141] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:00:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:00:58.760704 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52d18d-efda-4275-b796-a8f5965efeba None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:58.846090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937272c4-b751-41bf-bc94-5dafe6612847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:58.846749 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937272c4-b751-41bf-bc94-5dafe6612847 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:58.847030 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937272c4-b751-41bf-bc94-5dafe6612847 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:58.847311 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937272c4-b751-41bf-bc94-5dafe6612847 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:58.876535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937272c4-b751-41bf-bc94-5dafe6612847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:00:58.881964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-937272c4-b751-41bf-bc94-5dafe6612847 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:00:58.881964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:00:58.881964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:00:58.881964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:00:58.881964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:00:58.881964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:00:58.881964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:00:58.881964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:00:58.881964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:00:58.881964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:00:58.881964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:00:58.881964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:00:58.881964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:00:58.881964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:00:58.881964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:00:58.881964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:00:58.882810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:00:58.882810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:00:58.882810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:00:58.882810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:00:58.882810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:00:58.882810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:00:58.882810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:00:58.882810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:00:58.882810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:00:58.882810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:00:58.882810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:00:58.882810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:00:58.882810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:00:58.882810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:00:58.882810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:00:58.882810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:00:58.883599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:00:58.883599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:00:58.883599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:00:58.883599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:00:58.883599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:00:58.883599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:00:58.883599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:00:58.883599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:00:58.883599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:00:58.883599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:00:58.883599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:00:58.883599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:00:58.883599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 73/142] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:00:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:00:58.890201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c06558-01d5-4921-a200-f57efe65bf4a None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:59.103800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:59.117720 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c06558-01d5-4921-a200-f57efe65bf4a None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:59.158909 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04faafdd-d00a-4b01-b89e-1e4c752ecfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:59.159558 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faafdd-d00a-4b01-b89e-1e4c752ecfc5 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:59.159840 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faafdd-d00a-4b01-b89e-1e4c752ecfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:59.160117 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faafdd-d00a-4b01-b89e-1e4c752ecfc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:59.160795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04faafdd-d00a-4b01-b89e-1e4c752ecfc5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:00:59.161103 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04faafdd-d00a-4b01-b89e-1e4c752ecfc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:59.163045 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04faafdd-d00a-4b01-b89e-1e4c752ecfc5 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:59.180031 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 70/143] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:00:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:59.188526 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937272c4-b751-41bf-bc94-5dafe6612847 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:59.260537 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04faafdd-d00a-4b01-b89e-1e4c752ecfc5 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:59.280888 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:59.374906 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937272c4-b751-41bf-bc94-5dafe6612847 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:59.434243 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d16064-83bd-42ea-9371-86e6cd78439a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:59.440387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d16064-83bd-42ea-9371-86e6cd78439a None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:59.440725 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d16064-83bd-42ea-9371-86e6cd78439a None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:59.441010 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d16064-83bd-42ea-9371-86e6cd78439a None admin] PATH_INFO: `/v3/users/487e6099c4e64a10bbdf6b7df5e94d5c` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:59.442452 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d16064-83bd-42ea-9371-86e6cd78439a None admin] RBAC: Authorizing `identity:get_user(user_id=487e6099c4e64a10bbdf6b7df5e94d5c)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:59.444528 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d16064-83bd-42ea-9371-86e6cd78439a None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:59.446314 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 74/144] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:00:59 2022] GET /identity/v3/users/487e6099c4e64a10bbdf6b7df5e94d5c => generated 275 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:00:59.452468 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e23799-5796-4ecc-b8ec-829e05cb2b38 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:59.452818 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e23799-5796-4ecc-b8ec-829e05cb2b38 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:59.453104 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e23799-5796-4ecc-b8ec-829e05cb2b38 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:59.455580 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 75/145] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:00:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:00:59.456309 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e23799-5796-4ecc-b8ec-829e05cb2b38 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:59.496627 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04faafdd-d00a-4b01-b89e-1e4c752ecfc5 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:59.565913 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e4be9-30a8-4130-900a-ff46427220a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:59.566928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e4be9-30a8-4130-900a-ff46427220a6 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:59.567406 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e4be9-30a8-4130-900a-ff46427220a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:59.567940 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e4be9-30a8-4130-900a-ff46427220a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:59.585329 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e4be9-30a8-4130-900a-ff46427220a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:00:59.591737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-720e4be9-30a8-4130-900a-ff46427220a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:00:59.591737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:00:59.591737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:00:59.591737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:00:59.591737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:00:59.591737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:00:59.591737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:00:59.591737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:00:59.591737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:00:59.591737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:00:59.591737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:00:59.591737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:00:59.591737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:00:59.591737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:00:59.591737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:00:59.591737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:00:59.592649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:00:59.592649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:00:59.592649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:00:59.592649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:00:59.592649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:00:59.592649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:00:59.592649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:00:59.592649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:00:59.592649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:00:59.592649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:00:59.592649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:00:59.592649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:00:59.592649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:00:59.592649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:00:59.592649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:00:59.592649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:00:59.593445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:00:59.593445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:00:59.593445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:00:59.593445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:00:59.593445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:00:59.593445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:00:59.593445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:00:59.593445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:00:59.593445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:00:59.593445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:00:59.593445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:00:59.593445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:00:59.599095 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 71/146] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:00:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:00:59.601642 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4680f23-c862-43b6-8422-38fc042b0230 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:59.603985 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4680f23-c862-43b6-8422-38fc042b0230 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:59.605290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4680f23-c862-43b6-8422-38fc042b0230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:59.632854 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-c4680f23-c862-43b6-8422-38fc042b0230 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:00:59.635101 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c4680f23-c862-43b6-8422-38fc042b0230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:00:59.645131 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:59.667097 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e23799-5796-4ecc-b8ec-829e05cb2b38 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:00:59.690674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:00:59.731288 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385aa6f-9587-4b84-b5e2-dfadb41fe9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:00:59.731522 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385aa6f-9587-4b84-b5e2-dfadb41fe9eb None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:00:59.731895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385aa6f-9587-4b84-b5e2-dfadb41fe9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:00:59.732013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385aa6f-9587-4b84-b5e2-dfadb41fe9eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:00:59.768745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 72/147] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:00:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:00:59.769667 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4680f23-c862-43b6-8422-38fc042b0230 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:00:59.856175 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385aa6f-9587-4b84-b5e2-dfadb41fe9eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:00:59.857650 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385aa6f-9587-4b84-b5e2-dfadb41fe9eb None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:00:59.947148 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4680f23-c862-43b6-8422-38fc042b0230 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:00.011868 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2627a44-2aaa-43af-98bf-47100e7638aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:00.012493 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2627a44-2aaa-43af-98bf-47100e7638aa None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:00.012773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2627a44-2aaa-43af-98bf-47100e7638aa None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:00.013042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2627a44-2aaa-43af-98bf-47100e7638aa None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:00.013714 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2627a44-2aaa-43af-98bf-47100e7638aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:00.014015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2627a44-2aaa-43af-98bf-47100e7638aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:00.015411 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2627a44-2aaa-43af-98bf-47100e7638aa None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:00.029893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 73/148] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:00:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:00.039766 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2627a44-2aaa-43af-98bf-47100e7638aa None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:00.045822 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:00.072180 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 76/149] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:00:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:01:00.077427 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385aa6f-9587-4b84-b5e2-dfadb41fe9eb None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:00.109505 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:00.193349 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2627a44-2aaa-43af-98bf-47100e7638aa None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:00.225315 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385aa6f-9587-4b84-b5e2-dfadb41fe9eb None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:00.233919 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1d5a1-4348-40a8-8983-0791cbda0e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:00.234560 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1d5a1-4348-40a8-8983-0791cbda0e7a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:00.234840 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1d5a1-4348-40a8-8983-0791cbda0e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:00.235109 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1d5a1-4348-40a8-8983-0791cbda0e7a None admin] PATH_INFO: `/v3/users/c57b54b073714d88bce939746c445771` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:00.236269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1d5a1-4348-40a8-8983-0791cbda0e7a None admin] RBAC: Authorizing `identity:get_user(user_id=c57b54b073714d88bce939746c445771)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:00.237718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1d5a1-4348-40a8-8983-0791cbda0e7a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:00.239293 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 74/150] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:01:00 2022] GET /identity/v3/users/c57b54b073714d88bce939746c445771 => generated 247 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:00.240987 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c2b01-d0b8-483f-9393-e1e3a64ecb78 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:00.241514 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c2b01-d0b8-483f-9393-e1e3a64ecb78 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:00.241781 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c2b01-d0b8-483f-9393-e1e3a64ecb78 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:00.243106 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 75/151] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:00.243684 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c2b01-d0b8-483f-9393-e1e3a64ecb78 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:00.267535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d2e3c-b785-4593-9034-b4ff5be8abad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:00.268461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d2e3c-b785-4593-9034-b4ff5be8abad None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:00.268744 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d2e3c-b785-4593-9034-b4ff5be8abad None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:00.269018 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d2e3c-b785-4593-9034-b4ff5be8abad None admin] PATH_INFO: `/v3/projects/0976a5e8d4d942399b8522e367e466ba` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:00.270159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d2e3c-b785-4593-9034-b4ff5be8abad None admin] RBAC: Authorizing `identity:get_project(project_id=0976a5e8d4d942399b8522e367e466ba)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:00.272125 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d2e3c-b785-4593-9034-b4ff5be8abad None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:00.278603 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 77/152] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:00 2022] GET /identity/v3/projects/0976a5e8d4d942399b8522e367e466ba => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:00.278603 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b46c1-518f-4cb5-bd7c-539dcbd17038 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:00.278603 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b46c1-518f-4cb5-bd7c-539dcbd17038 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:00.278603 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b46c1-518f-4cb5-bd7c-539dcbd17038 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:00.278603 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 78/153] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:00.278603 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234855b-5fde-4096-94a4-e261cea81965 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:00.279025 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234855b-5fde-4096-94a4-e261cea81965 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:00.279025 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234855b-5fde-4096-94a4-e261cea81965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:00.296781 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-a234855b-5fde-4096-94a4-e261cea81965 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:00.297967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-a234855b-5fde-4096-94a4-e261cea81965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:00.328003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:00.361931 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c2b01-d0b8-483f-9393-e1e3a64ecb78 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:00.369529 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 79/154] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:00.370370 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234855b-5fde-4096-94a4-e261cea81965 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:00.384245 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:00.403678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180fa0a-393f-43cc-9548-9081c46f4377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:00.404311 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180fa0a-393f-43cc-9548-9081c46f4377 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:00.404592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180fa0a-393f-43cc-9548-9081c46f4377 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:00.404863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180fa0a-393f-43cc-9548-9081c46f4377 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:00.419918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180fa0a-393f-43cc-9548-9081c46f4377 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:00.425321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-6180fa0a-393f-43cc-9548-9081c46f4377 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:01:00.425321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:00.425321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:00.425321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:00.425321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:00.425321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:00.425321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:00.425321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:00.425321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:00.425321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:00.425321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:00.425321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:00.425321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:00.425321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:00.425321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:00.425321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:00.426386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:00.426386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:00.426386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:00.426386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:00.426386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:00.426386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:00.426386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:00.426386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:00.426386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:00.426386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:00.426386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:00.426386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:00.426386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:00.426386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:00.426386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:00.426386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:00.427343 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:00.427343 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:00.427343 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:00.427343 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:00.427343 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:00.427343 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:00.427343 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:00.427343 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:00.427343 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:00.427343 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:00.427343 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:01:00.427343 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:00.427343 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 76/155] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 28 12:01:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:00.427343 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180fa0a-393f-43cc-9548-9081c46f4377 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:00.482017 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234855b-5fde-4096-94a4-e261cea81965 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:00.520595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323ebe5-041e-4742-9445-0456dd42712d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:00.521209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323ebe5-041e-4742-9445-0456dd42712d None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:00.521543 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323ebe5-041e-4742-9445-0456dd42712d None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:00.521817 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323ebe5-041e-4742-9445-0456dd42712d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:00.530594 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180fa0a-393f-43cc-9548-9081c46f4377 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:00.559736 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:00.566178 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707b3d9-7b6c-4792-965e-ffb86822ec01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:00.566778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707b3d9-7b6c-4792-965e-ffb86822ec01 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:00.567059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707b3d9-7b6c-4792-965e-ffb86822ec01 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:00.567327 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707b3d9-7b6c-4792-965e-ffb86822ec01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:00.568120 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707b3d9-7b6c-4792-965e-ffb86822ec01 None admin] RBAC: Adding query filter params (role.id=9aa9b054939e4fc1ad0387e43c500693, scope.project.id=0976a5e8d4d942399b8522e367e466ba, user.id=487e6099c4e64a10bbdf6b7df5e94d5c) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:00.568438 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707b3d9-7b6c-4792-965e-ffb86822ec01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:00.569919 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707b3d9-7b6c-4792-965e-ffb86822ec01 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:00.576061 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 77/156] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:01:00 2022] GET /identity/v3/role_assignments?user.id=487e6099c4e64a10bbdf6b7df5e94d5c&scope.project.id=0976a5e8d4d942399b8522e367e466ba&role.id=9aa9b054939e4fc1ad0387e43c500693 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:00.577191 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098588cf-ca25-4495-9533-6a4f3ffa5024 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:00.577476 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098588cf-ca25-4495-9533-6a4f3ffa5024 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:00.577750 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098588cf-ca25-4495-9533-6a4f3ffa5024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:00.603044 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323ebe5-041e-4742-9445-0456dd42712d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:00.603802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-098588cf-ca25-4495-9533-6a4f3ffa5024 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:00.605038 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-098588cf-ca25-4495-9533-6a4f3ffa5024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:00.605296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323ebe5-041e-4742-9445-0456dd42712d None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:00.621880 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:00.687769 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 78/157] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:00.695676 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd53189-a2af-4fbc-afa4-c29d19f3055e None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:00.695676 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd53189-a2af-4fbc-afa4-c29d19f3055e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:00.695676 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd53189-a2af-4fbc-afa4-c29d19f3055e None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:00.695676 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 79/158] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:00.695676 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd53189-a2af-4fbc-afa4-c29d19f3055e None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:00.734293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 80/159] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:01:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:01:00.735331 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323ebe5-041e-4742-9445-0456dd42712d None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:00.831002 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd53189-a2af-4fbc-afa4-c29d19f3055e None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:00.860368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323ebe5-041e-4742-9445-0456dd42712d None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:00.872463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:00.874704 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:00.881926 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b032c-114c-4ef3-a460-ac38d23bcb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:00.882551 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b032c-114c-4ef3-a460-ac38d23bcb6a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:00.882830 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b032c-114c-4ef3-a460-ac38d23bcb6a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:00.883103 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b032c-114c-4ef3-a460-ac38d23bcb6a None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:00.889010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b032c-114c-4ef3-a460-ac38d23bcb6a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:00.889010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b032c-114c-4ef3-a460-ac38d23bcb6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:00.889010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b032c-114c-4ef3-a460-ac38d23bcb6a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:00.895814 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 80/160] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:01:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:00.897847 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17238d0-9ae7-4e77-8bc2-e0ec326fbf85 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:00.898137 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17238d0-9ae7-4e77-8bc2-e0ec326fbf85 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:00.898412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17238d0-9ae7-4e77-8bc2-e0ec326fbf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:00.900246 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b1ceb-5367-42fb-9b6c-48c2e5d9fc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:00.901166 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b1ceb-5367-42fb-9b6c-48c2e5d9fc74 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:00.901295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b1ceb-5367-42fb-9b6c-48c2e5d9fc74 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:00.901593 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b1ceb-5367-42fb-9b6c-48c2e5d9fc74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:00.913209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b1ceb-5367-42fb-9b6c-48c2e5d9fc74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:00.917957 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-e17238d0-9ae7-4e77-8bc2-e0ec326fbf85 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:00.918133 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-2b5b1ceb-5367-42fb-9b6c-48c2e5d9fc74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:01:00.918133 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:00.918133 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:00.918133 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:00.918133 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:00.918133 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:00.918133 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:00.918133 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:00.918133 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:00.918133 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:00.918133 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:00.918133 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:00.918133 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:00.918133 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:00.918133 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:00.918133 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:00.919083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:00.919083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:00.919083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:00.919083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:00.919083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:00.919083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:00.919083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:00.919083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:00.919083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:00.919083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:00.919083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:00.919083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:00.919083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:00.919083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:00.919083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:00.919083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:00.920212 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:00.920212 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:00.920212 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:00.920212 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:00.920212 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:00.920212 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:00.920212 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:00.920212 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:00.920212 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:00.920212 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:00.920212 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:01:00.920212 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:00.920872 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e17238d0-9ae7-4e77-8bc2-e0ec326fbf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:00.920953 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 81/161] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:00.920953 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b1ceb-5367-42fb-9b6c-48c2e5d9fc74 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:00.996999 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 81/162] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:00.997773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17238d0-9ae7-4e77-8bc2-e0ec326fbf85 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:01.034297 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b1ceb-5367-42fb-9b6c-48c2e5d9fc74 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:01.071404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da4093-a9c0-491e-a66e-e7cca9d9636e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:01.072696 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da4093-a9c0-491e-a66e-e7cca9d9636e None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:01.073169 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da4093-a9c0-491e-a66e-e7cca9d9636e None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:01.073640 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da4093-a9c0-491e-a66e-e7cca9d9636e None admin] PATH_INFO: `/v3/projects/0976a5e8d4d942399b8522e367e466ba` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:01.075064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da4093-a9c0-491e-a66e-e7cca9d9636e None admin] RBAC: Authorizing `identity:get_project(project_id=0976a5e8d4d942399b8522e367e466ba)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:01.076872 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da4093-a9c0-491e-a66e-e7cca9d9636e None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:01.078979 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 82/163] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:00 2022] GET /identity/v3/projects/0976a5e8d4d942399b8522e367e466ba => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:01.079990 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da4093-a9c0-491e-a66e-e7cca9d9636e None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:01.109378 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17238d0-9ae7-4e77-8bc2-e0ec326fbf85 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:01.125731 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:01.127594 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:01.147088 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35e9cc-6bd1-4f07-8871-57d465b039f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:01.147739 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35e9cc-6bd1-4f07-8871-57d465b039f6 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:01.148014 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35e9cc-6bd1-4f07-8871-57d465b039f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:01.148355 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35e9cc-6bd1-4f07-8871-57d465b039f6 None admin] PATH_INFO: `/v3/users/487e6099c4e64a10bbdf6b7df5e94d5c` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:01.149487 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35e9cc-6bd1-4f07-8871-57d465b039f6 None admin] RBAC: Authorizing `identity:get_user(user_id=487e6099c4e64a10bbdf6b7df5e94d5c)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:01.150920 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35e9cc-6bd1-4f07-8871-57d465b039f6 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:01.152724 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 82/164] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:01:00 2022] GET /identity/v3/users/487e6099c4e64a10bbdf6b7df5e94d5c => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:01.153268 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35e9cc-6bd1-4f07-8871-57d465b039f6 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:01.190179 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da4093-a9c0-491e-a66e-e7cca9d9636e None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:01.223057 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cacc5-4864-4e98-89b3-4a2bba9cd3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:01.223691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cacc5-4864-4e98-89b3-4a2bba9cd3fb None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:01.223975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cacc5-4864-4e98-89b3-4a2bba9cd3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:01.224249 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cacc5-4864-4e98-89b3-4a2bba9cd3fb None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:01.225534 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4cacc5-4864-4e98-89b3-4a2bba9cd3fb None admin] RBAC: Adding query filter params (name=member) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:01.225823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4cacc5-4864-4e98-89b3-4a2bba9cd3fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:01.227197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4cacc5-4864-4e98-89b3-4a2bba9cd3fb None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:01.235365 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 83/165] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:01:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:01.236412 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cacc5-4864-4e98-89b3-4a2bba9cd3fb None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:01.266111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35e9cc-6bd1-4f07-8871-57d465b039f6 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:01.299784 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06699e57-08c1-40cd-bb1f-47468a27e754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:01.300405 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06699e57-08c1-40cd-bb1f-47468a27e754 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:01.300678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06699e57-08c1-40cd-bb1f-47468a27e754 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:01.300947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06699e57-08c1-40cd-bb1f-47468a27e754 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:01.311309 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06699e57-08c1-40cd-bb1f-47468a27e754 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:01.316092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-06699e57-08c1-40cd-bb1f-47468a27e754 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:01:01.316092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:01.316092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:01.316092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:01.316092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:01.316092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:01.316092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:01.316092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:01.316092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:01.316092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:01.316092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:01.316092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:01.316092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:01.316092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:01.316092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:01.316092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:01.317016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:01.317016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:01.317016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:01.317016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:01.317016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:01.317016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:01.317016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:01.317016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:01.317016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:01.317016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:01.317016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:01.317016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:01.317016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:01.317016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:01.317016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:01.317016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:01.317801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:01.317801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:01.317801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:01.317801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:01.317801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:01.317801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:01.317801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:01.317801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:01.317801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:01.317801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:01.317801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:01:01.317801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:01.317801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 83/166] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:01.319606 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06699e57-08c1-40cd-bb1f-47468a27e754 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:01.337180 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cacc5-4864-4e98-89b3-4a2bba9cd3fb None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:01.338725 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:01.367163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:01.373400 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f14364-a526-4fab-b4ed-0c65f38262e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:01.374008 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f14364-a526-4fab-b4ed-0c65f38262e9 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:01.374284 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f14364-a526-4fab-b4ed-0c65f38262e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:01.374550 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f14364-a526-4fab-b4ed-0c65f38262e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:01.375275 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f14364-a526-4fab-b4ed-0c65f38262e9 None admin] RBAC: Adding query filter params (role.id=66456d39fc0c496c8f290a436b726216, scope.project.id=0976a5e8d4d942399b8522e367e466ba, user.id=c57b54b073714d88bce939746c445771) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:01.375621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f14364-a526-4fab-b4ed-0c65f38262e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:01.377035 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f14364-a526-4fab-b4ed-0c65f38262e9 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:01.382751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 84/167] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:01:01 2022] GET /identity/v3/role_assignments?user.id=c57b54b073714d88bce939746c445771&scope.project.id=0976a5e8d4d942399b8522e367e466ba&role.id=66456d39fc0c496c8f290a436b726216 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:01.383346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f14364-a526-4fab-b4ed-0c65f38262e9 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:01.433995 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06699e57-08c1-40cd-bb1f-47468a27e754 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:01.472501 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446409c6-4e6f-4791-90f3-86947b849822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:01.473121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446409c6-4e6f-4791-90f3-86947b849822 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:01.473396 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446409c6-4e6f-4791-90f3-86947b849822 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:01.473665 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446409c6-4e6f-4791-90f3-86947b849822 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:01.500950 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f14364-a526-4fab-b4ed-0c65f38262e9 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:01.541052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca716eb1-89e6-4ab0-970b-442c0ebedb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:01.541614 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca716eb1-89e6-4ab0-970b-442c0ebedb95 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:01.541908 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca716eb1-89e6-4ab0-970b-442c0ebedb95 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:01.542470 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca716eb1-89e6-4ab0-970b-442c0ebedb95 None admin] PATH_INFO: `/v3/users/487e6099c4e64a10bbdf6b7df5e94d5c` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:01.543373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca716eb1-89e6-4ab0-970b-442c0ebedb95 None admin] RBAC: Authorizing `identity:get_user(user_id=487e6099c4e64a10bbdf6b7df5e94d5c)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:01.544948 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca716eb1-89e6-4ab0-970b-442c0ebedb95 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:01.551182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 85/168] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:01:01 2022] GET /identity/v3/users/487e6099c4e64a10bbdf6b7df5e94d5c => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:01.551182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca716eb1-89e6-4ab0-970b-442c0ebedb95 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:01.558212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446409c6-4e6f-4791-90f3-86947b849822 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:01.559736 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446409c6-4e6f-4791-90f3-86947b849822 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:01.596164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:01.612614 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:01.668454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca716eb1-89e6-4ab0-970b-442c0ebedb95 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:01.674124 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 84/169] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:01:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:01:01.674961 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446409c6-4e6f-4791-90f3-86947b849822 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:01.703760 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f72d26-6d96-4978-94b1-2b39406b4be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:01.704489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f72d26-6d96-4978-94b1-2b39406b4be9 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:01.704646 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f72d26-6d96-4978-94b1-2b39406b4be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:01.704918 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f72d26-6d96-4978-94b1-2b39406b4be9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:01.706024 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f72d26-6d96-4978-94b1-2b39406b4be9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:01.707497 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f72d26-6d96-4978-94b1-2b39406b4be9 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:01.709280 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 86/170] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:01.709962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f72d26-6d96-4978-94b1-2b39406b4be9 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:01.781378 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446409c6-4e6f-4791-90f3-86947b849822 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:01.810972 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f72d26-6d96-4978-94b1-2b39406b4be9 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:01.812586 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:01.815456 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15d1fd-826b-49ba-881e-87425b4bc817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:01.816078 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15d1fd-826b-49ba-881e-87425b4bc817 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:01.816357 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15d1fd-826b-49ba-881e-87425b4bc817 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:01.816626 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15d1fd-826b-49ba-881e-87425b4bc817 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:01.817289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a15d1fd-826b-49ba-881e-87425b4bc817 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:01.817593 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a15d1fd-826b-49ba-881e-87425b4bc817 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:01.819522 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a15d1fd-826b-49ba-881e-87425b4bc817 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:01.827556 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 85/171] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:01:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:01.828329 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15d1fd-826b-49ba-881e-87425b4bc817 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:01.839650 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:01.847663 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165ec8e-a673-44bf-938b-02c92e7c55f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:01.848269 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165ec8e-a673-44bf-938b-02c92e7c55f5 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:01.848543 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165ec8e-a673-44bf-938b-02c92e7c55f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:01.848812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165ec8e-a673-44bf-938b-02c92e7c55f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:01.916183 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0165ec8e-a673-44bf-938b-02c92e7c55f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:01.917649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0165ec8e-a673-44bf-938b-02c92e7c55f5 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:01.931218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15d1fd-826b-49ba-881e-87425b4bc817 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:01.963251 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823aedcf-67a6-422e-9be9-b8f23224c2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:01.963901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823aedcf-67a6-422e-9be9-b8f23224c2ea None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:01.964178 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823aedcf-67a6-422e-9be9-b8f23224c2ea None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:01.964456 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823aedcf-67a6-422e-9be9-b8f23224c2ea None admin] PATH_INFO: `/v3/projects/0976a5e8d4d942399b8522e367e466ba` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:01.965571 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823aedcf-67a6-422e-9be9-b8f23224c2ea None admin] RBAC: Authorizing `identity:get_project(project_id=0976a5e8d4d942399b8522e367e466ba)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:01.967003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823aedcf-67a6-422e-9be9-b8f23224c2ea None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:01.968873 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 86/172] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:01 2022] GET /identity/v3/projects/0976a5e8d4d942399b8522e367e466ba => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:01.969397 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823aedcf-67a6-422e-9be9-b8f23224c2ea None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:02.015077 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 87/173] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:01:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:01:02.015943 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165ec8e-a673-44bf-938b-02c92e7c55f5 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:02.018313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:02.045809 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:02.070934 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823aedcf-67a6-422e-9be9-b8f23224c2ea None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:02.104239 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48352cf3-4f48-46f7-9bac-bd1401fe6d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:02.104840 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48352cf3-4f48-46f7-9bac-bd1401fe6d07 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:02.105116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48352cf3-4f48-46f7-9bac-bd1401fe6d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:02.105388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48352cf3-4f48-46f7-9bac-bd1401fe6d07 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:02.106033 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48352cf3-4f48-46f7-9bac-bd1401fe6d07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:02.107482 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48352cf3-4f48-46f7-9bac-bd1401fe6d07 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:02.114321 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165ec8e-a673-44bf-938b-02c92e7c55f5 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:02.129949 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 87/174] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 28 12:01:01 2022] POST /identity/v3/users => generated 283 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:01:02.131505 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48352cf3-4f48-46f7-9bac-bd1401fe6d07 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:02.154207 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf49f7f-8163-48dd-9fa3-478c9dd3f72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:02.154861 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf49f7f-8163-48dd-9fa3-478c9dd3f72a None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:02.155139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf49f7f-8163-48dd-9fa3-478c9dd3f72a None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:02.155411 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf49f7f-8163-48dd-9fa3-478c9dd3f72a None admin] PATH_INFO: `/v3/users/355241918e4c42e7ae4e9983c4e93cf1` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:02.156696 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf49f7f-8163-48dd-9fa3-478c9dd3f72a None admin] RBAC: Authorizing `identity:get_user(user_id=355241918e4c42e7ae4e9983c4e93cf1)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:02.158187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf49f7f-8163-48dd-9fa3-478c9dd3f72a None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:02.160087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 88/175] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:01:02 2022] GET /identity/v3/users/355241918e4c42e7ae4e9983c4e93cf1 => generated 289 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:02.160831 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf49f7f-8163-48dd-9fa3-478c9dd3f72a None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:02.237283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:02.261556 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48352cf3-4f48-46f7-9bac-bd1401fe6d07 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:02.272926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf49f7f-8163-48dd-9fa3-478c9dd3f72a None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:02.295300 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:02.303799 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af337618-469b-4b01-8b47-875b690390df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:02.304419 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af337618-469b-4b01-8b47-875b690390df None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:02.304698 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af337618-469b-4b01-8b47-875b690390df None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:02.304970 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af337618-469b-4b01-8b47-875b690390df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:02.305715 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af337618-469b-4b01-8b47-875b690390df None admin] RBAC: Adding query filter params (role.id=67ed180941fd45af996b858232628221, scope.project.id=0976a5e8d4d942399b8522e367e466ba, user.id=487e6099c4e64a10bbdf6b7df5e94d5c) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:02.306030 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af337618-469b-4b01-8b47-875b690390df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:02.307496 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af337618-469b-4b01-8b47-875b690390df None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:02.319492 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 88/176] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:01:02 2022] GET /identity/v3/role_assignments?user.id=487e6099c4e64a10bbdf6b7df5e94d5c&scope.project.id=0976a5e8d4d942399b8522e367e466ba&role.id=67ed180941fd45af996b858232628221 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:02.319492 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af337618-469b-4b01-8b47-875b690390df None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:02.319754 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8b80d-2b3b-4c51-9a19-d60149f39eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:02.319754 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8b80d-2b3b-4c51-9a19-d60149f39eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:02.319754 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8b80d-2b3b-4c51-9a19-d60149f39eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:02.319754 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8b80d-2b3b-4c51-9a19-d60149f39eb1 None admin] PATH_INFO: `/v3/projects/3f1f1193bc99470eb4863f0a1a231bdf` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:02.320085 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8b80d-2b3b-4c51-9a19-d60149f39eb1 None admin] RBAC: Authorizing `identity:get_project(project_id=3f1f1193bc99470eb4863f0a1a231bdf)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:02.322023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8b80d-2b3b-4c51-9a19-d60149f39eb1 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:02.324272 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 89/177] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:02 2022] GET /identity/v3/projects/3f1f1193bc99470eb4863f0a1a231bdf => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:02.330527 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8b80d-2b3b-4c51-9a19-d60149f39eb1 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:02.448802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af337618-469b-4b01-8b47-875b690390df None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:02.469110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8b80d-2b3b-4c51-9a19-d60149f39eb1 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:02.504533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5633e4-14d0-411e-b9b6-16e7bf323f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:02.505671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5633e4-14d0-411e-b9b6-16e7bf323f00 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:02.506608 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5633e4-14d0-411e-b9b6-16e7bf323f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:02.507130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5633e4-14d0-411e-b9b6-16e7bf323f00 None admin] PATH_INFO: `/v3/projects/0976a5e8d4d942399b8522e367e466ba` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:02.508594 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5633e4-14d0-411e-b9b6-16e7bf323f00 None admin] RBAC: Authorizing `identity:get_project(project_id=0976a5e8d4d942399b8522e367e466ba)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:02.510404 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5633e4-14d0-411e-b9b6-16e7bf323f00 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:02.512325 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 89/178] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:02 2022] GET /identity/v3/projects/0976a5e8d4d942399b8522e367e466ba => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:02.518038 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5633e4-14d0-411e-b9b6-16e7bf323f00 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:02.520908 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb5218-d7aa-4a3a-b73e-56c5ce5645ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:02.521589 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb5218-d7aa-4a3a-b73e-56c5ce5645ec None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:02.522903 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb5218-d7aa-4a3a-b73e-56c5ce5645ec None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:02.522903 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb5218-d7aa-4a3a-b73e-56c5ce5645ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:02.523088 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb5218-d7aa-4a3a-b73e-56c5ce5645ec None admin] RBAC: Adding query filter params (role.id=9aa9b054939e4fc1ad0387e43c500693, scope.project.id=3f1f1193bc99470eb4863f0a1a231bdf, user.id=487e6099c4e64a10bbdf6b7df5e94d5c) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:02.523295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb5218-d7aa-4a3a-b73e-56c5ce5645ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:02.526294 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb5218-d7aa-4a3a-b73e-56c5ce5645ec None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:02.532675 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 90/179] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:01:02 2022] GET /identity/v3/role_assignments?user.id=487e6099c4e64a10bbdf6b7df5e94d5c&scope.project.id=3f1f1193bc99470eb4863f0a1a231bdf&role.id=9aa9b054939e4fc1ad0387e43c500693 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:02.602837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:02.650329 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5633e4-14d0-411e-b9b6-16e7bf323f00 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:02.690233 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175783e6-cf4d-4847-8558-7d7b0e691363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:02.690912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175783e6-cf4d-4847-8558-7d7b0e691363 None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:02.691187 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175783e6-cf4d-4847-8558-7d7b0e691363 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:02.691500 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175783e6-cf4d-4847-8558-7d7b0e691363 None admin] PATH_INFO: `/v3/projects/0976a5e8d4d942399b8522e367e466ba/users/355241918e4c42e7ae4e9983c4e93cf1/roles/9f66f016692f4bff811f91c9fb372e57` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:02.693595 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175783e6-cf4d-4847-8558-7d7b0e691363 None admin] RBAC: Authorizing `identity:create_grant(project_id=0976a5e8d4d942399b8522e367e466ba, user_id=355241918e4c42e7ae4e9983c4e93cf1, role_id=9f66f016692f4bff811f91c9fb372e57)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:02.695068 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175783e6-cf4d-4847-8558-7d7b0e691363 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:02.715163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 90/180] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 28 12:01:02 2022] PUT /identity/v3/projects/0976a5e8d4d942399b8522e367e466ba/users/355241918e4c42e7ae4e9983c4e93cf1/roles/9f66f016692f4bff811f91c9fb372e57 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:01:04.564388 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82918140-4075-48c1-b009-9ca10dbaa93c None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:04.565408 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82918140-4075-48c1-b009-9ca10dbaa93c None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:04.565891 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82918140-4075-48c1-b009-9ca10dbaa93c None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:04.567458 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 91/181] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:04.572982 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9e242-0544-4654-b4ae-ac29dbb6e9cc None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:04.573784 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9e242-0544-4654-b4ae-ac29dbb6e9cc None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:04.574258 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9e242-0544-4654-b4ae-ac29dbb6e9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:04.593494 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-f1e9e242-0544-4654-b4ae-ac29dbb6e9cc None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:04.595037 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f1e9e242-0544-4654-b4ae-ac29dbb6e9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:04.669131 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 91/182] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:04.821287 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b0fb8-b3d9-40fd-a223-2c00995d6604 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:04.821478 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b0fb8-b3d9-40fd-a223-2c00995d6604 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:04.821741 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b0fb8-b3d9-40fd-a223-2c00995d6604 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:04.823122 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 92/183] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:04.829198 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bf282-2ab9-4cb2-90d2-574876f8b8f6 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:04.829554 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bf282-2ab9-4cb2-90d2-574876f8b8f6 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:04.829902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bf282-2ab9-4cb2-90d2-574876f8b8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:04.831543 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05183ec1-47c4-4c56-ae78-8e18fd798b7d None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:04.832047 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05183ec1-47c4-4c56-ae78-8e18fd798b7d None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:04.832662 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05183ec1-47c4-4c56-ae78-8e18fd798b7d None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:04.835063 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 93/184] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:04.840238 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c14bf-4f59-4ccb-b0b8-773798729c3a None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:04.840518 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c14bf-4f59-4ccb-b0b8-773798729c3a None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:04.840789 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c14bf-4f59-4ccb-b0b8-773798729c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:04.847382 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:04.849194 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-8e0bf282-2ab9-4cb2-90d2-574876f8b8f6 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:04.851196 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8e0bf282-2ab9-4cb2-90d2-574876f8b8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:04.862009 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-834c14bf-4f59-4ccb-b0b8-773798729c3a None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:04.863559 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-834c14bf-4f59-4ccb-b0b8-773798729c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:04.912206 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:04.933095 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 94/185] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:01:04.934790 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e67aa-d52b-43e4-bdd1-637238fd3c42 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:04.935277 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e67aa-d52b-43e4-bdd1-637238fd3c42 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:04.935790 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e67aa-d52b-43e4-bdd1-637238fd3c42 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:04.936698 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 92/186] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:04.937559 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 95/187] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:04.945126 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4b9f1-7dbb-40ea-b12f-c0df734b05b2 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:04.945409 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4b9f1-7dbb-40ea-b12f-c0df734b05b2 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:04.945683 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4b9f1-7dbb-40ea-b12f-c0df734b05b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:04.964457 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-ece4b9f1-7dbb-40ea-b12f-c0df734b05b2 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:04.965657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ece4b9f1-7dbb-40ea-b12f-c0df734b05b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:04.968925 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e67aa-d52b-43e4-bdd1-637238fd3c42 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:05.048115 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 93/188] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:01:05.079031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e67aa-d52b-43e4-bdd1-637238fd3c42 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:05.110602 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:05.117015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efbc27-470d-4eda-af3e-5df59c54a474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:05.117691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efbc27-470d-4eda-af3e-5df59c54a474 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:05.117975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efbc27-470d-4eda-af3e-5df59c54a474 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:05.118248 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efbc27-470d-4eda-af3e-5df59c54a474 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:05.128990 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efbc27-470d-4eda-af3e-5df59c54a474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:05.134430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-25efbc27-470d-4eda-af3e-5df59c54a474 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:01:05.134430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:05.134430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:05.134430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:05.134430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:05.134430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:05.134430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:05.134430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:05.134430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:05.134430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:05.134430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:05.134430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:05.134430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:05.134430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:05.134430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:05.134430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:05.135296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:05.135296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:05.135296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:05.135296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:05.135296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:05.135296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:05.135296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:05.135296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:05.135296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:05.135296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:05.135296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:05.135296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:05.135296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:05.135296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:05.135296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:05.135296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:05.136204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:05.136204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:05.136204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:05.136204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:05.136204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:05.136204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:05.136204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:05.136204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:05.136204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:05.136204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:05.136204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:01:05.136204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:05.136204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 96/189] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:01:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:01:05.142714 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4b9f1-7dbb-40ea-b12f-c0df734b05b2 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:05.210391 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efbc27-470d-4eda-af3e-5df59c54a474 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:05.245405 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4b9f1-7dbb-40ea-b12f-c0df734b05b2 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:05.260272 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:05.284563 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5bb738-eac0-462d-9b92-0b25028706b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:05.285174 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bb738-eac0-462d-9b92-0b25028706b9 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:05.285453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bb738-eac0-462d-9b92-0b25028706b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:05.285972 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bb738-eac0-462d-9b92-0b25028706b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:05.287416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5bb738-eac0-462d-9b92-0b25028706b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:05.287772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5bb738-eac0-462d-9b92-0b25028706b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:05.289147 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5bb738-eac0-462d-9b92-0b25028706b9 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:05.299156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 94/190] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:05.304363 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5bb738-eac0-462d-9b92-0b25028706b9 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:05.321481 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efbc27-470d-4eda-af3e-5df59c54a474 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:05.359690 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56852ccf-509a-4587-82e1-73da0ee25151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:05.360242 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56852ccf-509a-4587-82e1-73da0ee25151 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:05.360517 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56852ccf-509a-4587-82e1-73da0ee25151 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:05.360784 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56852ccf-509a-4587-82e1-73da0ee25151 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:05.371210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56852ccf-509a-4587-82e1-73da0ee25151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:05.376107 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-56852ccf-509a-4587-82e1-73da0ee25151 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:01:05.376107 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:05.376107 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:05.376107 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:05.376107 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:05.376107 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:05.376107 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:05.376107 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:05.376107 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:05.376107 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:05.376107 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:05.376107 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:05.376107 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:05.376107 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:05.376107 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:05.376107 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:05.377159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:05.377159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:05.377159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:05.377159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:05.377159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:05.377159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:05.377159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:05.377159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:05.377159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:05.377159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:05.377159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:05.377159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:05.377159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:05.377159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:05.377159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:05.377159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:05.378048 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:05.378048 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:05.378048 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:05.378048 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:05.378048 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:05.378048 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:05.378048 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:05.378048 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:05.378048 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:05.378048 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:05.378048 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:01:05.378048 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:05.378048 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 97/191] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 28 12:01:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:01:05.379893 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56852ccf-509a-4587-82e1-73da0ee25151 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:05.414975 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5bb738-eac0-462d-9b92-0b25028706b9 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:05.433295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:05.447290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9370a7-1e02-4011-8c2e-5c6c416b7323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:05.448012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9370a7-1e02-4011-8c2e-5c6c416b7323 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:05.448288 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9370a7-1e02-4011-8c2e-5c6c416b7323 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:05.448561 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9370a7-1e02-4011-8c2e-5c6c416b7323 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:05.449646 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9370a7-1e02-4011-8c2e-5c6c416b7323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:05.451077 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9370a7-1e02-4011-8c2e-5c6c416b7323 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:05.452674 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 95/192] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:05.453422 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9370a7-1e02-4011-8c2e-5c6c416b7323 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:05.481991 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56852ccf-509a-4587-82e1-73da0ee25151 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:05.497241 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:05.515113 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02374f18-c25e-4d28-aa1f-4cc0df8da7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:05.515757 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02374f18-c25e-4d28-aa1f-4cc0df8da7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:05.516031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02374f18-c25e-4d28-aa1f-4cc0df8da7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:05.516301 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02374f18-c25e-4d28-aa1f-4cc0df8da7d2 None admin] PATH_INFO: `/v3/users/e65f551d9a364bd2ba35a01bdafa1ebe` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:05.529406 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02374f18-c25e-4d28-aa1f-4cc0df8da7d2 None admin] RBAC: Authorizing `identity:get_user(user_id=e65f551d9a364bd2ba35a01bdafa1ebe)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:05.530865 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02374f18-c25e-4d28-aa1f-4cc0df8da7d2 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:05.532487 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 98/193] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:01:05 2022] GET /identity/v3/users/e65f551d9a364bd2ba35a01bdafa1ebe => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:05.533239 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02374f18-c25e-4d28-aa1f-4cc0df8da7d2 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:05.559236 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9370a7-1e02-4011-8c2e-5c6c416b7323 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:05.593039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8396ec8-cf8c-4f69-b8f1-75b1b6a72034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:05.593675 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8396ec8-cf8c-4f69-b8f1-75b1b6a72034 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:05.593934 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8396ec8-cf8c-4f69-b8f1-75b1b6a72034 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:05.594207 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8396ec8-cf8c-4f69-b8f1-75b1b6a72034 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:05.604301 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8396ec8-cf8c-4f69-b8f1-75b1b6a72034 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:05.609569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-a8396ec8-cf8c-4f69-b8f1-75b1b6a72034 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:01:05.609569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:05.609569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:05.609569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:05.609569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:05.609569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:05.609569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:05.609569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:05.609569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:05.609569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:05.609569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:05.609569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:05.609569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:05.609569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:05.609569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:05.609569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:05.610524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:05.610524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:05.610524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:05.610524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:05.610524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:05.610524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:05.610524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:05.610524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:05.610524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:05.610524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:05.610524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:05.610524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:05.610524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:05.610524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:05.610524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:05.610524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:05.611356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:05.611356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:05.611356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:05.611356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:05.611356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:05.611356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:05.611356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:05.611356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:05.611356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:05.611356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:05.611356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:01:05.611356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:05.611356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 96/194] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:05.612084 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8396ec8-cf8c-4f69-b8f1-75b1b6a72034 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:05.633130 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02374f18-c25e-4d28-aa1f-4cc0df8da7d2 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:05.643791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:05.667891 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324a344-aa16-4024-b30f-537ee7fe8c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:05.668529 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324a344-aa16-4024-b30f-537ee7fe8c9f None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:05.668812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324a344-aa16-4024-b30f-537ee7fe8c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:05.669086 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324a344-aa16-4024-b30f-537ee7fe8c9f None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:05.669750 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324a344-aa16-4024-b30f-537ee7fe8c9f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:05.670057 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324a344-aa16-4024-b30f-537ee7fe8c9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:05.671500 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324a344-aa16-4024-b30f-537ee7fe8c9f None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:05.683878 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 99/195] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:01:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:05.683878 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324a344-aa16-4024-b30f-537ee7fe8c9f None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:05.718169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8396ec8-cf8c-4f69-b8f1-75b1b6a72034 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:05.719735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:05.755340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd66c4-01dc-4efb-8d2a-ab8e6e0001aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:05.756486 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd66c4-01dc-4efb-8d2a-ab8e6e0001aa None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:05.756762 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd66c4-01dc-4efb-8d2a-ab8e6e0001aa None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:05.757037 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd66c4-01dc-4efb-8d2a-ab8e6e0001aa None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:05.757684 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd66c4-01dc-4efb-8d2a-ab8e6e0001aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:05.759113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd66c4-01dc-4efb-8d2a-ab8e6e0001aa None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:05.779701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 97/196] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 28 12:01:05 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:01:05.780509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd66c4-01dc-4efb-8d2a-ab8e6e0001aa None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:05.789111 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324a344-aa16-4024-b30f-537ee7fe8c9f None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:05.828524 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44366be-f524-43ce-afa3-a9a53a4c4d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:05.829145 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44366be-f524-43ce-afa3-a9a53a4c4d21 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:05.829425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44366be-f524-43ce-afa3-a9a53a4c4d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:05.829700 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44366be-f524-43ce-afa3-a9a53a4c4d21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:05.875982 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:05.899787 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd66c4-01dc-4efb-8d2a-ab8e6e0001aa None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:05.910531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44366be-f524-43ce-afa3-a9a53a4c4d21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:05.912072 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44366be-f524-43ce-afa3-a9a53a4c4d21 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:05.937247 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230fc3a-cdf5-41e3-99f0-ee8bb9564d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:05.938051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230fc3a-cdf5-41e3-99f0-ee8bb9564d5f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:05.938335 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230fc3a-cdf5-41e3-99f0-ee8bb9564d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:05.938616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230fc3a-cdf5-41e3-99f0-ee8bb9564d5f None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:05.939512 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230fc3a-cdf5-41e3-99f0-ee8bb9564d5f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:05.940212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230fc3a-cdf5-41e3-99f0-ee8bb9564d5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:05.941628 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230fc3a-cdf5-41e3-99f0-ee8bb9564d5f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:05.951039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 98/197] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:01:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:05.952130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230fc3a-cdf5-41e3-99f0-ee8bb9564d5f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:05.980709 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:06.038418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 100/198] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:01:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:01:06.039271 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44366be-f524-43ce-afa3-a9a53a4c4d21 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:06.087850 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230fc3a-cdf5-41e3-99f0-ee8bb9564d5f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:06.126193 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c7593-f37f-459f-ae30-a27af9792ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:06.126530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:06.126753 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c7593-f37f-459f-ae30-a27af9792ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:06.127033 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c7593-f37f-459f-ae30-a27af9792ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:06.127304 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c7593-f37f-459f-ae30-a27af9792ce2 None admin] PATH_INFO: `/v3/users/e65f551d9a364bd2ba35a01bdafa1ebe` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:06.128529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c7593-f37f-459f-ae30-a27af9792ce2 None admin] RBAC: Authorizing `identity:get_user(user_id=e65f551d9a364bd2ba35a01bdafa1ebe)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:06.129934 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c7593-f37f-459f-ae30-a27af9792ce2 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:06.133348 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 99/199] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:01:05 2022] GET /identity/v3/users/e65f551d9a364bd2ba35a01bdafa1ebe => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:06.133348 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c7593-f37f-459f-ae30-a27af9792ce2 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:06.170880 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44366be-f524-43ce-afa3-a9a53a4c4d21 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:06.209591 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5345d-69e3-444f-a67c-6d55137fd9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:06.210473 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5345d-69e3-444f-a67c-6d55137fd9b8 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:06.212021 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5345d-69e3-444f-a67c-6d55137fd9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:06.212571 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5345d-69e3-444f-a67c-6d55137fd9b8 None admin] PATH_INFO: `/v3/users/355241918e4c42e7ae4e9983c4e93cf1` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:06.213742 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5345d-69e3-444f-a67c-6d55137fd9b8 None admin] RBAC: Authorizing `identity:get_user(user_id=355241918e4c42e7ae4e9983c4e93cf1)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:06.215340 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5345d-69e3-444f-a67c-6d55137fd9b8 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:06.217246 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 101/200] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:01:06 2022] GET /identity/v3/users/355241918e4c42e7ae4e9983c4e93cf1 => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:06.217851 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5345d-69e3-444f-a67c-6d55137fd9b8 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:06.250180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:06.264942 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c7593-f37f-459f-ae30-a27af9792ce2 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:06.313065 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cc426-208c-43b1-ab60-9518dee6ec1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:06.314533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cc426-208c-43b1-ab60-9518dee6ec1e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:06.314992 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cc426-208c-43b1-ab60-9518dee6ec1e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:06.315459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cc426-208c-43b1-ab60-9518dee6ec1e None admin] PATH_INFO: `/v3/projects/6f1f0a0a8c824d639602043911e34bb5` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:06.316803 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cc426-208c-43b1-ab60-9518dee6ec1e None admin] RBAC: Authorizing `identity:get_project(project_id=6f1f0a0a8c824d639602043911e34bb5)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:06.319909 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cc426-208c-43b1-ab60-9518dee6ec1e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:06.322748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 100/201] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:06 2022] GET /identity/v3/projects/6f1f0a0a8c824d639602043911e34bb5 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:06.324460 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cc426-208c-43b1-ab60-9518dee6ec1e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:06.335802 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5345d-69e3-444f-a67c-6d55137fd9b8 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:06.374788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bb125-2aa3-49c1-8135-5681898a1017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:06.375944 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bb125-2aa3-49c1-8135-5681898a1017 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:06.376478 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bb125-2aa3-49c1-8135-5681898a1017 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:06.376941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bb125-2aa3-49c1-8135-5681898a1017 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:06.388887 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:06.439679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cc426-208c-43b1-ab60-9518dee6ec1e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:06.451379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bb125-2aa3-49c1-8135-5681898a1017 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:06.453247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bb125-2aa3-49c1-8135-5681898a1017 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:06.477310 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79a967-4c22-43fe-b508-19c5b8b02ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:06.477986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79a967-4c22-43fe-b508-19c5b8b02ace None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:06.478223 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79a967-4c22-43fe-b508-19c5b8b02ace None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:06.478497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79a967-4c22-43fe-b508-19c5b8b02ace None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:06.513264 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:06.564706 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79a967-4c22-43fe-b508-19c5b8b02ace None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:06.567154 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79a967-4c22-43fe-b508-19c5b8b02ace None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:06.574651 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 102/202] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:01:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:01:06.575739 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bb125-2aa3-49c1-8135-5681898a1017 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:06.619485 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:06.681763 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bb125-2aa3-49c1-8135-5681898a1017 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:06.690746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 101/203] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:01:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:01:06.692165 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79a967-4c22-43fe-b508-19c5b8b02ace None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:06.723820 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605162c1-fdd6-48a9-9e52-b55d33e78e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:06.724476 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605162c1-fdd6-48a9-9e52-b55d33e78e3e None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:06.724755 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605162c1-fdd6-48a9-9e52-b55d33e78e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:06.725033 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605162c1-fdd6-48a9-9e52-b55d33e78e3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:06.725772 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605162c1-fdd6-48a9-9e52-b55d33e78e3e None admin] RBAC: Adding query filter params (role.id=66456d39fc0c496c8f290a436b726216, scope.project.id=6f1f0a0a8c824d639602043911e34bb5, user.id=e65f551d9a364bd2ba35a01bdafa1ebe) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:06.726078 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605162c1-fdd6-48a9-9e52-b55d33e78e3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:06.727580 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605162c1-fdd6-48a9-9e52-b55d33e78e3e None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:06.736430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 103/204] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:01:06 2022] GET /identity/v3/role_assignments?user.id=e65f551d9a364bd2ba35a01bdafa1ebe&scope.project.id=6f1f0a0a8c824d639602043911e34bb5&role.id=66456d39fc0c496c8f290a436b726216 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:06.737255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605162c1-fdd6-48a9-9e52-b55d33e78e3e None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:06.767500 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:06.824129 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79a967-4c22-43fe-b508-19c5b8b02ace None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:06.857254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605162c1-fdd6-48a9-9e52-b55d33e78e3e None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:06.860636 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:06.884802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e47804-5b29-4965-a090-465b2b73297b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:06.885464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e47804-5b29-4965-a090-465b2b73297b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:06.885741 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e47804-5b29-4965-a090-465b2b73297b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:06.886014 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e47804-5b29-4965-a090-465b2b73297b None admin] PATH_INFO: `/v3/projects/6f1f0a0a8c824d639602043911e34bb5` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:06.890023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e47804-5b29-4965-a090-465b2b73297b None admin] RBAC: Authorizing `identity:get_project(project_id=6f1f0a0a8c824d639602043911e34bb5)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:06.891550 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e47804-5b29-4965-a090-465b2b73297b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:06.893302 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 102/205] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:06 2022] GET /identity/v3/projects/6f1f0a0a8c824d639602043911e34bb5 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:06.904802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e47804-5b29-4965-a090-465b2b73297b None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:06.936252 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27122517-c78d-49f4-9cde-6cc4b5865c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:06.936883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27122517-c78d-49f4-9cde-6cc4b5865c73 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:06.937162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27122517-c78d-49f4-9cde-6cc4b5865c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:06.937714 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27122517-c78d-49f4-9cde-6cc4b5865c73 None admin] PATH_INFO: `/v3/projects/0976a5e8d4d942399b8522e367e466ba` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:06.939940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27122517-c78d-49f4-9cde-6cc4b5865c73 None admin] RBAC: Authorizing `identity:get_project(project_id=0976a5e8d4d942399b8522e367e466ba)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:06.942376 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27122517-c78d-49f4-9cde-6cc4b5865c73 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:06.944487 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 104/206] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:06 2022] GET /identity/v3/projects/0976a5e8d4d942399b8522e367e466ba => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:06.950280 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27122517-c78d-49f4-9cde-6cc4b5865c73 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:07.048891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e47804-5b29-4965-a090-465b2b73297b None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:07.096414 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:07.114251 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02be2b0-5ebf-42d4-87f5-b0c8b1fef37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:07.115574 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02be2b0-5ebf-42d4-87f5-b0c8b1fef37a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:07.116344 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02be2b0-5ebf-42d4-87f5-b0c8b1fef37a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:07.116825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02be2b0-5ebf-42d4-87f5-b0c8b1fef37a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:07.117793 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02be2b0-5ebf-42d4-87f5-b0c8b1fef37a None admin] RBAC: Adding query filter params (role.id=67ed180941fd45af996b858232628221, scope.project.id=6f1f0a0a8c824d639602043911e34bb5, user.id=e65f551d9a364bd2ba35a01bdafa1ebe) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:07.118355 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02be2b0-5ebf-42d4-87f5-b0c8b1fef37a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:07.120018 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02be2b0-5ebf-42d4-87f5-b0c8b1fef37a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:07.126151 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 103/207] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:01:06 2022] GET /identity/v3/role_assignments?user.id=e65f551d9a364bd2ba35a01bdafa1ebe&scope.project.id=6f1f0a0a8c824d639602043911e34bb5&role.id=67ed180941fd45af996b858232628221 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:07.148771 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27122517-c78d-49f4-9cde-6cc4b5865c73 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:07.195050 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8632fd-d6fb-4485-83fa-908039780386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:07.196100 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8632fd-d6fb-4485-83fa-908039780386 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:07.196575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8632fd-d6fb-4485-83fa-908039780386 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:07.197109 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8632fd-d6fb-4485-83fa-908039780386 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:07.198119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8632fd-d6fb-4485-83fa-908039780386 None admin] RBAC: Adding query filter params (role.id=9f66f016692f4bff811f91c9fb372e57, scope.project.id=0976a5e8d4d942399b8522e367e466ba, user.id=355241918e4c42e7ae4e9983c4e93cf1) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:07.198653 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8632fd-d6fb-4485-83fa-908039780386 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:07.200445 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8632fd-d6fb-4485-83fa-908039780386 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:07.212927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 105/208] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:01:06 2022] GET /identity/v3/role_assignments?user.id=355241918e4c42e7ae4e9983c4e93cf1&scope.project.id=0976a5e8d4d942399b8522e367e466ba&role.id=9f66f016692f4bff811f91c9fb372e57 => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:08.191844 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81fa015-f73b-425c-be2a-323363d3bb73 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:08.192388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81fa015-f73b-425c-be2a-323363d3bb73 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:08.192388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81fa015-f73b-425c-be2a-323363d3bb73 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:08.194499 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 104/209] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:08.199853 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57147142-088f-477e-a2be-79440b3d1ea3 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:08.200240 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57147142-088f-477e-a2be-79440b3d1ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:08.200424 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57147142-088f-477e-a2be-79440b3d1ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:08.218685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-57147142-088f-477e-a2be-79440b3d1ea3 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:08.219907 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-57147142-088f-477e-a2be-79440b3d1ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:08.249766 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:08.289864 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 106/210] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:01:08.466653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971ce8a-dd1e-43ab-a1ac-4a5c8aec4314 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:08.467320 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971ce8a-dd1e-43ab-a1ac-4a5c8aec4314 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:08.467838 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971ce8a-dd1e-43ab-a1ac-4a5c8aec4314 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:08.469638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 105/211] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:08.474950 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10f402-0bd4-4c44-a5ca-646e295d0c20 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:08.475474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10f402-0bd4-4c44-a5ca-646e295d0c20 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:08.475966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10f402-0bd4-4c44-a5ca-646e295d0c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:08.495216 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-5c10f402-0bd4-4c44-a5ca-646e295d0c20 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:08.496745 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-5c10f402-0bd4-4c44-a5ca-646e295d0c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:08.557502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971ce8a-dd1e-43ab-a1ac-4a5c8aec4314 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:08.568938 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 107/212] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:08.664729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971ce8a-dd1e-43ab-a1ac-4a5c8aec4314 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:08.700754 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36258f28-f840-4441-87ea-f8fbe3769cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:08.701386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36258f28-f840-4441-87ea-f8fbe3769cce None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:08.701661 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36258f28-f840-4441-87ea-f8fbe3769cce None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:08.701928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36258f28-f840-4441-87ea-f8fbe3769cce None admin] PATH_INFO: `/v3/roles/member` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:08.712526 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36258f28-f840-4441-87ea-f8fbe3769cce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:08.718047 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-36258f28-f840-4441-87ea-f8fbe3769cce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:01:08.718047 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:08.718047 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:08.718047 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:08.718047 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:08.718047 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:08.718047 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:08.718047 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:08.718047 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:08.718047 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:08.718047 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:08.718047 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:08.718047 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:08.718047 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:08.718047 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:08.718047 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:08.718927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:08.718927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:08.718927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:08.718927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:08.718927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:08.718927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:08.718927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:08.718927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:08.718927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:08.718927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:08.718927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:08.718927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:08.718927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:08.718927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:08.718927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:08.718927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:08.719743 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:08.719743 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:08.719743 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:08.719743 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:08.719743 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:08.719743 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:08.719743 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:08.719743 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:08.719743 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:08.719743 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:08.719743 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:01:08.719743 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:08.719743 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 106/213] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:01:08.725610 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10f402-0bd4-4c44-a5ca-646e295d0c20 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:08.829693 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:08.836614 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10f402-0bd4-4c44-a5ca-646e295d0c20 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:08.846323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36258f28-f840-4441-87ea-f8fbe3769cce None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:08.876188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a4655-448a-44d3-ab1e-c4b4366649ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:08.877321 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a4655-448a-44d3-ab1e-c4b4366649ba None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:08.877671 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a4655-448a-44d3-ab1e-c4b4366649ba None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:08.878238 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a4655-448a-44d3-ab1e-c4b4366649ba None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:08.879013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a4655-448a-44d3-ab1e-c4b4366649ba None admin] RBAC: Adding query filter params (name=member) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:08.879639 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a4655-448a-44d3-ab1e-c4b4366649ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:08.882331 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a4655-448a-44d3-ab1e-c4b4366649ba None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:08.893566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 108/214] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:01:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:08.899771 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a4655-448a-44d3-ab1e-c4b4366649ba None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:08.902982 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:08.957742 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36258f28-f840-4441-87ea-f8fbe3769cce None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:08.994941 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21d6e6-3815-4322-ab07-88d2cd99baab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:08.995718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21d6e6-3815-4322-ab07-88d2cd99baab None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:08.996100 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21d6e6-3815-4322-ab07-88d2cd99baab None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:08.996477 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21d6e6-3815-4322-ab07-88d2cd99baab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:08.997709 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21d6e6-3815-4322-ab07-88d2cd99baab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:08.999263 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21d6e6-3815-4322-ab07-88d2cd99baab None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:09.001301 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 107/215] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:09.008375 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21d6e6-3815-4322-ab07-88d2cd99baab None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:09.026452 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a4655-448a-44d3-ab1e-c4b4366649ba None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:09.076294 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32885ea-701f-4d70-9018-059c145cb62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:09.077798 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32885ea-701f-4d70-9018-059c145cb62f None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:09.078316 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32885ea-701f-4d70-9018-059c145cb62f None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:09.078962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32885ea-701f-4d70-9018-059c145cb62f None admin] PATH_INFO: `/v3/users/47f0db753db74d4eb981cc146bf02b21` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:09.097205 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32885ea-701f-4d70-9018-059c145cb62f None admin] RBAC: Authorizing `identity:get_user(user_id=47f0db753db74d4eb981cc146bf02b21)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:09.099942 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32885ea-701f-4d70-9018-059c145cb62f None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:09.102248 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 109/216] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:01:08 2022] GET /identity/v3/users/47f0db753db74d4eb981cc146bf02b21 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:09.107701 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32885ea-701f-4d70-9018-059c145cb62f None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:09.126848 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:09.131200 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21d6e6-3815-4322-ab07-88d2cd99baab None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:09.153117 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:09.175119 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610013ba-dd7f-46d7-8d04-8446553340b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:09.175772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610013ba-dd7f-46d7-8d04-8446553340b0 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:09.176053 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610013ba-dd7f-46d7-8d04-8446553340b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:09.176324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610013ba-dd7f-46d7-8d04-8446553340b0 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:09.176982 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610013ba-dd7f-46d7-8d04-8446553340b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:09.178951 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610013ba-dd7f-46d7-8d04-8446553340b0 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:09.202536 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 108/217] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 28 12:01:09 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:01:09.204561 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddd9d6-8fb4-46f1-a4b0-b2a93838ab19 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:09.205061 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddd9d6-8fb4-46f1-a4b0-b2a93838ab19 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:09.205526 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddd9d6-8fb4-46f1-a4b0-b2a93838ab19 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:09.207027 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 109/218] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:09.212962 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f9c03-4e9a-4582-b7a1-47ba1c9a7408 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:09.213269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f9c03-4e9a-4582-b7a1-47ba1c9a7408 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:09.213519 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f9c03-4e9a-4582-b7a1-47ba1c9a7408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:09.226380 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32885ea-701f-4d70-9018-059c145cb62f None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:09.234143 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-da5f9c03-4e9a-4582-b7a1-47ba1c9a7408 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:09.235382 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-da5f9c03-4e9a-4582-b7a1-47ba1c9a7408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:09.268759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05089274-bf05-46cf-ac9c-3c743d6f813b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:09.269804 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05089274-bf05-46cf-ac9c-3c743d6f813b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:09.270303 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05089274-bf05-46cf-ac9c-3c743d6f813b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:09.270767 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05089274-bf05-46cf-ac9c-3c743d6f813b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:09.332036 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 110/219] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:09.354688 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05089274-bf05-46cf-ac9c-3c743d6f813b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:09.356718 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05089274-bf05-46cf-ac9c-3c743d6f813b None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:09.377907 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:09.477571 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 110/220] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:01:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:01:09.483464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f9c03-4e9a-4582-b7a1-47ba1c9a7408 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:09.531667 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5404cd1-5526-44f3-aadd-321ceeb9e27f None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:09.531920 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5404cd1-5526-44f3-aadd-321ceeb9e27f None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:09.532153 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5404cd1-5526-44f3-aadd-321ceeb9e27f None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:09.533512 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 111/221] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:01:09.538709 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a6872-78ba-4178-ae27-20cf2a2be184 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:09.538994 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a6872-78ba-4178-ae27-20cf2a2be184 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:09.539268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a6872-78ba-4178-ae27-20cf2a2be184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:09.562437 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-d20a6872-78ba-4178-ae27-20cf2a2be184 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:09.564460 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-d20a6872-78ba-4178-ae27-20cf2a2be184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:09.605876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f9c03-4e9a-4582-b7a1-47ba1c9a7408 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:09.607763 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:09.657490 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84121b-1d63-45f8-880b-c6ec467b2edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:09.658356 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 112/222] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:01:09.658646 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84121b-1d63-45f8-880b-c6ec467b2edb None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:09.659109 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84121b-1d63-45f8-880b-c6ec467b2edb None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:09.659212 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a6872-78ba-4178-ae27-20cf2a2be184 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:09.659753 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84121b-1d63-45f8-880b-c6ec467b2edb None admin] PATH_INFO: `/v3/projects/6f1f0a0a8c824d639602043911e34bb5` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:09.661163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84121b-1d63-45f8-880b-c6ec467b2edb None admin] RBAC: Authorizing `identity:get_project(project_id=6f1f0a0a8c824d639602043911e34bb5)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:09.663639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84121b-1d63-45f8-880b-c6ec467b2edb None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:09.665757 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 111/223] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:09 2022] GET /identity/v3/projects/6f1f0a0a8c824d639602043911e34bb5 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:09.671227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84121b-1d63-45f8-880b-c6ec467b2edb None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:09.728508 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:09.799480 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84121b-1d63-45f8-880b-c6ec467b2edb None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:09.810371 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a6872-78ba-4178-ae27-20cf2a2be184 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:09.839952 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972dfa16-dea0-4ee8-bd77-e881bb930827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:09.840565 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dfa16-dea0-4ee8-bd77-e881bb930827 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:09.840844 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dfa16-dea0-4ee8-bd77-e881bb930827 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:09.841115 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dfa16-dea0-4ee8-bd77-e881bb930827 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:09.842118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972dfa16-dea0-4ee8-bd77-e881bb930827 None admin] RBAC: Adding query filter params (role.id=9aa9b054939e4fc1ad0387e43c500693, scope.project.id=6f1f0a0a8c824d639602043911e34bb5, user.id=47f0db753db74d4eb981cc146bf02b21) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:09.842437 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972dfa16-dea0-4ee8-bd77-e881bb930827 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:09.843894 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972dfa16-dea0-4ee8-bd77-e881bb930827 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:09.850932 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 112/224] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:01:09 2022] GET /identity/v3/role_assignments?user.id=47f0db753db74d4eb981cc146bf02b21&scope.project.id=6f1f0a0a8c824d639602043911e34bb5&role.id=9aa9b054939e4fc1ad0387e43c500693 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:09.879514 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fedd0-bdcf-4b3c-950a-a094713927c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:09.880172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fedd0-bdcf-4b3c-950a-a094713927c6 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:09.880532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fedd0-bdcf-4b3c-950a-a094713927c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:09.880802 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fedd0-bdcf-4b3c-950a-a094713927c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:09.892325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fedd0-bdcf-4b3c-950a-a094713927c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:09.898049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-0b4fedd0-bdcf-4b3c-950a-a094713927c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:01:09.898049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:09.898049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:09.898049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:09.898049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:09.898049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:09.898049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:09.898049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:09.898049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:09.898049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:09.898049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:09.898049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:09.898049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:09.898049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:09.898049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:09.898049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:09.899015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:09.899015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:09.899015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:09.899015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:09.899015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:09.899015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:09.899015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:09.899015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:09.899015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:09.899015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:09.899015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:09.899015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:09.899015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:09.899015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:09.899015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:09.899015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:09.899855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:09.899855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:09.899855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:09.899855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:09.899855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:09.899855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:09.899855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:09.899855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:09.899855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:09.899855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:09.899855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:01:09.899855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:09.900455 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 113/225] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:01:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:09.905341 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972dfa16-dea0-4ee8-bd77-e881bb930827 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:09.945099 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:10.011892 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fedd0-bdcf-4b3c-950a-a094713927c6 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:10.020741 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972dfa16-dea0-4ee8-bd77-e881bb930827 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:10.060060 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c141c99-03ea-4f74-b5f8-0ef109135ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:10.060604 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c141c99-03ea-4f74-b5f8-0ef109135ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:10.060886 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c141c99-03ea-4f74-b5f8-0ef109135ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:10.061161 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c141c99-03ea-4f74-b5f8-0ef109135ce5 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:10.061844 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c141c99-03ea-4f74-b5f8-0ef109135ce5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:10.062157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c141c99-03ea-4f74-b5f8-0ef109135ce5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:10.063611 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c141c99-03ea-4f74-b5f8-0ef109135ce5 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:10.073738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 113/226] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:10.079480 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c141c99-03ea-4f74-b5f8-0ef109135ce5 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:10.182213 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:10.188425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c141c99-03ea-4f74-b5f8-0ef109135ce5 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:10.224729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c24e3-0946-4127-bd75-d626d41aa9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:10.225727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c24e3-0946-4127-bd75-d626d41aa9bb None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:10.226010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c24e3-0946-4127-bd75-d626d41aa9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:10.226286 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c24e3-0946-4127-bd75-d626d41aa9bb None admin] PATH_INFO: `/v3/users/e65f551d9a364bd2ba35a01bdafa1ebe` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:10.227478 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c24e3-0946-4127-bd75-d626d41aa9bb None admin] RBAC: Authorizing `identity:get_user(user_id=e65f551d9a364bd2ba35a01bdafa1ebe)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:10.229244 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c24e3-0946-4127-bd75-d626d41aa9bb None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:10.231164 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 114/227] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:01:10 2022] GET /identity/v3/users/e65f551d9a364bd2ba35a01bdafa1ebe => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:10.237914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c24e3-0946-4127-bd75-d626d41aa9bb None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:10.244410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fedd0-bdcf-4b3c-950a-a094713927c6 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:10.259777 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:10.330779 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2b464-46c8-4a0b-b551-e5c87a1c924c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:10.331851 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2b464-46c8-4a0b-b551-e5c87a1c924c None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:10.332376 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2b464-46c8-4a0b-b551-e5c87a1c924c None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:10.332836 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2b464-46c8-4a0b-b551-e5c87a1c924c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:10.347461 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c24e3-0946-4127-bd75-d626d41aa9bb None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:10.369197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2b464-46c8-4a0b-b551-e5c87a1c924c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:10.380566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-94f2b464-46c8-4a0b-b551-e5c87a1c924c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:01:10.380566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:10.380566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:10.380566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:10.380566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:10.380566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:10.380566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:10.380566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:10.380566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:10.380566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:10.380566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:10.380566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:10.380566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:10.380566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:10.380566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:10.380566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:10.381490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:10.381490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:10.381490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:10.381490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:10.381490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:10.381490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:10.381490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:10.381490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:10.381490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:10.381490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:10.381490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:10.381490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:10.381490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:10.381490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:10.381490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:10.381490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:10.382279 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:10.382279 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:10.382279 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:10.382279 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:10.382279 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:10.382279 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:10.382279 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:10.382279 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:10.382279 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:10.382279 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:10.382279 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:01:10.382279 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:10.382279 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 114/228] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 28 12:01:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:01:10.387117 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e562536-0f22-4c37-a66c-5c1558784a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:10.388237 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e562536-0f22-4c37-a66c-5c1558784a89 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:10.388636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e562536-0f22-4c37-a66c-5c1558784a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:10.388827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e562536-0f22-4c37-a66c-5c1558784a89 None admin] PATH_INFO: `/v3/projects/6f1f0a0a8c824d639602043911e34bb5` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:10.389870 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2b464-46c8-4a0b-b551-e5c87a1c924c None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:10.391597 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e562536-0f22-4c37-a66c-5c1558784a89 None admin] RBAC: Authorizing `identity:get_project(project_id=6f1f0a0a8c824d639602043911e34bb5)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:10.393049 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e562536-0f22-4c37-a66c-5c1558784a89 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:10.394865 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 115/229] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:10 2022] GET /identity/v3/projects/6f1f0a0a8c824d639602043911e34bb5 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:10.403682 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e562536-0f22-4c37-a66c-5c1558784a89 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:10.462410 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:10.577313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2b464-46c8-4a0b-b551-e5c87a1c924c None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:10.605410 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e562536-0f22-4c37-a66c-5c1558784a89 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:10.656120 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5b2bc-5bfb-4899-9584-2c7ec0c17658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:10.656420 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc937b3-382b-441d-9d97-de0afebda98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:10.656794 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc937b3-382b-441d-9d97-de0afebda98c None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:10.657130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc937b3-382b-441d-9d97-de0afebda98c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:10.657412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc937b3-382b-441d-9d97-de0afebda98c None admin] PATH_INFO: `/v3/projects/6f1f0a0a8c824d639602043911e34bb5/users/e65f551d9a364bd2ba35a01bdafa1ebe/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:10.657915 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5b2bc-5bfb-4899-9584-2c7ec0c17658 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:10.658380 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5b2bc-5bfb-4899-9584-2c7ec0c17658 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:10.658836 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5b2bc-5bfb-4899-9584-2c7ec0c17658 None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:10.659485 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc937b3-382b-441d-9d97-de0afebda98c None admin] RBAC: Authorizing `identity:create_grant(project_id=6f1f0a0a8c824d639602043911e34bb5, user_id=e65f551d9a364bd2ba35a01bdafa1ebe, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:10.659915 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5b2bc-5bfb-4899-9584-2c7ec0c17658 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:10.660417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5b2bc-5bfb-4899-9584-2c7ec0c17658 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:10.661004 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc937b3-382b-441d-9d97-de0afebda98c None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:10.662282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5b2bc-5bfb-4899-9584-2c7ec0c17658 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:10.679689 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 116/230] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 28 12:01:10 2022] PUT /identity/v3/projects/6f1f0a0a8c824d639602043911e34bb5/users/e65f551d9a364bd2ba35a01bdafa1ebe/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:01:10.685882 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 115/231] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:01:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:10.691989 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc937b3-382b-441d-9d97-de0afebda98c None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:10.814137 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:10.825212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc937b3-382b-441d-9d97-de0afebda98c None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:10.869353 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388a17f-e584-4ea5-b3d1-de4c7ccb321d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:10.869942 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388a17f-e584-4ea5-b3d1-de4c7ccb321d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:10.870229 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388a17f-e584-4ea5-b3d1-de4c7ccb321d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:10.870510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388a17f-e584-4ea5-b3d1-de4c7ccb321d None admin] PATH_INFO: `/v3/users/e65f551d9a364bd2ba35a01bdafa1ebe` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:10.875670 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388a17f-e584-4ea5-b3d1-de4c7ccb321d None admin] RBAC: Authorizing `identity:get_user(user_id=e65f551d9a364bd2ba35a01bdafa1ebe)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:10.877182 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388a17f-e584-4ea5-b3d1-de4c7ccb321d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:10.879244 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 117/232] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:01:10 2022] GET /identity/v3/users/e65f551d9a364bd2ba35a01bdafa1ebe => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:10.886320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5b2bc-5bfb-4899-9584-2c7ec0c17658 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:10.927223 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:11.008656 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5b2bc-5bfb-4899-9584-2c7ec0c17658 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:11.056511 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29b4d3-d2c4-4c79-ad09-3c2e6de0ca3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:11.057145 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29b4d3-d2c4-4c79-ad09-3c2e6de0ca3a None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:11.057429 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29b4d3-d2c4-4c79-ad09-3c2e6de0ca3a None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:11.057697 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29b4d3-d2c4-4c79-ad09-3c2e6de0ca3a None admin] PATH_INFO: `/v3/projects/6f1f0a0a8c824d639602043911e34bb5` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:11.064130 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f29b4d3-d2c4-4c79-ad09-3c2e6de0ca3a None admin] RBAC: Authorizing `identity:get_project(project_id=6f1f0a0a8c824d639602043911e34bb5)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:11.065580 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f29b4d3-d2c4-4c79-ad09-3c2e6de0ca3a None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:11.067218 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 116/233] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:10 2022] GET /identity/v3/projects/6f1f0a0a8c824d639602043911e34bb5 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:11.073636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388a17f-e584-4ea5-b3d1-de4c7ccb321d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:11.183538 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388a17f-e584-4ea5-b3d1-de4c7ccb321d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:11.224235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba7133-73b2-418e-ad58-645bb5c64298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:11.224925 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba7133-73b2-418e-ad58-645bb5c64298 None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:11.225440 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba7133-73b2-418e-ad58-645bb5c64298 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:11.225546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba7133-73b2-418e-ad58-645bb5c64298 None admin] PATH_INFO: `/v3/projects/6f1f0a0a8c824d639602043911e34bb5/users/e65f551d9a364bd2ba35a01bdafa1ebe/roles/67ed180941fd45af996b858232628221` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:11.227721 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba7133-73b2-418e-ad58-645bb5c64298 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f1f0a0a8c824d639602043911e34bb5, user_id=e65f551d9a364bd2ba35a01bdafa1ebe, role_id=67ed180941fd45af996b858232628221)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:11.229164 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba7133-73b2-418e-ad58-645bb5c64298 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:11.257315 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 118/234] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 28 12:01:11 2022] PUT /identity/v3/projects/6f1f0a0a8c824d639602043911e34bb5/users/e65f551d9a364bd2ba35a01bdafa1ebe/roles/67ed180941fd45af996b858232628221 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:01:12.069827 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d4d02-b42a-4563-95f7-9b7cc46bdbc3 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:12.070357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d4d02-b42a-4563-95f7-9b7cc46bdbc3 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:12.070651 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d4d02-b42a-4563-95f7-9b7cc46bdbc3 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:12.072222 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 117/235] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:12.077821 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8e3ee-1c50-40d9-9402-9e0a3327e097 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:12.078243 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8e3ee-1c50-40d9-9402-9e0a3327e097 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:12.078616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8e3ee-1c50-40d9-9402-9e0a3327e097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:12.097566 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-55f8e3ee-1c50-40d9-9402-9e0a3327e097 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:12.098769 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-55f8e3ee-1c50-40d9-9402-9e0a3327e097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:12.113672 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:12.161822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9019ae2-23f5-4700-8555-81b590f8cded None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:12.162458 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9019ae2-23f5-4700-8555-81b590f8cded None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:12.162925 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9019ae2-23f5-4700-8555-81b590f8cded None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:12.164523 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 118/236] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:01:12.169739 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c025f9-9cba-4a23-9024-fd3291a83419 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:12.170137 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c025f9-9cba-4a23-9024-fd3291a83419 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:12.170503 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c025f9-9cba-4a23-9024-fd3291a83419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:12.199562 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-93c025f9-9cba-4a23-9024-fd3291a83419 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:12.200759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-93c025f9-9cba-4a23-9024-fd3291a83419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:12.203835 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 119/237] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:12.301935 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 119/238] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:01:12.530557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8e3ee-1c50-40d9-9402-9e0a3327e097 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:12.632972 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c025f9-9cba-4a23-9024-fd3291a83419 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:12.663075 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:12.666962 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8e3ee-1c50-40d9-9402-9e0a3327e097 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:12.720188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bd4f9-b1ca-44f5-a317-297d4a5f5c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:12.721078 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bd4f9-b1ca-44f5-a317-297d4a5f5c3c None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:12.721518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bd4f9-b1ca-44f5-a317-297d4a5f5c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:12.721938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bd4f9-b1ca-44f5-a317-297d4a5f5c3c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:12.737801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bd4f9-b1ca-44f5-a317-297d4a5f5c3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:12.744746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-e74bd4f9-b1ca-44f5-a317-297d4a5f5c3c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:01:12.744746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:12.744746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:12.744746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:12.744746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:12.744746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:12.744746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:12.744746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:12.744746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:12.744746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:12.744746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:12.744746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:12.744746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:12.744746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:12.744746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:12.744746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:12.745772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:12.745772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:12.745772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:12.745772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:12.745772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:12.745772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:12.745772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:12.745772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:12.745772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:12.745772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:12.745772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:12.745772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:12.745772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:12.745772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:12.745772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:12.745772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:12.746581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:12.746581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:12.746581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:12.746581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:12.746581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:12.746581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:12.746581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:12.746581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:12.746581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:12.746581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:12.746581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:01:12.746581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:12.755021 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 120/239] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:12.757729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160483b2-79da-4f05-b5a1-fee7adfea05b None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:12.758199 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160483b2-79da-4f05-b5a1-fee7adfea05b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:12.758616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160483b2-79da-4f05-b5a1-fee7adfea05b None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:12.760403 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 121/240] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:12.763835 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c025f9-9cba-4a23-9024-fd3291a83419 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:12.765924 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160483b2-79da-4f05-b5a1-fee7adfea05b None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:12.783476 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:12.810402 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d670c70-5740-43fc-9c17-a8cb7ea094d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:12.811368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d670c70-5740-43fc-9c17-a8cb7ea094d3 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:12.811852 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d670c70-5740-43fc-9c17-a8cb7ea094d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:12.812311 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d670c70-5740-43fc-9c17-a8cb7ea094d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:12.813643 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d670c70-5740-43fc-9c17-a8cb7ea094d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:12.815285 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d670c70-5740-43fc-9c17-a8cb7ea094d3 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:12.817251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 120/241] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:12.819288 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c88d9f-4efa-4d00-aa8a-04a3ace32cca None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:12.819791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c88d9f-4efa-4d00-aa8a-04a3ace32cca None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:12.820257 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c88d9f-4efa-4d00-aa8a-04a3ace32cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:12.840864 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-87c88d9f-4efa-4d00-aa8a-04a3ace32cca None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:12.842495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-87c88d9f-4efa-4d00-aa8a-04a3ace32cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:12.893394 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160483b2-79da-4f05-b5a1-fee7adfea05b None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:12.919939 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 121/242] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:12.921159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c88d9f-4efa-4d00-aa8a-04a3ace32cca None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:12.935628 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f23a4-ec6d-4461-9b72-31e996be7bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:12.936508 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f23a4-ec6d-4461-9b72-31e996be7bad None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:12.936788 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f23a4-ec6d-4461-9b72-31e996be7bad None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:12.937059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f23a4-ec6d-4461-9b72-31e996be7bad None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:12.937723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f23a4-ec6d-4461-9b72-31e996be7bad None admin] RBAC: Adding query filter params (name=reader) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:12.938044 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f23a4-ec6d-4461-9b72-31e996be7bad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:12.939394 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f23a4-ec6d-4461-9b72-31e996be7bad None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:12.949543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 122/243] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:01:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:12.951476 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:12.955318 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f23a4-ec6d-4461-9b72-31e996be7bad None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:13.035646 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:13.037998 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c88d9f-4efa-4d00-aa8a-04a3ace32cca None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:13.069164 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f23a4-ec6d-4461-9b72-31e996be7bad None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:13.081320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b782175-81c4-410a-b55d-a96a1f2c74b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:13.082711 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b782175-81c4-410a-b55d-a96a1f2c74b8 None admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:13.083196 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b782175-81c4-410a-b55d-a96a1f2c74b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:13.084230 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b782175-81c4-410a-b55d-a96a1f2c74b8 None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:13.085104 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b782175-81c4-410a-b55d-a96a1f2c74b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:13.086765 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b782175-81c4-410a-b55d-a96a1f2c74b8 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:13.122295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe3447-cc95-4907-b166-a7a67e74b668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:13.123043 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe3447-cc95-4907-b166-a7a67e74b668 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:13.123329 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe3447-cc95-4907-b166-a7a67e74b668 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:13.123775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe3447-cc95-4907-b166-a7a67e74b668 None admin] PATH_INFO: `/v3/users/c127df7080204a2dbfb3b1b4fda7be88` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:13.142110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 122/244] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 28 12:01:12 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:01:13.152211 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe3447-cc95-4907-b166-a7a67e74b668 None admin] RBAC: Authorizing `identity:get_user(user_id=c127df7080204a2dbfb3b1b4fda7be88)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:13.153829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe3447-cc95-4907-b166-a7a67e74b668 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:13.155738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 123/245] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:01:12 2022] GET /identity/v3/users/c127df7080204a2dbfb3b1b4fda7be88 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:13.164875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b782175-81c4-410a-b55d-a96a1f2c74b8 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:13.303377 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe3447-cc95-4907-b166-a7a67e74b668 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:13.320322 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:13.358164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b782175-81c4-410a-b55d-a96a1f2c74b8 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:13.419287 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d1a65-2e4f-436a-a6b9-07b64a6ac8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:13.419948 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d1a65-2e4f-436a-a6b9-07b64a6ac8f8 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:13.420223 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d1a65-2e4f-436a-a6b9-07b64a6ac8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:13.420499 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d1a65-2e4f-436a-a6b9-07b64a6ac8f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:13.464081 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe3447-cc95-4907-b166-a7a67e74b668 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:13.501368 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:13.509191 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a333f85-2d44-481b-8588-9ca2f56cb150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:13.510001 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a333f85-2d44-481b-8588-9ca2f56cb150 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:13.510402 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a333f85-2d44-481b-8588-9ca2f56cb150 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:13.510686 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a333f85-2d44-481b-8588-9ca2f56cb150 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:13.510848 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d1a65-2e4f-436a-a6b9-07b64a6ac8f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:13.512402 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d1a65-2e4f-436a-a6b9-07b64a6ac8f8 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:13.522865 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a333f85-2d44-481b-8588-9ca2f56cb150 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:13.529702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-4a333f85-2d44-481b-8588-9ca2f56cb150 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:01:13.529702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:13.529702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:13.529702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:13.529702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:13.529702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:13.529702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:13.529702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:13.529702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:13.529702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:13.529702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:13.529702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:13.529702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:13.529702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:13.529702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:13.529702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:13.530601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:13.530601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:13.530601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:13.530601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:13.530601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:13.530601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:13.530601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:13.530601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:13.530601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:13.530601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:13.530601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:13.530601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:13.530601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:13.530601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:13.530601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:13.530601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:13.532458 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:13.532458 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:13.532458 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:13.532458 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:13.532458 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:13.532458 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:13.532458 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:13.532458 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:13.532458 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:13.532458 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:13.532458 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:01:13.532458 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:13.532458 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 124/246] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:13.532458 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002026d5-3a23-467c-a308-f90ab8d2a630 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:13.533365 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002026d5-3a23-467c-a308-f90ab8d2a630 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:13.533365 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002026d5-3a23-467c-a308-f90ab8d2a630 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:13.534705 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 125/247] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:13.539886 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002026d5-3a23-467c-a308-f90ab8d2a630 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:13.618016 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:13.654364 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 123/248] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:01:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:01:13.656159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5de27a-5ca8-4592-909c-cd7b1396e481 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:13.656658 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5de27a-5ca8-4592-909c-cd7b1396e481 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:13.657149 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5de27a-5ca8-4592-909c-cd7b1396e481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:13.669219 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002026d5-3a23-467c-a308-f90ab8d2a630 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:13.680021 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-8b5de27a-5ca8-4592-909c-cd7b1396e481 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:13.681646 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-8b5de27a-5ca8-4592-909c-cd7b1396e481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:13.714339 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6283d-8ce4-4dad-9e28-75c4849a9247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:13.715064 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6283d-8ce4-4dad-9e28-75c4849a9247 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:13.715351 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6283d-8ce4-4dad-9e28-75c4849a9247 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:13.715659 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6283d-8ce4-4dad-9e28-75c4849a9247 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:13.716338 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6283d-8ce4-4dad-9e28-75c4849a9247 None admin] RBAC: Adding query filter params (name=member) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:13.716644 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6283d-8ce4-4dad-9e28-75c4849a9247 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:13.718345 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6283d-8ce4-4dad-9e28-75c4849a9247 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:13.729723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 126/249] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:01:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:13.732091 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6283d-8ce4-4dad-9e28-75c4849a9247 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:13.766411 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 124/250] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:13.768105 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5de27a-5ca8-4592-909c-cd7b1396e481 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:13.826636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:13.927745 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5de27a-5ca8-4592-909c-cd7b1396e481 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:13.947618 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:13.955892 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6283d-8ce4-4dad-9e28-75c4849a9247 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:14.016899 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297afbd-e694-4c28-8d5c-306b083f9e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:14.017611 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297afbd-e694-4c28-8d5c-306b083f9e45 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:14.017893 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297afbd-e694-4c28-8d5c-306b083f9e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:14.018163 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297afbd-e694-4c28-8d5c-306b083f9e45 None admin] PATH_INFO: `/v3/users/47f0db753db74d4eb981cc146bf02b21` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:14.020576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297afbd-e694-4c28-8d5c-306b083f9e45 None admin] RBAC: Authorizing `identity:get_user(user_id=47f0db753db74d4eb981cc146bf02b21)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:14.022120 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297afbd-e694-4c28-8d5c-306b083f9e45 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:14.023816 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 125/251] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:01:13 2022] GET /identity/v3/users/47f0db753db74d4eb981cc146bf02b21 => generated 297 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:14.037897 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297afbd-e694-4c28-8d5c-306b083f9e45 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:14.047269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c4876-4e40-4e9f-b9a2-b6717c19513a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:14.047954 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c4876-4e40-4e9f-b9a2-b6717c19513a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:14.048232 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c4876-4e40-4e9f-b9a2-b6717c19513a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:14.048505 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c4876-4e40-4e9f-b9a2-b6717c19513a None admin] PATH_INFO: `/v3/projects/6f1f0a0a8c824d639602043911e34bb5` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:14.051154 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c4876-4e40-4e9f-b9a2-b6717c19513a None admin] RBAC: Authorizing `identity:get_project(project_id=6f1f0a0a8c824d639602043911e34bb5)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:14.052702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c4876-4e40-4e9f-b9a2-b6717c19513a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:14.056491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 127/252] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:13 2022] GET /identity/v3/projects/6f1f0a0a8c824d639602043911e34bb5 => generated 302 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:14.062191 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c4876-4e40-4e9f-b9a2-b6717c19513a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:14.194121 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297afbd-e694-4c28-8d5c-306b083f9e45 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:14.235541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c1e9e-01fb-4efe-80ce-32650d9a8947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:14.236934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c1e9e-01fb-4efe-80ce-32650d9a8947 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:14.237541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c1e9e-01fb-4efe-80ce-32650d9a8947 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:14.238017 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c1e9e-01fb-4efe-80ce-32650d9a8947 None admin] PATH_INFO: `/v3/projects/6f1f0a0a8c824d639602043911e34bb5` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:14.239351 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c1e9e-01fb-4efe-80ce-32650d9a8947 None admin] RBAC: Authorizing `identity:get_project(project_id=6f1f0a0a8c824d639602043911e34bb5)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:14.242002 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c1e9e-01fb-4efe-80ce-32650d9a8947 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:14.243605 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c4876-4e40-4e9f-b9a2-b6717c19513a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:14.244172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 126/253] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:14 2022] GET /identity/v3/projects/6f1f0a0a8c824d639602043911e34bb5 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:14.245849 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a72aa2-cdca-4498-8e57-edd04c0305f6 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:14.246385 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a72aa2-cdca-4498-8e57-edd04c0305f6 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:14.246850 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a72aa2-cdca-4498-8e57-edd04c0305f6 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:14.248563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 127/254] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:14.251412 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a72aa2-cdca-4498-8e57-edd04c0305f6 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:14.286519 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:14.303733 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae02261-33ea-4f4a-b798-51d8b28e2945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:14.304522 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae02261-33ea-4f4a-b798-51d8b28e2945 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:14.304719 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae02261-33ea-4f4a-b798-51d8b28e2945 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:14.304995 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae02261-33ea-4f4a-b798-51d8b28e2945 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:14.305735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae02261-33ea-4f4a-b798-51d8b28e2945 None admin] RBAC: Adding query filter params (role.id=9f66f016692f4bff811f91c9fb372e57, scope.project.id=6f1f0a0a8c824d639602043911e34bb5, user.id=c127df7080204a2dbfb3b1b4fda7be88) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:14.306044 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae02261-33ea-4f4a-b798-51d8b28e2945 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:14.307642 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae02261-33ea-4f4a-b798-51d8b28e2945 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:14.313829 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:14.315244 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 128/255] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:01:14 2022] GET /identity/v3/role_assignments?user.id=c127df7080204a2dbfb3b1b4fda7be88&scope.project.id=6f1f0a0a8c824d639602043911e34bb5&role.id=9f66f016692f4bff811f91c9fb372e57 => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:14.316606 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e56fd-219d-4702-bf1e-eada913f71d1 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:14.316995 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e56fd-219d-4702-bf1e-eada913f71d1 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:14.317274 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e56fd-219d-4702-bf1e-eada913f71d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:14.341635 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-909e56fd-219d-4702-bf1e-eada913f71d1 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:14.343046 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-909e56fd-219d-4702-bf1e-eada913f71d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:14.385241 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a72aa2-cdca-4498-8e57-edd04c0305f6 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:14.434526 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 129/256] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:14.435463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e56fd-219d-4702-bf1e-eada913f71d1 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:14.459192 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fdb6f-faf3-4db6-aa07-1747a2fa462e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:14.459824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fdb6f-faf3-4db6-aa07-1747a2fa462e None admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:14.460107 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fdb6f-faf3-4db6-aa07-1747a2fa462e None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:14.460383 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fdb6f-faf3-4db6-aa07-1747a2fa462e None admin] PATH_INFO: `/v3/projects/6f1f0a0a8c824d639602043911e34bb5/users/47f0db753db74d4eb981cc146bf02b21/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:14.467158 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fdb6f-faf3-4db6-aa07-1747a2fa462e None admin] RBAC: Authorizing `identity:create_grant(project_id=6f1f0a0a8c824d639602043911e34bb5, user_id=47f0db753db74d4eb981cc146bf02b21, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:14.468776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fdb6f-faf3-4db6-aa07-1747a2fa462e None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:14.498713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 128/257] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 28 12:01:14 2022] PUT /identity/v3/projects/6f1f0a0a8c824d639602043911e34bb5/users/47f0db753db74d4eb981cc146bf02b21/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:01:14.585657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e56fd-219d-4702-bf1e-eada913f71d1 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:14.602206 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:14.634908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acd4c3-73db-4d8f-9424-f790fb088176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:14.635972 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acd4c3-73db-4d8f-9424-f790fb088176 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:14.636482 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acd4c3-73db-4d8f-9424-f790fb088176 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:14.636968 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acd4c3-73db-4d8f-9424-f790fb088176 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:14.650673 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66acd4c3-73db-4d8f-9424-f790fb088176 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:14.656284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-66acd4c3-73db-4d8f-9424-f790fb088176 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:01:14.656284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:14.656284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:14.656284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:14.656284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:14.656284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:14.656284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:14.656284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:14.656284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:14.656284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:14.656284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:14.656284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:14.656284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:14.656284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:14.656284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:14.656284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:14.657208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:14.657208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:14.657208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:14.657208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:14.657208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:14.657208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:14.657208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:14.657208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:14.657208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:14.657208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:14.657208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:14.657208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:14.657208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:14.657208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:14.657208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:14.657208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:14.658036 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:14.658036 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:14.658036 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:14.658036 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:14.658036 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:14.658036 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:14.658036 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:14.658036 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:14.658036 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:14.658036 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:14.658036 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:01:14.658036 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:14.661000 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 130/258] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:01:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:14.668602 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fdb6f-faf3-4db6-aa07-1747a2fa462e None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:14.820747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fdb6f-faf3-4db6-aa07-1747a2fa462e None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:14.832294 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:14.863658 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c9f27-b800-4a44-860c-4f3ce89f0668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:14.864275 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c9f27-b800-4a44-860c-4f3ce89f0668 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:14.864611 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c9f27-b800-4a44-860c-4f3ce89f0668 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:14.864886 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c9f27-b800-4a44-860c-4f3ce89f0668 None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:14.865553 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c9f27-b800-4a44-860c-4f3ce89f0668 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:14.865857 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c9f27-b800-4a44-860c-4f3ce89f0668 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:14.867511 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c9f27-b800-4a44-860c-4f3ce89f0668 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:14.878846 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 129/259] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:14.885584 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acd4c3-73db-4d8f-9424-f790fb088176 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:14.912296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c9f27-b800-4a44-860c-4f3ce89f0668 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:15.076835 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acd4c3-73db-4d8f-9424-f790fb088176 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:15.095224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c9f27-b800-4a44-860c-4f3ce89f0668 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:15.146353 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f562b3-076e-47e3-a0e2-e46e7c3e9cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:15.147006 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f562b3-076e-47e3-a0e2-e46e7c3e9cbe None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:15.147287 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f562b3-076e-47e3-a0e2-e46e7c3e9cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:15.147630 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f562b3-076e-47e3-a0e2-e46e7c3e9cbe None admin] PATH_INFO: `/v3/users/e65f551d9a364bd2ba35a01bdafa1ebe` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:15.152198 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f562b3-076e-47e3-a0e2-e46e7c3e9cbe None admin] RBAC: Authorizing `identity:get_user(user_id=e65f551d9a364bd2ba35a01bdafa1ebe)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:15.153686 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f562b3-076e-47e3-a0e2-e46e7c3e9cbe None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:15.155644 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 131/260] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:01:14 2022] GET /identity/v3/users/e65f551d9a364bd2ba35a01bdafa1ebe => generated 283 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:15.160890 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f562b3-076e-47e3-a0e2-e46e7c3e9cbe None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:15.161287 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569c56a-2eca-41ba-b0bd-61888cc3f27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:15.162808 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569c56a-2eca-41ba-b0bd-61888cc3f27a None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:15.163285 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569c56a-2eca-41ba-b0bd-61888cc3f27a None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:15.163776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569c56a-2eca-41ba-b0bd-61888cc3f27a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:15.192386 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569c56a-2eca-41ba-b0bd-61888cc3f27a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:15.198263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-b569c56a-2eca-41ba-b0bd-61888cc3f27a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:01:15.198263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:15.198263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:15.198263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:15.198263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:15.198263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:15.198263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:15.198263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:15.198263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:15.198263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:15.198263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:15.198263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:15.198263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:15.198263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:15.198263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:15.198263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:15.199628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:15.199628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:15.199628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:15.199628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:15.199628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:15.199628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:15.199628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:15.199628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:15.199628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:15.199628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:15.199628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:15.199628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:15.199628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:15.199628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:15.199628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:15.199628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:15.200441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:15.200441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:15.200441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:15.200441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:15.200441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:15.200441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:15.200441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:15.200441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:15.200441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:15.200441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:15.200441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:01:15.200441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:15.202754 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 130/261] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 28 12:01:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:01:15.209063 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569c56a-2eca-41ba-b0bd-61888cc3f27a None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:15.272070 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:15.277004 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:15.337534 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f562b3-076e-47e3-a0e2-e46e7c3e9cbe None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:15.376021 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff1a81-b012-4165-9487-05fcd28a32a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:15.377031 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff1a81-b012-4165-9487-05fcd28a32a0 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:15.377312 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff1a81-b012-4165-9487-05fcd28a32a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:15.377590 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff1a81-b012-4165-9487-05fcd28a32a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:15.513685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569c56a-2eca-41ba-b0bd-61888cc3f27a None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:15.524066 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff1a81-b012-4165-9487-05fcd28a32a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:15.525895 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff1a81-b012-4165-9487-05fcd28a32a0 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:15.599998 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1684c5-ee1c-476c-a7ef-1d1d2ff50323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:15.600534 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1684c5-ee1c-476c-a7ef-1d1d2ff50323 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:15.600811 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1684c5-ee1c-476c-a7ef-1d1d2ff50323 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:15.601087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1684c5-ee1c-476c-a7ef-1d1d2ff50323 None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:15.601761 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1684c5-ee1c-476c-a7ef-1d1d2ff50323 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:15.602117 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1684c5-ee1c-476c-a7ef-1d1d2ff50323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:15.605633 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1684c5-ee1c-476c-a7ef-1d1d2ff50323 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:15.612911 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:15.621776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 131/262] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:01:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:15.627290 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1684c5-ee1c-476c-a7ef-1d1d2ff50323 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:15.700090 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 132/263] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:01:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:01:15.709122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff1a81-b012-4165-9487-05fcd28a32a0 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:15.828373 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff1a81-b012-4165-9487-05fcd28a32a0 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:15.866689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:15.869711 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd216313-af4c-4c9a-84b6-79b4882dbbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:15.870563 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd216313-af4c-4c9a-84b6-79b4882dbbb2 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:15.871150 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd216313-af4c-4c9a-84b6-79b4882dbbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:15.871647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd216313-af4c-4c9a-84b6-79b4882dbbb2 None admin] PATH_INFO: `/v3/projects/6f1f0a0a8c824d639602043911e34bb5` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:15.876762 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd216313-af4c-4c9a-84b6-79b4882dbbb2 None admin] RBAC: Authorizing `identity:get_project(project_id=6f1f0a0a8c824d639602043911e34bb5)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:15.878491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd216313-af4c-4c9a-84b6-79b4882dbbb2 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:15.882870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 133/264] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:15 2022] GET /identity/v3/projects/6f1f0a0a8c824d639602043911e34bb5 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:15.887091 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1684c5-ee1c-476c-a7ef-1d1d2ff50323 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:15.889613 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd216313-af4c-4c9a-84b6-79b4882dbbb2 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:15.904609 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:15.960154 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d31cf4-2d83-42d5-acde-9e08d2583b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:15.960933 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d31cf4-2d83-42d5-acde-9e08d2583b63 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:15.961197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d31cf4-2d83-42d5-acde-9e08d2583b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:15.961472 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d31cf4-2d83-42d5-acde-9e08d2583b63 None admin] PATH_INFO: `/v3/users/e65f551d9a364bd2ba35a01bdafa1ebe` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:15.962651 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d31cf4-2d83-42d5-acde-9e08d2583b63 None admin] RBAC: Authorizing `identity:get_user(user_id=e65f551d9a364bd2ba35a01bdafa1ebe)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:15.964261 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d31cf4-2d83-42d5-acde-9e08d2583b63 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:15.965973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 132/265] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:01:15 2022] GET /identity/v3/users/e65f551d9a364bd2ba35a01bdafa1ebe => generated 283 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:15.971863 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d31cf4-2d83-42d5-acde-9e08d2583b63 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:16.018195 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd216313-af4c-4c9a-84b6-79b4882dbbb2 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:16.102370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4bb83-8a67-46d6-90f6-8fe990cb6d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:16.102995 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4bb83-8a67-46d6-90f6-8fe990cb6d14 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:16.103273 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4bb83-8a67-46d6-90f6-8fe990cb6d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:16.103570 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4bb83-8a67-46d6-90f6-8fe990cb6d14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:16.104307 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4bb83-8a67-46d6-90f6-8fe990cb6d14 None admin] RBAC: Adding query filter params (role.id=66456d39fc0c496c8f290a436b726216, scope.project.id=6f1f0a0a8c824d639602043911e34bb5, user.id=e65f551d9a364bd2ba35a01bdafa1ebe) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:16.104615 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4bb83-8a67-46d6-90f6-8fe990cb6d14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:16.106086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4bb83-8a67-46d6-90f6-8fe990cb6d14 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:16.113597 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 134/266] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:01:15 2022] GET /identity/v3/role_assignments?user.id=e65f551d9a364bd2ba35a01bdafa1ebe&scope.project.id=6f1f0a0a8c824d639602043911e34bb5&role.id=66456d39fc0c496c8f290a436b726216 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:16.173941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d31cf4-2d83-42d5-acde-9e08d2583b63 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:16.190278 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aeb7e8-7bba-480e-9eea-06f8c0b96506 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:16.190620 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aeb7e8-7bba-480e-9eea-06f8c0b96506 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:16.190828 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aeb7e8-7bba-480e-9eea-06f8c0b96506 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:16.192428 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 135/267] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:01:16.205146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4dfd9-f49b-4192-ac11-6373f6e0f5cb None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:16.205466 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4dfd9-f49b-4192-ac11-6373f6e0f5cb None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:16.205698 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4dfd9-f49b-4192-ac11-6373f6e0f5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:16.226941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0036ae-2b72-4fdf-acc8-a03db1438927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:16.227623 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0036ae-2b72-4fdf-acc8-a03db1438927 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:16.227898 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0036ae-2b72-4fdf-acc8-a03db1438927 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:16.228172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0036ae-2b72-4fdf-acc8-a03db1438927 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:16.260644 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-54a4dfd9-f49b-4192-ac11-6373f6e0f5cb None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:16.261897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-54a4dfd9-f49b-4192-ac11-6373f6e0f5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:16.275838 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:16.349611 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0036ae-2b72-4fdf-acc8-a03db1438927 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:16.351082 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0036ae-2b72-4fdf-acc8-a03db1438927 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:16.419542 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 136/268] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:16.487482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 133/269] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:01:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:01:16.493484 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4dfd9-f49b-4192-ac11-6373f6e0f5cb None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:16.497066 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:16.547960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f7fa1-8565-4cc9-a3b5-147e78e98607 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:16.548654 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f7fa1-8565-4cc9-a3b5-147e78e98607 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:16.549148 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f7fa1-8565-4cc9-a3b5-147e78e98607 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:16.550937 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 134/270] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:01:16.557435 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e4e5c-9f19-4ea8-8a73-fbb62e58077d None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:16.557979 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e4e5c-9f19-4ea8-8a73-fbb62e58077d None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:16.558460 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e4e5c-9f19-4ea8-8a73-fbb62e58077d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:16.592328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-304e4e5c-9f19-4ea8-8a73-fbb62e58077d None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:16.593852 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-304e4e5c-9f19-4ea8-8a73-fbb62e58077d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:16.609214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4dfd9-f49b-4192-ac11-6373f6e0f5cb None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:16.650948 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4b332-26d2-4a8b-a619-d1b78d7028ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:16.651731 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4b332-26d2-4a8b-a619-d1b78d7028ef None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:16.651918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4b332-26d2-4a8b-a619-d1b78d7028ef None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:16.652163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4b332-26d2-4a8b-a619-d1b78d7028ef None admin] PATH_INFO: `/v3/projects/6f1f0a0a8c824d639602043911e34bb5` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:16.654633 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4b332-26d2-4a8b-a619-d1b78d7028ef None admin] RBAC: Authorizing `identity:get_project(project_id=6f1f0a0a8c824d639602043911e34bb5)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:16.657778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4b332-26d2-4a8b-a619-d1b78d7028ef None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:16.659759 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 137/271] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:16 2022] GET /identity/v3/projects/6f1f0a0a8c824d639602043911e34bb5 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:16.668628 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4b332-26d2-4a8b-a619-d1b78d7028ef None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:16.707777 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:16.730468 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 135/272] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:01:16.782547 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:16.808334 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4b332-26d2-4a8b-a619-d1b78d7028ef None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:16.855064 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d69321-5ade-451e-bf74-077961c8cd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:16.855701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d69321-5ade-451e-bf74-077961c8cd71 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:16.855981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d69321-5ade-451e-bf74-077961c8cd71 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:16.856252 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d69321-5ade-451e-bf74-077961c8cd71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:16.856983 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d69321-5ade-451e-bf74-077961c8cd71 None admin] RBAC: Adding query filter params (role.id=67ed180941fd45af996b858232628221, scope.project.id=6f1f0a0a8c824d639602043911e34bb5, user.id=e65f551d9a364bd2ba35a01bdafa1ebe) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:16.857291 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d69321-5ade-451e-bf74-077961c8cd71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:16.858728 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d69321-5ade-451e-bf74-077961c8cd71 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:16.867486 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 138/273] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:01:16 2022] GET /identity/v3/role_assignments?user.id=e65f551d9a364bd2ba35a01bdafa1ebe&scope.project.id=6f1f0a0a8c824d639602043911e34bb5&role.id=67ed180941fd45af996b858232628221 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:16.888326 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e4e5c-9f19-4ea8-8a73-fbb62e58077d None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:17.034957 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e4e5c-9f19-4ea8-8a73-fbb62e58077d None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:17.081343 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cb06d-0420-4537-b50b-6017d59035cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:17.081984 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cb06d-0420-4537-b50b-6017d59035cf None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:17.082263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cb06d-0420-4537-b50b-6017d59035cf None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:17.082533 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cb06d-0420-4537-b50b-6017d59035cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:17.084236 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686cb06d-0420-4537-b50b-6017d59035cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:17.085777 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686cb06d-0420-4537-b50b-6017d59035cf None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:17.087728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 136/274] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:17.092942 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d69321-5ade-451e-bf74-077961c8cd71 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:17.189929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cb06d-0420-4537-b50b-6017d59035cf None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:17.221705 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d69321-5ade-451e-bf74-077961c8cd71 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:17.266868 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:17.268367 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378fffad-8881-4136-b730-2b18a01880b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:17.269200 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fffad-8881-4136-b730-2b18a01880b5 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:17.269551 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fffad-8881-4136-b730-2b18a01880b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:17.269888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fffad-8881-4136-b730-2b18a01880b5 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:17.271142 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378fffad-8881-4136-b730-2b18a01880b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:17.272799 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378fffad-8881-4136-b730-2b18a01880b5 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:17.283424 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:17.316348 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 139/275] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 28 12:01:17 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:01:17.328058 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cb06d-0420-4537-b50b-6017d59035cf None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:17.374276 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0ca3e-b6a8-44dd-9e55-ad063a3f3037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:17.374943 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0ca3e-b6a8-44dd-9e55-ad063a3f3037 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:17.375222 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0ca3e-b6a8-44dd-9e55-ad063a3f3037 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:17.375523 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0ca3e-b6a8-44dd-9e55-ad063a3f3037 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:17.388894 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0ca3e-b6a8-44dd-9e55-ad063a3f3037 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:17.394431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-23f0ca3e-b6a8-44dd-9e55-ad063a3f3037 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:01:17.394431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:17.394431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:17.394431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:17.394431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:17.394431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:17.394431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:17.394431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:17.394431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:17.394431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:17.394431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:17.394431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:17.394431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:17.394431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:17.394431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:17.394431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:17.397255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:17.397255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:17.397255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:17.397255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:17.397255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:17.397255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:17.397255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:17.397255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:17.397255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:17.397255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:17.397255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:17.397255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:17.397255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:17.397255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:17.397255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:17.397255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:17.398346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:17.398346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:17.398346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:17.398346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:17.398346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:17.398346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:17.398346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:17.398346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:17.398346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:17.398346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:17.398346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:01:17.398346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:17.398346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 137/276] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:17.402571 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378fffad-8881-4136-b730-2b18a01880b5 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:17.523534 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378fffad-8881-4136-b730-2b18a01880b5 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:17.560341 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad977dae-0c36-4a56-b70e-c4f8385c9e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:17.560960 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad977dae-0c36-4a56-b70e-c4f8385c9e86 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:17.561237 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad977dae-0c36-4a56-b70e-c4f8385c9e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:17.561516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad977dae-0c36-4a56-b70e-c4f8385c9e86 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:17.562248 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad977dae-0c36-4a56-b70e-c4f8385c9e86 None admin] RBAC: Adding query filter params (name=member) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:17.562553 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad977dae-0c36-4a56-b70e-c4f8385c9e86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:17.563969 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad977dae-0c36-4a56-b70e-c4f8385c9e86 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:17.573366 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 140/277] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:01:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:17.578906 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0ca3e-b6a8-44dd-9e55-ad063a3f3037 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:17.585755 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9245c-e726-4711-baae-f2da4b600d98 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:17.585913 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9245c-e726-4711-baae-f2da4b600d98 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:17.586155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9245c-e726-4711-baae-f2da4b600d98 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:17.587658 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 141/278] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:01:17.592555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0cb1b-bb3d-4bbb-a2f2-586c75192623 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:17.592845 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0cb1b-bb3d-4bbb-a2f2-586c75192623 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:17.593123 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0cb1b-bb3d-4bbb-a2f2-586c75192623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:17.611782 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-3ee0cb1b-bb3d-4bbb-a2f2-586c75192623 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:17.612988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3ee0cb1b-bb3d-4bbb-a2f2-586c75192623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:17.679748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:17.706931 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 142/279] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:01:17.722260 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0ca3e-b6a8-44dd-9e55-ad063a3f3037 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:17.749562 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:17.764250 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b6580-3298-46f7-9a53-0adfcef3f3f0 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:17.764753 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b6580-3298-46f7-9a53-0adfcef3f3f0 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:17.765213 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b6580-3298-46f7-9a53-0adfcef3f3f0 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:17.766986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 143/280] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:01:17.772313 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b4273-5458-4a23-9d78-1e7aad6e7e66 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:17.772806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b4273-5458-4a23-9d78-1e7aad6e7e66 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:17.773255 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b4273-5458-4a23-9d78-1e7aad6e7e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:17.773892 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeed84c-1cb2-4e38-9dfc-c659bf29973f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:17.774527 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeed84c-1cb2-4e38-9dfc-c659bf29973f None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:17.774806 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeed84c-1cb2-4e38-9dfc-c659bf29973f None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:17.775080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeed84c-1cb2-4e38-9dfc-c659bf29973f None admin] PATH_INFO: `/v3/users/74964152309a43b3948730bb9dec241c` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:17.790071 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeed84c-1cb2-4e38-9dfc-c659bf29973f None admin] RBAC: Authorizing `identity:get_user(user_id=74964152309a43b3948730bb9dec241c)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:17.791691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeed84c-1cb2-4e38-9dfc-c659bf29973f None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:17.793619 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-264b4273-5458-4a23-9d78-1e7aad6e7e66 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:17.793756 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 138/281] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:01:17 2022] GET /identity/v3/users/74964152309a43b3948730bb9dec241c => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:17.795123 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-264b4273-5458-4a23-9d78-1e7aad6e7e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:17.799543 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeed84c-1cb2-4e38-9dfc-c659bf29973f None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:17.884852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 144/282] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:17.930037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeed84c-1cb2-4e38-9dfc-c659bf29973f None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:17.967524 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373d758-ba2c-4504-a238-f923587c26d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:17.968140 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373d758-ba2c-4504-a238-f923587c26d9 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:17.968421 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373d758-ba2c-4504-a238-f923587c26d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:17.968695 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373d758-ba2c-4504-a238-f923587c26d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:17.969427 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373d758-ba2c-4504-a238-f923587c26d9 None admin] RBAC: Adding query filter params (role.id=9aa9b054939e4fc1ad0387e43c500693, user.id=74964152309a43b3948730bb9dec241c, scope.system=all) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:17.969735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373d758-ba2c-4504-a238-f923587c26d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:17.971177 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373d758-ba2c-4504-a238-f923587c26d9 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:17.976875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 139/283] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Sep 28 12:01:17 2022] GET /identity/v3/role_assignments?user.id=74964152309a43b3948730bb9dec241c&scope.system=all&role.id=9aa9b054939e4fc1ad0387e43c500693 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:18.017884 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b4273-5458-4a23-9d78-1e7aad6e7e66 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:18.149810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b4273-5458-4a23-9d78-1e7aad6e7e66 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:18.165459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:18.202015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d1b3f-8001-4b60-b0e7-eaf8630645fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:18.202670 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d1b3f-8001-4b60-b0e7-eaf8630645fc None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:18.202946 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d1b3f-8001-4b60-b0e7-eaf8630645fc None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:18.203220 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d1b3f-8001-4b60-b0e7-eaf8630645fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:18.222491 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373d758-ba2c-4504-a238-f923587c26d9 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:18.226722 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d1b3f-8001-4b60-b0e7-eaf8630645fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:18.231885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-1b5d1b3f-8001-4b60-b0e7-eaf8630645fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:01:18.231885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:18.231885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:18.231885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:18.231885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:18.231885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:18.231885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:18.231885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:18.231885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:18.231885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:18.231885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:18.231885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:18.231885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:18.231885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:18.231885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:18.231885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:18.232806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:18.232806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:18.232806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:18.232806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:18.232806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:18.232806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:18.232806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:18.232806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:18.232806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:18.232806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:18.232806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:18.232806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:18.232806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:18.232806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:18.232806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:18.232806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:18.233589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:18.233589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:18.233589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:18.233589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:18.233589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:18.233589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:18.233589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:18.233589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:18.233589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:18.233589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:18.233589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:01:18.233589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:18.233589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 145/284] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:18.239008 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d1b3f-8001-4b60-b0e7-eaf8630645fc None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:18.275825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:18.371292 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373d758-ba2c-4504-a238-f923587c26d9 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:18.394138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d1b3f-8001-4b60-b0e7-eaf8630645fc None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:18.430339 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cebffd-c2b7-488d-a08f-46c69ec8df58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:18.431213 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cebffd-c2b7-488d-a08f-46c69ec8df58 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:18.431783 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cebffd-c2b7-488d-a08f-46c69ec8df58 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:18.432197 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cebffd-c2b7-488d-a08f-46c69ec8df58 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:18.433044 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cebffd-c2b7-488d-a08f-46c69ec8df58 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:18.433492 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cebffd-c2b7-488d-a08f-46c69ec8df58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:18.435094 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cebffd-c2b7-488d-a08f-46c69ec8df58 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:18.444532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 146/285] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:01:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:18.451360 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cebffd-c2b7-488d-a08f-46c69ec8df58 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:18.465098 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee47bb5-8845-4267-9c36-a22ae375fbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:18.465687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee47bb5-8845-4267-9c36-a22ae375fbfd None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:18.465972 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee47bb5-8845-4267-9c36-a22ae375fbfd None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:18.466247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee47bb5-8845-4267-9c36-a22ae375fbfd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:18.486297 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee47bb5-8845-4267-9c36-a22ae375fbfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:18.493535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-8ee47bb5-8845-4267-9c36-a22ae375fbfd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:01:18.493535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:18.493535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:18.493535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:18.493535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:18.493535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:18.493535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:18.493535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:18.493535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:18.493535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:18.493535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:18.493535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:18.493535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:18.493535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:18.493535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:18.493535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:18.494480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:18.494480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:18.494480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:18.494480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:18.494480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:18.494480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:18.494480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:18.494480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:18.494480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:18.494480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:18.494480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:18.494480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:18.494480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:18.494480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:18.494480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:18.494480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:18.495895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:18.495895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:18.495895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:18.495895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:18.495895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:18.495895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:18.495895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:18.495895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:18.495895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:18.495895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:18.495895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:01:18.495895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:18.495895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 140/286] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:18.500412 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee47bb5-8845-4267-9c36-a22ae375fbfd None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:18.501137 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:18.562961 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cebffd-c2b7-488d-a08f-46c69ec8df58 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:18.607791 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850111e-4aee-49c8-b258-0cc527d6396e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:18.608446 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850111e-4aee-49c8-b258-0cc527d6396e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:18.608729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850111e-4aee-49c8-b258-0cc527d6396e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:18.609004 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850111e-4aee-49c8-b258-0cc527d6396e None admin] PATH_INFO: `/v3/users/c127df7080204a2dbfb3b1b4fda7be88` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:18.616333 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850111e-4aee-49c8-b258-0cc527d6396e None admin] RBAC: Authorizing `identity:get_user(user_id=c127df7080204a2dbfb3b1b4fda7be88)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:18.617828 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850111e-4aee-49c8-b258-0cc527d6396e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:18.619535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 147/287] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:01:18 2022] GET /identity/v3/users/c127df7080204a2dbfb3b1b4fda7be88 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:18.625093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850111e-4aee-49c8-b258-0cc527d6396e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:18.725401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:18.745105 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee47bb5-8845-4267-9c36-a22ae375fbfd None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:18.821947 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505adc5-355c-41de-a223-8837214b20dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:18.822696 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505adc5-355c-41de-a223-8837214b20dc None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:18.822971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505adc5-355c-41de-a223-8837214b20dc None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:18.823239 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505adc5-355c-41de-a223-8837214b20dc None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:18.823935 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505adc5-355c-41de-a223-8837214b20dc None admin] RBAC: Adding query filter params (name=member) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:18.824236 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505adc5-355c-41de-a223-8837214b20dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:18.825621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505adc5-355c-41de-a223-8837214b20dc None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:18.834581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850111e-4aee-49c8-b258-0cc527d6396e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:18.840532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:18.843090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 141/288] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:01:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:18.852493 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505adc5-355c-41de-a223-8837214b20dc None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:18.885497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8461c5-9b98-47f8-8f91-4b629f422a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:18.886709 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8461c5-9b98-47f8-8f91-4b629f422a8d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:18.887181 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8461c5-9b98-47f8-8f91-4b629f422a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:18.887677 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8461c5-9b98-47f8-8f91-4b629f422a8d None admin] PATH_INFO: `/v3/projects/6f1f0a0a8c824d639602043911e34bb5` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:18.889417 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8461c5-9b98-47f8-8f91-4b629f422a8d None admin] RBAC: Authorizing `identity:get_project(project_id=6f1f0a0a8c824d639602043911e34bb5)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:18.891585 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8461c5-9b98-47f8-8f91-4b629f422a8d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:18.893812 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 148/289] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:18 2022] GET /identity/v3/projects/6f1f0a0a8c824d639602043911e34bb5 => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:18.903585 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8461c5-9b98-47f8-8f91-4b629f422a8d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:19.070406 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8461c5-9b98-47f8-8f91-4b629f422a8d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:19.073279 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505adc5-355c-41de-a223-8837214b20dc None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:19.111260 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2467f-b8fb-40fd-8bd1-673f803c5be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:19.111958 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2467f-b8fb-40fd-8bd1-673f803c5be5 None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:19.112264 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2467f-b8fb-40fd-8bd1-673f803c5be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:19.113009 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2467f-b8fb-40fd-8bd1-673f803c5be5 None admin] PATH_INFO: `/v3/projects/6f1f0a0a8c824d639602043911e34bb5/users/c127df7080204a2dbfb3b1b4fda7be88/roles/9f66f016692f4bff811f91c9fb372e57` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:19.116104 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2467f-b8fb-40fd-8bd1-673f803c5be5 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f1f0a0a8c824d639602043911e34bb5, user_id=c127df7080204a2dbfb3b1b4fda7be88, role_id=9f66f016692f4bff811f91c9fb372e57)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:19.118384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2467f-b8fb-40fd-8bd1-673f803c5be5 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:19.133360 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 149/290] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 28 12:01:18 2022] PUT /identity/v3/projects/6f1f0a0a8c824d639602043911e34bb5/users/c127df7080204a2dbfb3b1b4fda7be88/roles/9f66f016692f4bff811f91c9fb372e57 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:01:19.158379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a0993-07ee-47b2-9813-2aca7ac8d477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:19.159086 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a0993-07ee-47b2-9813-2aca7ac8d477 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:19.159368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a0993-07ee-47b2-9813-2aca7ac8d477 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:19.159667 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a0993-07ee-47b2-9813-2aca7ac8d477 None admin] PATH_INFO: `/v3/users/47f0db753db74d4eb981cc146bf02b21` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:19.160908 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a0993-07ee-47b2-9813-2aca7ac8d477 None admin] RBAC: Authorizing `identity:get_user(user_id=47f0db753db74d4eb981cc146bf02b21)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:19.163013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a0993-07ee-47b2-9813-2aca7ac8d477 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:19.165118 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 142/291] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:01:18 2022] GET /identity/v3/users/47f0db753db74d4eb981cc146bf02b21 => generated 297 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:19.170521 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2467f-b8fb-40fd-8bd1-673f803c5be5 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:19.232707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:19.318837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2467f-b8fb-40fd-8bd1-673f803c5be5 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:19.358799 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeac3be-25fb-41ef-b1bc-c003d4f19101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:19.359328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeac3be-25fb-41ef-b1bc-c003d4f19101 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:19.359633 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeac3be-25fb-41ef-b1bc-c003d4f19101 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:19.359905 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeac3be-25fb-41ef-b1bc-c003d4f19101 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:19.431585 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeac3be-25fb-41ef-b1bc-c003d4f19101 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:19.433031 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeac3be-25fb-41ef-b1bc-c003d4f19101 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:19.464493 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:19.536470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 150/292] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:01:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:01:19.542131 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a0993-07ee-47b2-9813-2aca7ac8d477 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:19.573464 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:19.677841 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a0993-07ee-47b2-9813-2aca7ac8d477 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:19.713598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81ce1d-8bcc-4ed7-8233-78527bf32e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:19.714235 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81ce1d-8bcc-4ed7-8233-78527bf32e54 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:19.714510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81ce1d-8bcc-4ed7-8233-78527bf32e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:19.714781 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81ce1d-8bcc-4ed7-8233-78527bf32e54 None admin] PATH_INFO: `/v3/projects/6f1f0a0a8c824d639602043911e34bb5` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:19.715923 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81ce1d-8bcc-4ed7-8233-78527bf32e54 None admin] RBAC: Authorizing `identity:get_project(project_id=6f1f0a0a8c824d639602043911e34bb5)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:19.717393 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81ce1d-8bcc-4ed7-8233-78527bf32e54 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:19.719089 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 143/293] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:19 2022] GET /identity/v3/projects/6f1f0a0a8c824d639602043911e34bb5 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:19.730460 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeac3be-25fb-41ef-b1bc-c003d4f19101 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:19.852040 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeac3be-25fb-41ef-b1bc-c003d4f19101 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:19.894478 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:19.900513 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e702ee-1e0c-4178-93eb-504a85241930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:19.901131 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e702ee-1e0c-4178-93eb-504a85241930 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:19.901411 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e702ee-1e0c-4178-93eb-504a85241930 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:19.901683 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e702ee-1e0c-4178-93eb-504a85241930 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:19.902417 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e702ee-1e0c-4178-93eb-504a85241930 None admin] RBAC: Adding query filter params (role.id=9aa9b054939e4fc1ad0387e43c500693, scope.project.id=6f1f0a0a8c824d639602043911e34bb5, user.id=47f0db753db74d4eb981cc146bf02b21) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:19.902728 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e702ee-1e0c-4178-93eb-504a85241930 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:19.905069 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e702ee-1e0c-4178-93eb-504a85241930 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:19.911128 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 151/294] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:01:19 2022] GET /identity/v3/role_assignments?user.id=47f0db753db74d4eb981cc146bf02b21&scope.project.id=6f1f0a0a8c824d639602043911e34bb5&role.id=9aa9b054939e4fc1ad0387e43c500693 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:20.055769 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426b041-0779-40e8-a860-327ee3871438 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:20.056109 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426b041-0779-40e8-a860-327ee3871438 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:20.056319 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426b041-0779-40e8-a860-327ee3871438 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:20.057906 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 144/295] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:20.063772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2352ce1-464f-453d-b7ef-ba178de7021a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:20.064082 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2352ce1-464f-453d-b7ef-ba178de7021a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:20.064321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2352ce1-464f-453d-b7ef-ba178de7021a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:20.091144 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b2352ce1-464f-453d-b7ef-ba178de7021a None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:20.092388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b2352ce1-464f-453d-b7ef-ba178de7021a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:20.194277 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 152/296] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:20.488251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a12d14-ee71-4ad0-b106-09984adf895d None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:20.488610 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a12d14-ee71-4ad0-b106-09984adf895d None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:20.488714 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2352ce1-464f-453d-b7ef-ba178de7021a None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:20.489023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a12d14-ee71-4ad0-b106-09984adf895d None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:20.490525 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 145/297] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:20.497859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b13824-3131-4231-b209-2d250a916151 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:20.498012 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b13824-3131-4231-b209-2d250a916151 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:20.498235 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b13824-3131-4231-b209-2d250a916151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:20.520341 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-09b13824-3131-4231-b209-2d250a916151 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:20.522046 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-09b13824-3131-4231-b209-2d250a916151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:20.602594 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2352ce1-464f-453d-b7ef-ba178de7021a None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:20.608032 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 146/298] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:01:20.636337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:20.646152 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9928d8-a48e-4f79-b3ff-a94fbcad623d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:20.647107 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9928d8-a48e-4f79-b3ff-a94fbcad623d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:20.647676 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9928d8-a48e-4f79-b3ff-a94fbcad623d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:20.648205 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9928d8-a48e-4f79-b3ff-a94fbcad623d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:20.659118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9928d8-a48e-4f79-b3ff-a94fbcad623d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:20.664853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-ec9928d8-a48e-4f79-b3ff-a94fbcad623d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:01:20.664853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:20.664853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:20.664853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:20.664853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:20.664853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:20.664853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:20.664853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:20.664853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:20.664853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:20.664853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:20.664853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:20.664853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:20.664853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:20.664853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:20.664853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:20.665779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:20.665779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:20.665779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:20.665779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:20.665779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:20.665779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:20.665779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:20.665779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:20.665779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:20.665779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:20.665779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:20.665779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:20.665779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:20.665779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:20.665779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:20.665779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:20.666597 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:20.666597 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:20.666597 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:20.666597 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:20.666597 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:20.666597 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:20.666597 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:20.666597 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:20.666597 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:20.666597 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:20.666597 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:01:20.666597 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:20.667214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 153/299] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:01:20.669895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6abc1b-2e48-44b6-ad36-27375d64a1a8 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:20.670399 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6abc1b-2e48-44b6-ad36-27375d64a1a8 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:20.670871 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6abc1b-2e48-44b6-ad36-27375d64a1a8 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:20.672987 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9928d8-a48e-4f79-b3ff-a94fbcad623d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:20.673203 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 147/300] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:20.679763 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bfb22-89b0-4f48-bb31-e7339b79d266 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:20.680283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bfb22-89b0-4f48-bb31-e7339b79d266 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:20.680781 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bfb22-89b0-4f48-bb31-e7339b79d266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:20.707610 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-af2bfb22-89b0-4f48-bb31-e7339b79d266 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:20.709728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-af2bfb22-89b0-4f48-bb31-e7339b79d266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:20.739896 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:20.793931 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9928d8-a48e-4f79-b3ff-a94fbcad623d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:20.811576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 148/301] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:20.838563 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8d8b8-d22f-486d-9a27-96f22c180a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:20.839547 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8d8b8-d22f-486d-9a27-96f22c180a07 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:20.840039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8d8b8-d22f-486d-9a27-96f22c180a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:20.840504 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8d8b8-d22f-486d-9a27-96f22c180a07 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:20.841353 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8d8b8-d22f-486d-9a27-96f22c180a07 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:20.841847 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8d8b8-d22f-486d-9a27-96f22c180a07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:20.843493 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8d8b8-d22f-486d-9a27-96f22c180a07 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:20.852076 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 154/302] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:01:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:20.858359 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2bfb22-89b0-4f48-bb31-e7339b79d266 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:20.899485 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8d8b8-d22f-486d-9a27-96f22c180a07 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:20.956517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:20.985366 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2bfb22-89b0-4f48-bb31-e7339b79d266 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:21.017737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8d8b8-d22f-486d-9a27-96f22c180a07 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:21.024888 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e68fd-974d-449e-87a8-1cdbe6568448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:21.025791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e68fd-974d-449e-87a8-1cdbe6568448 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:21.026231 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e68fd-974d-449e-87a8-1cdbe6568448 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:21.026644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e68fd-974d-449e-87a8-1cdbe6568448 None admin] PATH_INFO: `/v3/users/9211cb9be9824e06bac9f365ec3a80a1` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:21.041052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e68fd-974d-449e-87a8-1cdbe6568448 None admin] RBAC: Authorizing `identity:get_user(user_id=9211cb9be9824e06bac9f365ec3a80a1)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:21.042822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e68fd-974d-449e-87a8-1cdbe6568448 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:21.044715 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 149/303] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:01:20 2022] GET /identity/v3/users/9211cb9be9824e06bac9f365ec3a80a1 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:21.055485 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e68fd-974d-449e-87a8-1cdbe6568448 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:21.055718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2736e7-8765-461c-8325-c7076561c0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:21.056276 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2736e7-8765-461c-8325-c7076561c0fe None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:21.056677 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2736e7-8765-461c-8325-c7076561c0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:21.056939 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2736e7-8765-461c-8325-c7076561c0fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:21.058068 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2736e7-8765-461c-8325-c7076561c0fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:21.059510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2736e7-8765-461c-8325-c7076561c0fe None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:21.061423 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 155/304] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:21.066606 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2736e7-8765-461c-8325-c7076561c0fe None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:21.069532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:21.171051 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e68fd-974d-449e-87a8-1cdbe6568448 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:21.185215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2736e7-8765-461c-8325-c7076561c0fe None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:21.204594 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:21.210620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd257bc-e188-4901-a396-6fecf300da95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:21.211425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd257bc-e188-4901-a396-6fecf300da95 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:21.211734 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd257bc-e188-4901-a396-6fecf300da95 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:21.212006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd257bc-e188-4901-a396-6fecf300da95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:21.212738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd257bc-e188-4901-a396-6fecf300da95 None admin] RBAC: Adding query filter params (role.id=9f66f016692f4bff811f91c9fb372e57, user.id=9211cb9be9824e06bac9f365ec3a80a1, scope.system=all) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:21.213046 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd257bc-e188-4901-a396-6fecf300da95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:21.214472 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd257bc-e188-4901-a396-6fecf300da95 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:21.219750 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 150/305] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Sep 28 12:01:21 2022] GET /identity/v3/role_assignments?user.id=9211cb9be9824e06bac9f365ec3a80a1&scope.system=all&role.id=9f66f016692f4bff811f91c9fb372e57 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:21.220349 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd257bc-e188-4901-a396-6fecf300da95 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:21.232875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845c66a-800a-4eec-82ac-8be1940003e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:21.234451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845c66a-800a-4eec-82ac-8be1940003e5 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:21.234927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845c66a-800a-4eec-82ac-8be1940003e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:21.235851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845c66a-800a-4eec-82ac-8be1940003e5 None admin] PATH_INFO: `/v3/groups` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:21.237033 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845c66a-800a-4eec-82ac-8be1940003e5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:21.239094 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845c66a-800a-4eec-82ac-8be1940003e5 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:21.266222 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 156/306] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Sep 28 12:01:21 2022] POST /identity/v3/groups => generated 229 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:01:21.331960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:21.360254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd257bc-e188-4901-a396-6fecf300da95 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:21.403595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7bfe7-e0f0-4ca1-a7ee-7f5f2d8794d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:21.404566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7bfe7-e0f0-4ca1-a7ee-7f5f2d8794d2 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:21.405053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7bfe7-e0f0-4ca1-a7ee-7f5f2d8794d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:21.405502 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7bfe7-e0f0-4ca1-a7ee-7f5f2d8794d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:21.418777 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af7bfe7-e0f0-4ca1-a7ee-7f5f2d8794d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:21.424368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-9af7bfe7-e0f0-4ca1-a7ee-7f5f2d8794d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:01:21.424368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:21.424368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:21.424368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:21.424368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:21.424368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:21.424368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:21.424368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:21.424368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:21.424368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:21.424368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:21.424368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:21.424368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:21.424368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:21.424368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:21.424368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:21.425338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:21.425338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:21.425338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:21.425338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:21.425338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:21.425338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:21.425338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:21.425338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:21.425338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:21.425338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:21.425338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:21.425338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:21.425338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:21.425338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:21.425338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:21.425338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:21.426145 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:21.426145 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:21.426145 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:21.426145 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:21.426145 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:21.426145 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:21.426145 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:21.426145 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:21.426145 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:21.426145 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:21.426145 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:01:21.426145 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:21.428409 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 151/307] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:21.436635 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845c66a-800a-4eec-82ac-8be1940003e5 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:21.552344 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845c66a-800a-4eec-82ac-8be1940003e5 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:21.588224 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c603622-4fdb-4f0c-8b0a-093461f5d989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:21.588756 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c603622-4fdb-4f0c-8b0a-093461f5d989 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:21.589038 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c603622-4fdb-4f0c-8b0a-093461f5d989 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:21.589308 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c603622-4fdb-4f0c-8b0a-093461f5d989 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:21.589977 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c603622-4fdb-4f0c-8b0a-093461f5d989 None admin] RBAC: Adding query filter params (name=member) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:21.590281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c603622-4fdb-4f0c-8b0a-093461f5d989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:21.591700 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c603622-4fdb-4f0c-8b0a-093461f5d989 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:21.600824 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 157/308] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:01:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:21.606438 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7bfe7-e0f0-4ca1-a7ee-7f5f2d8794d2 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:21.719657 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7bfe7-e0f0-4ca1-a7ee-7f5f2d8794d2 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:21.756499 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a4289-ea2e-4b79-8be6-3647068e3df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:21.757131 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a4289-ea2e-4b79-8be6-3647068e3df1 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:21.757407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a4289-ea2e-4b79-8be6-3647068e3df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:21.757679 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a4289-ea2e-4b79-8be6-3647068e3df1 None admin] PATH_INFO: `/v3/users/74964152309a43b3948730bb9dec241c` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:21.758825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a4289-ea2e-4b79-8be6-3647068e3df1 None admin] RBAC: Authorizing `identity:get_user(user_id=74964152309a43b3948730bb9dec241c)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:21.760304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a4289-ea2e-4b79-8be6-3647068e3df1 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:21.762264 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 152/309] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:01:21 2022] GET /identity/v3/users/74964152309a43b3948730bb9dec241c => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:21.767638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c603622-4fdb-4f0c-8b0a-093461f5d989 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:21.790032 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4486f-4eca-4d72-bd8a-aedefd045c36 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:21.790329 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4486f-4eca-4d72-bd8a-aedefd045c36 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:21.790570 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4486f-4eca-4d72-bd8a-aedefd045c36 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:21.791946 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 153/310] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:01:21.797451 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60a68a-015b-461a-875c-6978e76234fa None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:21.797731 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60a68a-015b-461a-875c-6978e76234fa None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:21.798002 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60a68a-015b-461a-875c-6978e76234fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:21.813233 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:21.819820 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:21.824357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-3c60a68a-015b-461a-875c-6978e76234fa None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:21.826344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-3c60a68a-015b-461a-875c-6978e76234fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:21.877589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c603622-4fdb-4f0c-8b0a-093461f5d989 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:21.907968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 154/311] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:01:21.913490 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25313833-a6de-4c00-b2dc-2cee9e86ac85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:21.914247 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25313833-a6de-4c00-b2dc-2cee9e86ac85 None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:21.914595 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25313833-a6de-4c00-b2dc-2cee9e86ac85 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:21.914938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25313833-a6de-4c00-b2dc-2cee9e86ac85 None admin] PATH_INFO: `/v3/system/users/74964152309a43b3948730bb9dec241c/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:21.916516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25313833-a6de-4c00-b2dc-2cee9e86ac85 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=74964152309a43b3948730bb9dec241c, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:21.918041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25313833-a6de-4c00-b2dc-2cee9e86ac85 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:21.930069 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 158/312] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Sep 28 12:01:21 2022] PUT /identity/v3/system/users/74964152309a43b3948730bb9dec241c/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:01:22.176389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60a68a-015b-461a-875c-6978e76234fa None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:22.282995 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60a68a-015b-461a-875c-6978e76234fa None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:22.322448 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0255ac1-7ccd-4ac9-9547-aeaa78587bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:22.323473 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0255ac1-7ccd-4ac9-9547-aeaa78587bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:22.325957 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0255ac1-7ccd-4ac9-9547-aeaa78587bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:22.325957 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0255ac1-7ccd-4ac9-9547-aeaa78587bd1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:22.327364 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:22.337320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0255ac1-7ccd-4ac9-9547-aeaa78587bd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:22.342293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-b0255ac1-7ccd-4ac9-9547-aeaa78587bd1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:01:22.342293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:22.342293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:22.342293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:22.342293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:22.342293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:22.342293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:22.342293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:22.342293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:22.342293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:22.342293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:22.342293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:22.342293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:22.342293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:22.342293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:22.342293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:22.343360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:22.343360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:22.343360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:22.343360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:22.343360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:22.343360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:22.343360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:22.343360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:22.343360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:22.343360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:22.343360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:22.343360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:22.343360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:22.343360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:22.343360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:22.343360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:22.344385 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:22.344385 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:22.344385 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:22.344385 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:22.344385 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:22.344385 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:22.344385 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:22.344385 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:22.344385 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:22.344385 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:22.344385 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:01:22.344385 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:22.346596 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 155/313] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:22.359482 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25313833-a6de-4c00-b2dc-2cee9e86ac85 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:22.463903 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25313833-a6de-4c00-b2dc-2cee9e86ac85 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:22.465738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:22.500775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f65e15-c3b1-4f7a-896c-6a2a08bc00be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:22.501762 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f65e15-c3b1-4f7a-896c-6a2a08bc00be None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:22.502236 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f65e15-c3b1-4f7a-896c-6a2a08bc00be None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:22.502700 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f65e15-c3b1-4f7a-896c-6a2a08bc00be None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:22.503588 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f65e15-c3b1-4f7a-896c-6a2a08bc00be None admin] RBAC: Adding query filter params (name=reader) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:22.504086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f65e15-c3b1-4f7a-896c-6a2a08bc00be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:22.506317 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f65e15-c3b1-4f7a-896c-6a2a08bc00be None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:22.515760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 159/314] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:01:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:22.521603 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0255ac1-7ccd-4ac9-9547-aeaa78587bd1 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:22.630717 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0255ac1-7ccd-4ac9-9547-aeaa78587bd1 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:22.666126 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b694567-f5c4-4366-ae78-d4821f76684b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:22.666761 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b694567-f5c4-4366-ae78-d4821f76684b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:22.667037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b694567-f5c4-4366-ae78-d4821f76684b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:22.667307 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b694567-f5c4-4366-ae78-d4821f76684b None admin] PATH_INFO: `/v3/users/c127df7080204a2dbfb3b1b4fda7be88` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:22.668479 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b694567-f5c4-4366-ae78-d4821f76684b None admin] RBAC: Authorizing `identity:get_user(user_id=c127df7080204a2dbfb3b1b4fda7be88)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:22.669923 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b694567-f5c4-4366-ae78-d4821f76684b None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:22.671881 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 156/315] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:01:22 2022] GET /identity/v3/users/c127df7080204a2dbfb3b1b4fda7be88 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:22.677689 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f65e15-c3b1-4f7a-896c-6a2a08bc00be None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:22.786482 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f65e15-c3b1-4f7a-896c-6a2a08bc00be None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:22.825259 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc0e9d-1109-46b7-8d5d-ab65ee32e83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:22.826274 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc0e9d-1109-46b7-8d5d-ab65ee32e83a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:22.826751 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc0e9d-1109-46b7-8d5d-ab65ee32e83a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:22.827287 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc0e9d-1109-46b7-8d5d-ab65ee32e83a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:22.865809 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:22.902970 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc0e9d-1109-46b7-8d5d-ab65ee32e83a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:22.905331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc0e9d-1109-46b7-8d5d-ab65ee32e83a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:23.011107 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 160/316] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:01:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:01:23.017186 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b694567-f5c4-4366-ae78-d4821f76684b None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:23.083317 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:23.129531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b694567-f5c4-4366-ae78-d4821f76684b None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:23.167002 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e99ea-1a80-4e87-b5f9-116aff440d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:23.167884 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e99ea-1a80-4e87-b5f9-116aff440d25 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:23.168270 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e99ea-1a80-4e87-b5f9-116aff440d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:23.168587 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e99ea-1a80-4e87-b5f9-116aff440d25 None admin] PATH_INFO: `/v3/projects/6f1f0a0a8c824d639602043911e34bb5` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:23.170022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e99ea-1a80-4e87-b5f9-116aff440d25 None admin] RBAC: Authorizing `identity:get_project(project_id=6f1f0a0a8c824d639602043911e34bb5)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:23.172138 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e99ea-1a80-4e87-b5f9-116aff440d25 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:23.174784 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 157/317] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:23 2022] GET /identity/v3/projects/6f1f0a0a8c824d639602043911e34bb5 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:23.181158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc0e9d-1109-46b7-8d5d-ab65ee32e83a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:23.247168 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:23.287905 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc0e9d-1109-46b7-8d5d-ab65ee32e83a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:23.324148 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbd348-8445-414e-8861-26692b060132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:23.324744 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbd348-8445-414e-8861-26692b060132 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:23.325044 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbd348-8445-414e-8861-26692b060132 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:23.325318 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbd348-8445-414e-8861-26692b060132 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:23.326113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbd348-8445-414e-8861-26692b060132 None admin] RBAC: Adding query filter params (role.id=9f66f016692f4bff811f91c9fb372e57, scope.project.id=6f1f0a0a8c824d639602043911e34bb5, user.id=c127df7080204a2dbfb3b1b4fda7be88) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:23.326416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbd348-8445-414e-8861-26692b060132 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:23.328249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbd348-8445-414e-8861-26692b060132 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:23.335758 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 161/318] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:01:23 2022] GET /identity/v3/role_assignments?user.id=c127df7080204a2dbfb3b1b4fda7be88&scope.project.id=6f1f0a0a8c824d639602043911e34bb5&role.id=9f66f016692f4bff811f91c9fb372e57 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:23.490464 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0b360-9e97-4da1-b9e5-23610cc23f43 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:23.491378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0b360-9e97-4da1-b9e5-23610cc23f43 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:23.491909 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0b360-9e97-4da1-b9e5-23610cc23f43 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:23.493514 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 158/319] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:23.499237 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb4d4d-a1e4-41bd-a1dc-434916778562 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:23.499886 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb4d4d-a1e4-41bd-a1dc-434916778562 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:23.500353 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb4d4d-a1e4-41bd-a1dc-434916778562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:23.520641 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-eabb4d4d-a1e4-41bd-a1dc-434916778562 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:23.521858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-eabb4d4d-a1e4-41bd-a1dc-434916778562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:23.599657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 162/320] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:23.655490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f553328-48e3-4a7f-ad58-7cb1892d26dd None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:23.655789 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f553328-48e3-4a7f-ad58-7cb1892d26dd None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:23.656044 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f553328-48e3-4a7f-ad58-7cb1892d26dd None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:23.657683 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 159/321] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:23.662887 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c24c47-af62-4828-9149-5f89ab96f136 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:23.663184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c24c47-af62-4828-9149-5f89ab96f136 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:23.663485 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c24c47-af62-4828-9149-5f89ab96f136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:23.681866 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-36c24c47-af62-4828-9149-5f89ab96f136 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:23.683058 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-36c24c47-af62-4828-9149-5f89ab96f136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:23.743630 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:23.761208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 163/322] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:23.868088 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f553328-48e3-4a7f-ad58-7cb1892d26dd None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:23.974419 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f553328-48e3-4a7f-ad58-7cb1892d26dd None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:24.004682 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:24.011822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01fab4-5202-4bf5-8a1f-3d2fb3890eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:24.012979 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01fab4-5202-4bf5-8a1f-3d2fb3890eab None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:24.013733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01fab4-5202-4bf5-8a1f-3d2fb3890eab None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:24.014011 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01fab4-5202-4bf5-8a1f-3d2fb3890eab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:24.026398 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f01fab4-5202-4bf5-8a1f-3d2fb3890eab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:24.031712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-2f01fab4-5202-4bf5-8a1f-3d2fb3890eab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:01:24.031712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:24.031712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:24.031712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:24.031712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:24.031712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:24.031712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:24.031712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:24.031712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:24.031712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:24.031712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:24.031712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:24.031712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:24.031712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:24.031712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:24.031712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:24.032685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:24.032685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:24.032685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:24.032685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:24.032685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:24.032685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:24.032685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:24.032685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:24.032685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:24.032685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:24.032685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:24.032685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:24.032685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:24.032685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:24.032685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:24.032685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:24.036226 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:24.036226 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:24.036226 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:24.036226 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:24.036226 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:24.036226 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:24.036226 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:24.036226 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:24.036226 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:24.036226 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:24.036226 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:01:24.036226 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:24.036226 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 160/323] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:24.038496 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c24c47-af62-4828-9149-5f89ab96f136 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:24.038941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01fab4-5202-4bf5-8a1f-3d2fb3890eab None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:24.145410 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c24c47-af62-4828-9149-5f89ab96f136 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:24.153633 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01fab4-5202-4bf5-8a1f-3d2fb3890eab None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:24.179164 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673c5ba-5448-4936-87bc-01abee86d30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:24.179821 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673c5ba-5448-4936-87bc-01abee86d30b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:24.180101 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673c5ba-5448-4936-87bc-01abee86d30b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:24.180372 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673c5ba-5448-4936-87bc-01abee86d30b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:24.181462 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673c5ba-5448-4936-87bc-01abee86d30b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:24.182893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673c5ba-5448-4936-87bc-01abee86d30b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:24.184489 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 164/324] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:24.185592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53844ab0-6172-4db4-b3fe-d8d360c9d125 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:24.185871 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53844ab0-6172-4db4-b3fe-d8d360c9d125 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:24.186141 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53844ab0-6172-4db4-b3fe-d8d360c9d125 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:24.187329 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 165/325] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:24.187924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171b331-fdd4-4dd2-8fad-cf6d6aa0b3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:24.188526 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171b331-fdd4-4dd2-8fad-cf6d6aa0b3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:24.189051 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171b331-fdd4-4dd2-8fad-cf6d6aa0b3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:24.189051 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171b331-fdd4-4dd2-8fad-cf6d6aa0b3b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:24.189750 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171b331-fdd4-4dd2-8fad-cf6d6aa0b3b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:24.189998 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53844ab0-6172-4db4-b3fe-d8d360c9d125 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:24.190095 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171b331-fdd4-4dd2-8fad-cf6d6aa0b3b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:24.191389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171b331-fdd4-4dd2-8fad-cf6d6aa0b3b2 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:24.200452 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 161/326] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:01:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:24.203185 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c11d3-8ad7-4248-9455-e1566a2fa9d4 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:24.203494 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c11d3-8ad7-4248-9455-e1566a2fa9d4 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:24.203913 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c11d3-8ad7-4248-9455-e1566a2fa9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:24.221199 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-ef5c11d3-8ad7-4248-9455-e1566a2fa9d4 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:24.222387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-ef5c11d3-8ad7-4248-9455-e1566a2fa9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:24.249950 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:24.272608 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:24.290585 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 162/327] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:24.291399 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c11d3-8ad7-4248-9455-e1566a2fa9d4 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:24.305599 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53844ab0-6172-4db4-b3fe-d8d360c9d125 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:24.346276 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bde5bd-9992-4331-9439-32b0201b0ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:24.347117 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bde5bd-9992-4331-9439-32b0201b0ab3 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:24.347568 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bde5bd-9992-4331-9439-32b0201b0ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:24.347981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bde5bd-9992-4331-9439-32b0201b0ab3 None admin] PATH_INFO: `/v3/groups` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:24.349308 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bde5bd-9992-4331-9439-32b0201b0ab3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:24.350869 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bde5bd-9992-4331-9439-32b0201b0ab3 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:24.367774 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 166/328] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Sep 28 12:01:24 2022] POST /identity/v3/groups => generated 226 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:01:24.410817 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c11d3-8ad7-4248-9455-e1566a2fa9d4 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:24.449839 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6ad00-40c7-4184-a2c6-ff4ff2eca635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:24.450490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6ad00-40c7-4184-a2c6-ff4ff2eca635 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:24.450772 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6ad00-40c7-4184-a2c6-ff4ff2eca635 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:24.451102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6ad00-40c7-4184-a2c6-ff4ff2eca635 None admin] PATH_INFO: `/v3/users/9211cb9be9824e06bac9f365ec3a80a1` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:24.452327 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6ad00-40c7-4184-a2c6-ff4ff2eca635 None admin] RBAC: Authorizing `identity:get_user(user_id=9211cb9be9824e06bac9f365ec3a80a1)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:24.453787 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6ad00-40c7-4184-a2c6-ff4ff2eca635 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:24.455451 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 163/329] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:01:24 2022] GET /identity/v3/users/9211cb9be9824e06bac9f365ec3a80a1 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:24.461673 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bde5bd-9992-4331-9439-32b0201b0ab3 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:24.559555 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6ad00-40c7-4184-a2c6-ff4ff2eca635 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:24.569882 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bde5bd-9992-4331-9439-32b0201b0ab3 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:24.586582 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:24.608731 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db333d66-763d-4dc7-983b-ad139cb56bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:24.609387 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db333d66-763d-4dc7-983b-ad139cb56bbd None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:24.609662 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db333d66-763d-4dc7-983b-ad139cb56bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:24.609935 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db333d66-763d-4dc7-983b-ad139cb56bbd None admin] PATH_INFO: `/v3/system/users/9211cb9be9824e06bac9f365ec3a80a1/roles/9f66f016692f4bff811f91c9fb372e57` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:24.611354 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db333d66-763d-4dc7-983b-ad139cb56bbd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9211cb9be9824e06bac9f365ec3a80a1, role_id=9f66f016692f4bff811f91c9fb372e57)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:24.613248 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db333d66-763d-4dc7-983b-ad139cb56bbd None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:24.624312 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 167/330] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Sep 28 12:01:24 2022] PUT /identity/v3/system/users/9211cb9be9824e06bac9f365ec3a80a1/roles/9f66f016692f4bff811f91c9fb372e57 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:01:24.632205 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:24.692490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6ad00-40c7-4184-a2c6-ff4ff2eca635 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:24.748428 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3974be4-79f9-4f45-92cb-4b70d79145ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:24.749084 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3974be4-79f9-4f45-92cb-4b70d79145ec None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:24.749359 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3974be4-79f9-4f45-92cb-4b70d79145ec None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:24.749628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3974be4-79f9-4f45-92cb-4b70d79145ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:24.763220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3974be4-79f9-4f45-92cb-4b70d79145ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:24.768403 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-f3974be4-79f9-4f45-92cb-4b70d79145ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:01:24.768403 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:24.768403 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:24.768403 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:24.768403 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:24.768403 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:24.768403 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:24.768403 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:24.768403 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:24.768403 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:24.768403 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:24.768403 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:24.768403 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:24.768403 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:24.768403 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:24.768403 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:24.769368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:24.769368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:24.769368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:24.769368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:24.769368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:24.769368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:24.769368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:24.769368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:24.769368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:24.769368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:24.769368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:24.769368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:24.769368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:24.769368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:24.769368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:24.769368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:24.770671 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:24.770671 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:24.770671 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:24.770671 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:24.770671 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:24.770671 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:24.770671 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:24.770671 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:24.770671 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:24.770671 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:24.770671 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:01:24.770671 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:24.770671 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 164/331] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:01:24.776069 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db333d66-763d-4dc7-983b-ad139cb56bbd None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:24.884337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db333d66-763d-4dc7-983b-ad139cb56bbd None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:24.925784 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1249dfa-8726-4e6c-96ab-7c6e18dabc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:24.926394 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1249dfa-8726-4e6c-96ab-7c6e18dabc16 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:24.926733 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1249dfa-8726-4e6c-96ab-7c6e18dabc16 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:24.927008 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1249dfa-8726-4e6c-96ab-7c6e18dabc16 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:24.927746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1249dfa-8726-4e6c-96ab-7c6e18dabc16 None admin] RBAC: Adding query filter params (name=member) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:24.928050 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1249dfa-8726-4e6c-96ab-7c6e18dabc16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:24.929446 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1249dfa-8726-4e6c-96ab-7c6e18dabc16 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:24.939474 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 168/332] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:01:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:24.945371 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3974be4-79f9-4f45-92cb-4b70d79145ec None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:25.064584 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3974be4-79f9-4f45-92cb-4b70d79145ec None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:25.080356 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:25.103627 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02ab42-ee6e-4bb6-81eb-56d2bf6b4bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:25.104255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02ab42-ee6e-4bb6-81eb-56d2bf6b4bdf None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:25.104532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02ab42-ee6e-4bb6-81eb-56d2bf6b4bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:25.104798 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02ab42-ee6e-4bb6-81eb-56d2bf6b4bdf None admin] PATH_INFO: `/v3/users/74964152309a43b3948730bb9dec241c` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:25.105935 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02ab42-ee6e-4bb6-81eb-56d2bf6b4bdf None admin] RBAC: Authorizing `identity:get_user(user_id=74964152309a43b3948730bb9dec241c)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:25.107382 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02ab42-ee6e-4bb6-81eb-56d2bf6b4bdf None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:25.109281 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 165/333] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:01:24 2022] GET /identity/v3/users/74964152309a43b3948730bb9dec241c => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:25.115197 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1249dfa-8726-4e6c-96ab-7c6e18dabc16 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:25.167260 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:25.238200 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1249dfa-8726-4e6c-96ab-7c6e18dabc16 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:25.279287 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221c12e-1990-431d-9b5b-4d93f2db34ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:25.279985 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221c12e-1990-431d-9b5b-4d93f2db34ed None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:25.280258 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221c12e-1990-431d-9b5b-4d93f2db34ed None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:25.280526 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221c12e-1990-431d-9b5b-4d93f2db34ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:25.281255 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221c12e-1990-431d-9b5b-4d93f2db34ed None admin] RBAC: Adding query filter params (role.id=9aa9b054939e4fc1ad0387e43c500693, user.id=74964152309a43b3948730bb9dec241c, scope.system=all) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:25.281558 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221c12e-1990-431d-9b5b-4d93f2db34ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:25.282989 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221c12e-1990-431d-9b5b-4d93f2db34ed None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:25.297609 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 169/334] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Sep 28 12:01:25 2022] GET /identity/v3/role_assignments?user.id=74964152309a43b3948730bb9dec241c&scope.system=all&role.id=9aa9b054939e4fc1ad0387e43c500693 => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:26.765752 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9173f-88b3-41e0-ba67-be7788d98483 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:26.766276 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9173f-88b3-41e0-ba67-be7788d98483 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:26.766276 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9173f-88b3-41e0-ba67-be7788d98483 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:26.767717 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 166/335] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:26.774067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdd2f3-40c5-4816-8330-0316ed62fb89 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:26.774958 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdd2f3-40c5-4816-8330-0316ed62fb89 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:26.775472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdd2f3-40c5-4816-8330-0316ed62fb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:26.795647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-09cdd2f3-40c5-4816-8330-0316ed62fb89 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:26.797189 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-09cdd2f3-40c5-4816-8330-0316ed62fb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:26.873454 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 170/336] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:27.374844 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9173f-88b3-41e0-ba67-be7788d98483 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:27.416881 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc767440-deb8-4c8d-8e24-2b652fd9dd23 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:27.417504 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc767440-deb8-4c8d-8e24-2b652fd9dd23 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:27.418029 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc767440-deb8-4c8d-8e24-2b652fd9dd23 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:27.419604 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 171/337] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:01:27.427798 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf3cb4-4c53-458f-8121-1462733f4ccf None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:27.428408 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf3cb4-4c53-458f-8121-1462733f4ccf None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:27.428881 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf3cb4-4c53-458f-8121-1462733f4ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:27.461306 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-6ddf3cb4-4c53-458f-8121-1462733f4ccf None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:27.462841 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6ddf3cb4-4c53-458f-8121-1462733f4ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:27.509981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:27.573138 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9173f-88b3-41e0-ba67-be7788d98483 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:27.589889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 172/338] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:01:27.591199 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f47b4e-e6fd-4047-9bcb-4bf8a1e0b447 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:27.591668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f47b4e-e6fd-4047-9bcb-4bf8a1e0b447 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:27.591947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f47b4e-e6fd-4047-9bcb-4bf8a1e0b447 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:27.593615 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 173/339] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:27.609536 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c224f4-9870-4e0e-a807-6ce03d2c144f None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:27.609870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c224f4-9870-4e0e-a807-6ce03d2c144f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:27.610100 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c224f4-9870-4e0e-a807-6ce03d2c144f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:27.621912 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca590e1-0b1e-448f-b3e3-d89394d291c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:27.622546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca590e1-0b1e-448f-b3e3-d89394d291c3 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:27.622820 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca590e1-0b1e-448f-b3e3-d89394d291c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:27.623083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca590e1-0b1e-448f-b3e3-d89394d291c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:27.640789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-09c224f4-9870-4e0e-a807-6ce03d2c144f None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:27.642244 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-09c224f4-9870-4e0e-a807-6ce03d2c144f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:27.645900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca590e1-0b1e-448f-b3e3-d89394d291c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:27.650956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-0ca590e1-0b1e-448f-b3e3-d89394d291c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:01:27.650956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:27.650956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:27.650956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:27.650956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:27.650956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:27.650956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:27.650956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:27.650956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:27.650956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:27.650956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:27.650956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:27.650956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:27.650956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:27.650956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:27.650956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:27.651877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:27.651877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:27.651877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:27.651877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:27.651877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:27.651877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:27.651877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:27.651877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:27.651877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:27.651877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:27.651877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:27.651877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:27.651877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:27.651877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:27.651877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:27.651877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:27.652698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:27.652698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:27.652698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:27.652698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:27.652698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:27.652698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:27.652698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:27.652698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:27.652698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:27.652698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:27.652698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:01:27.652698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:27.652698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 167/340] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:27.658214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca590e1-0b1e-448f-b3e3-d89394d291c3 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:27.741243 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 174/341] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:01:27.744291 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:27.830187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca590e1-0b1e-448f-b3e3-d89394d291c3 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:27.879036 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0025a-610d-4aa9-bd72-a6abb88a1323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:27.879742 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0025a-610d-4aa9-bd72-a6abb88a1323 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:27.880020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0025a-610d-4aa9-bd72-a6abb88a1323 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:27.880363 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0025a-610d-4aa9-bd72-a6abb88a1323 None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:27.880968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0025a-610d-4aa9-bd72-a6abb88a1323 None admin] RBAC: Adding query filter params (name=member) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:27.881269 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0025a-610d-4aa9-bd72-a6abb88a1323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:27.882864 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0025a-610d-4aa9-bd72-a6abb88a1323 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:27.893026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 168/342] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:01:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:27.899366 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c224f4-9870-4e0e-a807-6ce03d2c144f None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:28.031802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:28.044575 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c224f4-9870-4e0e-a807-6ce03d2c144f None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:28.085760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b7fb3-d8fd-4ca4-b573-da1b0a698b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:28.086378 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b7fb3-d8fd-4ca4-b573-da1b0a698b2d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:28.086662 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b7fb3-d8fd-4ca4-b573-da1b0a698b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:28.087030 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b7fb3-d8fd-4ca4-b573-da1b0a698b2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:28.142585 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691cb32-7da4-4753-a7e5-a98e241d8d4a None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:28.142887 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691cb32-7da4-4753-a7e5-a98e241d8d4a None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:28.143194 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691cb32-7da4-4753-a7e5-a98e241d8d4a None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:28.144930 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 169/343] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:01:28.151000 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b50572-337e-4000-ac7b-57e1d4cb118c None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:28.151284 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b50572-337e-4000-ac7b-57e1d4cb118c None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:28.151608 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b50572-337e-4000-ac7b-57e1d4cb118c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:28.192029 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-a7b50572-337e-4000-ac7b-57e1d4cb118c None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:28.194048 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-a7b50572-337e-4000-ac7b-57e1d4cb118c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:28.204882 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b7fb3-d8fd-4ca4-b573-da1b0a698b2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:28.206360 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b7fb3-d8fd-4ca4-b573-da1b0a698b2d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:28.308344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 170/344] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:01:28.312346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b50572-337e-4000-ac7b-57e1d4cb118c None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:28.349136 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:28.366211 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 175/345] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:01:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:01:28.366885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b7fb3-d8fd-4ca4-b573-da1b0a698b2d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:28.381598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:28.504854 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b50572-337e-4000-ac7b-57e1d4cb118c None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:28.558125 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b7fb3-d8fd-4ca4-b573-da1b0a698b2d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:28.576718 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88630347-7f00-4375-a47d-fa8eb277fd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:28.577654 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88630347-7f00-4375-a47d-fa8eb277fd6d None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:28.578022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88630347-7f00-4375-a47d-fa8eb277fd6d None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:28.578268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88630347-7f00-4375-a47d-fa8eb277fd6d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:28.603942 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88630347-7f00-4375-a47d-fa8eb277fd6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:28.609833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-88630347-7f00-4375-a47d-fa8eb277fd6d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:01:28.609833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:28.609833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:28.609833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:28.609833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:28.609833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:28.609833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:28.609833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:28.609833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:28.609833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:28.609833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:28.609833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:28.609833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:28.609833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:28.609833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:28.609833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:28.610705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:28.610705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:28.610705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:28.610705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:28.610705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:28.610705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:28.610705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:28.610705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:28.610705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:28.610705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:28.610705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:28.610705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:28.610705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:28.610705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:28.610705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:28.610705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:28.611539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:28.611539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:28.611539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:28.611539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:28.611539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:28.611539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:28.611539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:28.611539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:28.611539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:28.611539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:28.611539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:01:28.611539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:28.611539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 171/346] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 28 12:01:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:28.612203 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88630347-7f00-4375-a47d-fa8eb277fd6d None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:28.630467 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c10696-83e1-4175-a2cb-50f08834f955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:28.631108 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c10696-83e1-4175-a2cb-50f08834f955 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:28.631378 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c10696-83e1-4175-a2cb-50f08834f955 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:28.631666 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c10696-83e1-4175-a2cb-50f08834f955 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:28.653098 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c10696-83e1-4175-a2cb-50f08834f955 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:28.658160 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-a7c10696-83e1-4175-a2cb-50f08834f955 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:01:28.658160 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:28.658160 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:28.658160 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:28.658160 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:28.658160 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:28.658160 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:28.658160 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:28.658160 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:28.658160 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:28.658160 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:28.658160 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:28.658160 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:28.658160 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:28.658160 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:28.658160 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:28.659156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:28.659156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:28.659156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:28.659156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:28.659156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:28.659156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:28.659156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:28.659156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:28.659156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:28.659156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:28.659156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:28.659156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:28.659156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:28.659156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:28.659156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:28.659156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:28.660009 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:28.660009 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:28.660009 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:28.660009 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:28.660009 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:28.660009 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:28.660009 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:28.660009 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:28.660009 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:28.660009 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:28.660009 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:01:28.660009 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:28.660009 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 176/347] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:28.665938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c10696-83e1-4175-a2cb-50f08834f955 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:28.746458 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:28.773741 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:28.785000 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88630347-7f00-4375-a47d-fa8eb277fd6d None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:28.824090 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c10696-83e1-4175-a2cb-50f08834f955 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:28.829443 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d46e7d-9db6-4457-b610-aab868936783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:28.830339 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d46e7d-9db6-4457-b610-aab868936783 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:28.831171 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d46e7d-9db6-4457-b610-aab868936783 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:28.831606 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d46e7d-9db6-4457-b610-aab868936783 None admin] PATH_INFO: `/v3/projects/0976a5e8d4d942399b8522e367e466ba` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:28.833428 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d46e7d-9db6-4457-b610-aab868936783 None admin] RBAC: Authorizing `identity:get_project(project_id=0976a5e8d4d942399b8522e367e466ba)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:28.835600 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d46e7d-9db6-4457-b610-aab868936783 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:28.837877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 172/348] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:28 2022] GET /identity/v3/projects/0976a5e8d4d942399b8522e367e466ba => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:28.839208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d46e7d-9db6-4457-b610-aab868936783 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:28.882564 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9ade8-f571-42e2-a08a-e6a20973c8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:28.883335 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9ade8-f571-42e2-a08a-e6a20973c8f4 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:28.883699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9ade8-f571-42e2-a08a-e6a20973c8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:28.884007 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9ade8-f571-42e2-a08a-e6a20973c8f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:28.884928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9ade8-f571-42e2-a08a-e6a20973c8f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:28.885289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9ade8-f571-42e2-a08a-e6a20973c8f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:28.887093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9ade8-f571-42e2-a08a-e6a20973c8f4 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:28.903080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 177/349] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:01:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:28.904257 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9ade8-f571-42e2-a08a-e6a20973c8f4 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:28.996115 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d46e7d-9db6-4457-b610-aab868936783 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:29.041467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61090b82-cb05-454e-841d-365ea94e5f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:29.042425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61090b82-cb05-454e-841d-365ea94e5f23 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:29.042913 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61090b82-cb05-454e-841d-365ea94e5f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:29.043374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61090b82-cb05-454e-841d-365ea94e5f23 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:29.057984 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9ade8-f571-42e2-a08a-e6a20973c8f4 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:29.058353 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61090b82-cb05-454e-841d-365ea94e5f23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:29.064826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-61090b82-cb05-454e-841d-365ea94e5f23 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:01:29.064826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:29.064826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:29.064826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:29.064826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:29.064826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:29.064826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:29.064826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:29.064826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:29.064826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:29.064826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:29.064826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:29.064826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:29.064826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:29.064826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:29.064826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:29.065732 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:29.065732 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:29.065732 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:29.065732 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:29.065732 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:29.065732 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:29.065732 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:29.065732 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:29.065732 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:29.065732 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:29.065732 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:29.065732 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:29.065732 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:29.065732 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:29.065732 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:29.065732 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:29.066530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:29.066530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:29.066530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:29.066530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:29.066530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:29.066530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:29.066530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:29.066530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:29.066530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:29.066530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:29.066530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:01:29.066530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:29.071382 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 173/350] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:29.074074 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61090b82-cb05-454e-841d-365ea94e5f23 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:29.079542 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:29.107955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4525b4-7191-4d1f-a13a-5acb6dd13346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:29.108572 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:29.109803 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4525b4-7191-4d1f-a13a-5acb6dd13346 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:29.110229 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4525b4-7191-4d1f-a13a-5acb6dd13346 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:29.110638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4525b4-7191-4d1f-a13a-5acb6dd13346 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:29.111466 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4525b4-7191-4d1f-a13a-5acb6dd13346 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:29.111909 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4525b4-7191-4d1f-a13a-5acb6dd13346 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:29.113433 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4525b4-7191-4d1f-a13a-5acb6dd13346 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:29.127280 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 178/351] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:01:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:29.127787 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4525b4-7191-4d1f-a13a-5acb6dd13346 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:29.218183 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61090b82-cb05-454e-841d-365ea94e5f23 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:29.254739 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4525b4-7191-4d1f-a13a-5acb6dd13346 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:29.263664 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4159d-0bf1-4069-ae2b-ed34d9b96a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:29.264821 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4159d-0bf1-4069-ae2b-ed34d9b96a13 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:29.265103 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4159d-0bf1-4069-ae2b-ed34d9b96a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:29.265377 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4159d-0bf1-4069-ae2b-ed34d9b96a13 None admin] PATH_INFO: `/v3/groups/15bc028d41364b2d835602a2066ef030` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:29.273751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4159d-0bf1-4069-ae2b-ed34d9b96a13 None admin] RBAC: Authorizing `identity:get_group(group_id=15bc028d41364b2d835602a2066ef030)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:29.275748 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4159d-0bf1-4069-ae2b-ed34d9b96a13 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:29.277712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 174/352] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 28 12:01:29 2022] GET /identity/v3/groups/15bc028d41364b2d835602a2066ef030 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:29.278746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4159d-0bf1-4069-ae2b-ed34d9b96a13 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:29.302867 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2002929-0c64-44a2-9166-e70ffc220f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:29.303748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2002929-0c64-44a2-9166-e70ffc220f4f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:29.304089 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2002929-0c64-44a2-9166-e70ffc220f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:29.304415 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2002929-0c64-44a2-9166-e70ffc220f4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:29.376313 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:29.398929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:29.408885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2002929-0c64-44a2-9166-e70ffc220f4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:29.410566 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2002929-0c64-44a2-9166-e70ffc220f4f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:29.422264 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4159d-0bf1-4069-ae2b-ed34d9b96a13 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:29.469228 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba0e21-fe50-4967-ac7a-2599e5c3e004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:29.470083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba0e21-fe50-4967-ac7a-2599e5c3e004 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:29.470504 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba0e21-fe50-4967-ac7a-2599e5c3e004 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:29.470930 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba0e21-fe50-4967-ac7a-2599e5c3e004 None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:29.471647 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba0e21-fe50-4967-ac7a-2599e5c3e004 None admin] RBAC: Adding query filter params (name=member) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:29.471954 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba0e21-fe50-4967-ac7a-2599e5c3e004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:29.475369 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba0e21-fe50-4967-ac7a-2599e5c3e004 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:29.485019 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 175/353] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:01:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:29.486086 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd02426-ad85-47a0-875a-fab296ce6117 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:29.486372 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd02426-ad85-47a0-875a-fab296ce6117 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:29.486717 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd02426-ad85-47a0-875a-fab296ce6117 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:29.489762 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 176/354] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:29.490343 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd02426-ad85-47a0-875a-fab296ce6117 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:29.552458 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 179/355] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:01:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:01:29.553373 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2002929-0c64-44a2-9166-e70ffc220f4f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:29.649114 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd02426-ad85-47a0-875a-fab296ce6117 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:29.652565 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:29.685947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2002929-0c64-44a2-9166-e70ffc220f4f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:29.703024 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df19d28-8ae7-4ed9-9dad-bb97ebdf4bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:29.703878 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df19d28-8ae7-4ed9-9dad-bb97ebdf4bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:29.704247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df19d28-8ae7-4ed9-9dad-bb97ebdf4bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:29.704647 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df19d28-8ae7-4ed9-9dad-bb97ebdf4bd6 None admin] PATH_INFO: `/v3/users/9211cb9be9824e06bac9f365ec3a80a1` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:29.706012 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df19d28-8ae7-4ed9-9dad-bb97ebdf4bd6 None admin] RBAC: Authorizing `identity:get_user(user_id=9211cb9be9824e06bac9f365ec3a80a1)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:29.708326 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df19d28-8ae7-4ed9-9dad-bb97ebdf4bd6 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:29.714901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 177/356] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:01:29 2022] GET /identity/v3/users/9211cb9be9824e06bac9f365ec3a80a1 => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:29.714901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df19d28-8ae7-4ed9-9dad-bb97ebdf4bd6 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:29.738131 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412d181-7fe7-4ef5-aaad-d144f7782168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:29.738335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:29.738525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412d181-7fe7-4ef5-aaad-d144f7782168 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:29.738823 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412d181-7fe7-4ef5-aaad-d144f7782168 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:29.739125 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412d181-7fe7-4ef5-aaad-d144f7782168 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:29.739905 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c412d181-7fe7-4ef5-aaad-d144f7782168 None admin] RBAC: Adding query filter params (group.id=15bc028d41364b2d835602a2066ef030, role.id=9aa9b054939e4fc1ad0387e43c500693, scope.project.id=0976a5e8d4d942399b8522e367e466ba) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:29.740218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c412d181-7fe7-4ef5-aaad-d144f7782168 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:29.743812 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c412d181-7fe7-4ef5-aaad-d144f7782168 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:29.751082 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 180/357] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 28 12:01:29 2022] GET /identity/v3/role_assignments?group.id=15bc028d41364b2d835602a2066ef030&scope.project.id=0976a5e8d4d942399b8522e367e466ba&role.id=9aa9b054939e4fc1ad0387e43c500693 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:29.752512 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cad268-5be9-4f15-9bcc-9c80f3d7a7e0 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:29.752621 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cad268-5be9-4f15-9bcc-9c80f3d7a7e0 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:29.753517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cad268-5be9-4f15-9bcc-9c80f3d7a7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:29.775536 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-42cad268-5be9-4f15-9bcc-9c80f3d7a7e0 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:29.776782 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-42cad268-5be9-4f15-9bcc-9c80f3d7a7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:29.855879 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df19d28-8ae7-4ed9-9dad-bb97ebdf4bd6 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:29.874536 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 181/358] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:29.875147 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cad268-5be9-4f15-9bcc-9c80f3d7a7e0 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:29.938374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d55fc8-8010-4762-aa59-eac282126f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:29.939125 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d55fc8-8010-4762-aa59-eac282126f01 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:29.939414 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d55fc8-8010-4762-aa59-eac282126f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:29.939742 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d55fc8-8010-4762-aa59-eac282126f01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:29.973827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:30.009617 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cad268-5be9-4f15-9bcc-9c80f3d7a7e0 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:30.043094 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d55fc8-8010-4762-aa59-eac282126f01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:30.045186 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d55fc8-8010-4762-aa59-eac282126f01 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:30.046922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7644b1-3a86-4324-903d-9a09cc1b2d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:30.048021 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7644b1-3a86-4324-903d-9a09cc1b2d89 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:30.048021 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7644b1-3a86-4324-903d-9a09cc1b2d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:30.048299 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7644b1-3a86-4324-903d-9a09cc1b2d89 None admin] PATH_INFO: `/v3/projects/0976a5e8d4d942399b8522e367e466ba` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:30.050354 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7644b1-3a86-4324-903d-9a09cc1b2d89 None admin] RBAC: Authorizing `identity:get_project(project_id=0976a5e8d4d942399b8522e367e466ba)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:30.052984 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7644b1-3a86-4324-903d-9a09cc1b2d89 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:30.054367 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 182/359] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:29 2022] GET /identity/v3/projects/0976a5e8d4d942399b8522e367e466ba => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:30.055164 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7644b1-3a86-4324-903d-9a09cc1b2d89 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:30.076009 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:30.165894 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7644b1-3a86-4324-903d-9a09cc1b2d89 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:30.182681 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 178/360] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:01:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:01:30.186578 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159f3ce-a98d-47d1-81b7-d1897d5ddd23 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:30.186578 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159f3ce-a98d-47d1-81b7-d1897d5ddd23 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:30.186578 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159f3ce-a98d-47d1-81b7-d1897d5ddd23 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:30.186578 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 179/361] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:30.186578 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159f3ce-a98d-47d1-81b7-d1897d5ddd23 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:30.211707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40caaf-fa10-4b4f-8f58-f4957cb90c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:30.212314 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40caaf-fa10-4b4f-8f58-f4957cb90c1a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:30.212592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40caaf-fa10-4b4f-8f58-f4957cb90c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:30.212864 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40caaf-fa10-4b4f-8f58-f4957cb90c1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:30.213591 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40caaf-fa10-4b4f-8f58-f4957cb90c1a None admin] RBAC: Adding query filter params (role.id=9f66f016692f4bff811f91c9fb372e57, user.id=9211cb9be9824e06bac9f365ec3a80a1, scope.system=all) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:30.213899 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40caaf-fa10-4b4f-8f58-f4957cb90c1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:30.215322 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40caaf-fa10-4b4f-8f58-f4957cb90c1a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:30.219023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:30.230491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 183/362] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Sep 28 12:01:30 2022] GET /identity/v3/role_assignments?user.id=9211cb9be9824e06bac9f365ec3a80a1&scope.system=all&role.id=9f66f016692f4bff811f91c9fb372e57 => generated 510 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:30.231510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40caaf-fa10-4b4f-8f58-f4957cb90c1a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:30.326744 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159f3ce-a98d-47d1-81b7-d1897d5ddd23 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:30.345145 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:30.359420 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40caaf-fa10-4b4f-8f58-f4957cb90c1a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:30.378915 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f4a09-2c35-451d-8f3f-ec8e52e2e5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:30.379632 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f4a09-2c35-451d-8f3f-ec8e52e2e5b7 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:30.379918 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f4a09-2c35-451d-8f3f-ec8e52e2e5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:30.380193 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f4a09-2c35-451d-8f3f-ec8e52e2e5b7 None admin] PATH_INFO: `/v3/groups/15bc028d41364b2d835602a2066ef030` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:30.381375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f4a09-2c35-451d-8f3f-ec8e52e2e5b7 None admin] RBAC: Authorizing `identity:get_group(group_id=15bc028d41364b2d835602a2066ef030)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:30.382876 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f4a09-2c35-451d-8f3f-ec8e52e2e5b7 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:30.384736 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 180/363] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 28 12:01:30 2022] GET /identity/v3/groups/15bc028d41364b2d835602a2066ef030 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:30.388050 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f4a09-2c35-451d-8f3f-ec8e52e2e5b7 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:30.416998 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9007179-1732-45b6-a05a-06120f3372eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:30.417626 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9007179-1732-45b6-a05a-06120f3372eb None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:30.417908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9007179-1732-45b6-a05a-06120f3372eb None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:30.418186 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9007179-1732-45b6-a05a-06120f3372eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:30.432929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9007179-1732-45b6-a05a-06120f3372eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:30.440647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-c9007179-1732-45b6-a05a-06120f3372eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:01:30.440647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:30.440647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:30.440647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:30.440647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:30.440647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:30.440647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:30.440647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:30.440647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:30.440647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:30.440647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:30.440647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:30.440647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:30.440647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:30.440647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:30.440647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:30.441668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:30.441668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:30.441668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:30.441668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:30.441668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:30.441668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:30.441668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:30.441668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:30.441668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:30.441668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:30.441668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:30.441668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:30.441668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:30.441668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:30.441668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:30.441668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:30.442578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:30.442578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:30.442578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:30.442578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:30.442578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:30.442578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:30.442578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:30.442578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:30.442578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:30.442578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:30.442578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:01:30.442578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:30.445188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 184/364] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 28 12:01:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:30.446726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4c543-177c-4dcb-8898-dc588bebadff None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:30.447971 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4c543-177c-4dcb-8898-dc588bebadff None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:30.448613 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4c543-177c-4dcb-8898-dc588bebadff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:30.471582 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-6ab4c543-177c-4dcb-8898-dc588bebadff None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:30.473839 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6ab4c543-177c-4dcb-8898-dc588bebadff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:30.523402 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f4a09-2c35-451d-8f3f-ec8e52e2e5b7 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:30.549039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:30.570883 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 185/365] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:30.571618 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6484be-85c6-434e-8a8d-b585e1595ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:30.571770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4c543-177c-4dcb-8898-dc588bebadff None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:30.572685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6484be-85c6-434e-8a8d-b585e1595ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:30.573194 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6484be-85c6-434e-8a8d-b585e1595ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:30.573679 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6484be-85c6-434e-8a8d-b585e1595ec4 None admin] PATH_INFO: `/v3/projects/6f1f0a0a8c824d639602043911e34bb5` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:30.580640 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6484be-85c6-434e-8a8d-b585e1595ec4 None admin] RBAC: Authorizing `identity:get_project(project_id=6f1f0a0a8c824d639602043911e34bb5)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:30.582466 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6484be-85c6-434e-8a8d-b585e1595ec4 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:30.593339 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 181/366] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:30 2022] GET /identity/v3/projects/6f1f0a0a8c824d639602043911e34bb5 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:30.594488 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6484be-85c6-434e-8a8d-b585e1595ec4 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:30.659586 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:30.696128 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4c543-177c-4dcb-8898-dc588bebadff None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:30.738978 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6484be-85c6-434e-8a8d-b585e1595ec4 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:30.741586 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6570d-e08d-4f2e-8d84-a199eab2c2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:30.742403 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6570d-e08d-4f2e-8d84-a199eab2c2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:30.742678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6570d-e08d-4f2e-8d84-a199eab2c2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:30.742946 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6570d-e08d-4f2e-8d84-a199eab2c2f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:30.744004 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6570d-e08d-4f2e-8d84-a199eab2c2f3 None admin] RBAC: Adding query filter params (group.id=15bc028d41364b2d835602a2066ef030, role.id=67ed180941fd45af996b858232628221, scope.project.id=0976a5e8d4d942399b8522e367e466ba) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:30.744315 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6570d-e08d-4f2e-8d84-a199eab2c2f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:30.745810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6570d-e08d-4f2e-8d84-a199eab2c2f3 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:30.752973 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 186/367] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 28 12:01:30 2022] GET /identity/v3/role_assignments?group.id=15bc028d41364b2d835602a2066ef030&scope.project.id=0976a5e8d4d942399b8522e367e466ba&role.id=67ed180941fd45af996b858232628221 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:30.753618 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6570d-e08d-4f2e-8d84-a199eab2c2f3 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:30.813439 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478af885-0718-432d-bac6-1f54321f1676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:30.814456 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478af885-0718-432d-bac6-1f54321f1676 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:30.814943 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478af885-0718-432d-bac6-1f54321f1676 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:30.816114 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478af885-0718-432d-bac6-1f54321f1676 None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:30.818253 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478af885-0718-432d-bac6-1f54321f1676 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:30.820694 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478af885-0718-432d-bac6-1f54321f1676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:30.822386 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478af885-0718-432d-bac6-1f54321f1676 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:30.845739 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 182/368] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:01:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:30.851697 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478af885-0718-432d-bac6-1f54321f1676 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:30.872601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:30.975245 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6570d-e08d-4f2e-8d84-a199eab2c2f3 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:31.022778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc085bd0-452d-45e9-a5a4-5c774d026db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:31.023517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc085bd0-452d-45e9-a5a4-5c774d026db6 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:31.023806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc085bd0-452d-45e9-a5a4-5c774d026db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:31.024076 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc085bd0-452d-45e9-a5a4-5c774d026db6 None admin] PATH_INFO: `/v3/groups/15bc028d41364b2d835602a2066ef030` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:31.025210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc085bd0-452d-45e9-a5a4-5c774d026db6 None admin] RBAC: Authorizing `identity:get_group(group_id=15bc028d41364b2d835602a2066ef030)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:31.026570 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478af885-0718-432d-bac6-1f54321f1676 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:31.027012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc085bd0-452d-45e9-a5a4-5c774d026db6 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:31.028483 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 187/369] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 28 12:01:30 2022] GET /identity/v3/groups/15bc028d41364b2d835602a2066ef030 => generated 226 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:31.030138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc085bd0-452d-45e9-a5a4-5c774d026db6 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:31.048987 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:31.069324 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623c9c4-ce78-411d-b4e1-dd1e0bc0730d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:31.069940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623c9c4-ce78-411d-b4e1-dd1e0bc0730d None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:31.070215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623c9c4-ce78-411d-b4e1-dd1e0bc0730d None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:31.070485 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623c9c4-ce78-411d-b4e1-dd1e0bc0730d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:31.144513 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623c9c4-ce78-411d-b4e1-dd1e0bc0730d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:31.146058 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623c9c4-ce78-411d-b4e1-dd1e0bc0730d None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:31.151201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc085bd0-452d-45e9-a5a4-5c774d026db6 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:31.180751 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:31.195659 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f7275-d387-460a-9855-0832e86c55fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:31.197254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f7275-d387-460a-9855-0832e86c55fb None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:31.197546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f7275-d387-460a-9855-0832e86c55fb None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:31.197967 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f7275-d387-460a-9855-0832e86c55fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:31.212347 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f7275-d387-460a-9855-0832e86c55fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:31.219118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-b59f7275-d387-460a-9855-0832e86c55fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:01:31.219118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:31.219118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:31.219118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:31.219118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:31.219118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:31.219118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:31.219118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:31.219118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:31.219118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:31.219118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:31.219118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:31.219118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:31.219118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:31.219118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:31.219118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:31.220075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:31.220075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:31.220075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:31.220075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:31.220075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:31.220075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:31.220075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:31.220075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:31.220075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:31.220075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:31.220075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:31.220075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:31.220075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:31.220075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:31.220075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:31.220075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:31.221297 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:31.221297 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:31.221297 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:31.221297 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:31.221297 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:31.221297 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:31.221297 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:31.221297 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:31.221297 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:31.221297 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:31.221297 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:01:31.221297 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:31.221297 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 188/370] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:01:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:31.222035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f7275-d387-460a-9855-0832e86c55fb None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:31.266742 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 183/371] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:01:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 28 12:01:31.271469 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623c9c4-ce78-411d-b4e1-dd1e0bc0730d None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:31.295826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:31.358010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f7275-d387-460a-9855-0832e86c55fb None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:31.393960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623c9c4-ce78-411d-b4e1-dd1e0bc0730d None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:31.397841 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2976ea-1cb8-4ae0-b31e-9230c6b15c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:31.398450 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2976ea-1cb8-4ae0-b31e-9230c6b15c15 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:31.398723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2976ea-1cb8-4ae0-b31e-9230c6b15c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:31.398993 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2976ea-1cb8-4ae0-b31e-9230c6b15c15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:31.399751 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2976ea-1cb8-4ae0-b31e-9230c6b15c15 None admin] RBAC: Adding query filter params (group.id=15bc028d41364b2d835602a2066ef030, role.id=9aa9b054939e4fc1ad0387e43c500693, scope.project.id=6f1f0a0a8c824d639602043911e34bb5) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:31.400057 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2976ea-1cb8-4ae0-b31e-9230c6b15c15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:31.401471 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2976ea-1cb8-4ae0-b31e-9230c6b15c15 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:31.407750 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 189/372] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 28 12:01:31 2022] GET /identity/v3/role_assignments?group.id=15bc028d41364b2d835602a2066ef030&scope.project.id=6f1f0a0a8c824d639602043911e34bb5&role.id=9aa9b054939e4fc1ad0387e43c500693 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:31.408577 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2976ea-1cb8-4ae0-b31e-9230c6b15c15 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:31.433295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb58168-1aa4-413f-b6f8-9fa6f05d599b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:31.434024 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb58168-1aa4-413f-b6f8-9fa6f05d599b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:31.434308 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb58168-1aa4-413f-b6f8-9fa6f05d599b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:31.434613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb58168-1aa4-413f-b6f8-9fa6f05d599b None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:31.435362 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb58168-1aa4-413f-b6f8-9fa6f05d599b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:31.435796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb58168-1aa4-413f-b6f8-9fa6f05d599b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:31.437132 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb58168-1aa4-413f-b6f8-9fa6f05d599b None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:31.448580 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 184/373] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:31.454522 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb58168-1aa4-413f-b6f8-9fa6f05d599b None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:31.486991 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:31.574631 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:31.584496 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2976ea-1cb8-4ae0-b31e-9230c6b15c15 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:31.608095 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb58168-1aa4-413f-b6f8-9fa6f05d599b None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:31.653947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bc4b7-f3c2-4436-957b-97db5b9d4fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:31.654595 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bc4b7-f3c2-4436-957b-97db5b9d4fad None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:31.654866 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bc4b7-f3c2-4436-957b-97db5b9d4fad None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:31.655134 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bc4b7-f3c2-4436-957b-97db5b9d4fad None admin] PATH_INFO: `/v3/projects/6f1f0a0a8c824d639602043911e34bb5` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:31.657977 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2bc4b7-f3c2-4436-957b-97db5b9d4fad None admin] RBAC: Authorizing `identity:get_project(project_id=6f1f0a0a8c824d639602043911e34bb5)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:31.659469 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2bc4b7-f3c2-4436-957b-97db5b9d4fad None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:31.661328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 190/374] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:31 2022] GET /identity/v3/projects/6f1f0a0a8c824d639602043911e34bb5 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:31.667033 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bc4b7-f3c2-4436-957b-97db5b9d4fad None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:31.684810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56025c3a-8f66-4f1a-ad90-f6b7596c0d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:31.685439 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56025c3a-8f66-4f1a-ad90-f6b7596c0d37 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:31.685715 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56025c3a-8f66-4f1a-ad90-f6b7596c0d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:31.685984 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56025c3a-8f66-4f1a-ad90-f6b7596c0d37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:31.802046 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56025c3a-8f66-4f1a-ad90-f6b7596c0d37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:31.803532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56025c3a-8f66-4f1a-ad90-f6b7596c0d37 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:31.878231 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bc4b7-f3c2-4436-957b-97db5b9d4fad None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:31.892833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:31.910200 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:31.929400 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234485c3-ae57-4969-abff-4d5e2eac91f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:31.930499 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234485c3-ae57-4969-abff-4d5e2eac91f9 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:31.932474 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234485c3-ae57-4969-abff-4d5e2eac91f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:31.932901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234485c3-ae57-4969-abff-4d5e2eac91f9 None admin] PATH_INFO: `/v3/groups/15bc028d41364b2d835602a2066ef030` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:31.935496 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234485c3-ae57-4969-abff-4d5e2eac91f9 None admin] RBAC: Authorizing `identity:get_group(group_id=15bc028d41364b2d835602a2066ef030)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:31.937111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234485c3-ae57-4969-abff-4d5e2eac91f9 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:31.939274 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 191/375] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 28 12:01:31 2022] GET /identity/v3/groups/15bc028d41364b2d835602a2066ef030 => generated 226 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:31.952411 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234485c3-ae57-4969-abff-4d5e2eac91f9 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:31.969168 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 185/376] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:01:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 28 12:01:31.980463 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56025c3a-8f66-4f1a-ad90-f6b7596c0d37 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:32.155291 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234485c3-ae57-4969-abff-4d5e2eac91f9 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:32.178811 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56025c3a-8f66-4f1a-ad90-f6b7596c0d37 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:32.196795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3841dfb-3528-486f-b407-405ea8021e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:32.197409 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3841dfb-3528-486f-b407-405ea8021e9e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:32.197684 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3841dfb-3528-486f-b407-405ea8021e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:32.197953 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3841dfb-3528-486f-b407-405ea8021e9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:32.198681 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3841dfb-3528-486f-b407-405ea8021e9e None admin] RBAC: Adding query filter params (group.id=15bc028d41364b2d835602a2066ef030, role.id=67ed180941fd45af996b858232628221, scope.project.id=6f1f0a0a8c824d639602043911e34bb5) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:32.198985 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3841dfb-3528-486f-b407-405ea8021e9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:32.200450 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3841dfb-3528-486f-b407-405ea8021e9e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:32.206270 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 192/377] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 28 12:01:31 2022] GET /identity/v3/role_assignments?group.id=15bc028d41364b2d835602a2066ef030&scope.project.id=6f1f0a0a8c824d639602043911e34bb5&role.id=67ed180941fd45af996b858232628221 => generated 260 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:32.251183 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01ab38-c1d4-435e-be40-e824aacc506b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:32.251878 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01ab38-c1d4-435e-be40-e824aacc506b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:32.252160 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01ab38-c1d4-435e-be40-e824aacc506b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:32.252435 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01ab38-c1d4-435e-be40-e824aacc506b None admin] PATH_INFO: `/v3/projects/041bf4405bd541158bdb50b4fa9874e6` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:32.256331 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f01ab38-c1d4-435e-be40-e824aacc506b None admin] RBAC: Authorizing `identity:get_project(project_id=041bf4405bd541158bdb50b4fa9874e6)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:32.257847 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f01ab38-c1d4-435e-be40-e824aacc506b None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:32.259669 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 186/378] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:31 2022] GET /identity/v3/projects/041bf4405bd541158bdb50b4fa9874e6 => generated 344 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:32.266076 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3841dfb-3528-486f-b407-405ea8021e9e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:32.286891 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fceebf-6cbc-456b-a9e4-2bc79bdf585d None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:32.287454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fceebf-6cbc-456b-a9e4-2bc79bdf585d None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:32.287869 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fceebf-6cbc-456b-a9e4-2bc79bdf585d None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:32.289661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 187/379] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:01:32.296844 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602a0e3-571e-477c-affe-84f6e87cad83 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:32.297444 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602a0e3-571e-477c-affe-84f6e87cad83 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:32.297891 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602a0e3-571e-477c-affe-84f6e87cad83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:32.326944 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:32.331203 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-c602a0e3-571e-477c-affe-84f6e87cad83 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:32.334389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-c602a0e3-571e-477c-affe-84f6e87cad83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:32.405605 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:32.448177 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3841dfb-3528-486f-b407-405ea8021e9e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:32.470641 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 188/380] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:32.502865 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8b937-4102-475f-a44d-f52d666c4381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:32.503920 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8b937-4102-475f-a44d-f52d666c4381 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:32.504386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8b937-4102-475f-a44d-f52d666c4381 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:32.505489 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8b937-4102-475f-a44d-f52d666c4381 None admin] PATH_INFO: `/v3/groups/8db74032c4b044b1a3348672e4389a4b` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:32.512173 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8b937-4102-475f-a44d-f52d666c4381 None admin] RBAC: Authorizing `identity:get_group(group_id=8db74032c4b044b1a3348672e4389a4b)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:32.513774 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8b937-4102-475f-a44d-f52d666c4381 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:32.515702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 193/381] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 28 12:01:32 2022] GET /identity/v3/groups/8db74032c4b044b1a3348672e4389a4b => generated 229 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:32.521624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602a0e3-571e-477c-affe-84f6e87cad83 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:32.638274 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602a0e3-571e-477c-affe-84f6e87cad83 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:32.675818 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e7560-b090-4a31-8814-594cb847eece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:32.677421 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e7560-b090-4a31-8814-594cb847eece None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:32.677895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e7560-b090-4a31-8814-594cb847eece None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:32.678368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e7560-b090-4a31-8814-594cb847eece None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:32.679309 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e7560-b090-4a31-8814-594cb847eece None admin] RBAC: Adding query filter params (group.id=8db74032c4b044b1a3348672e4389a4b, role.id=66456d39fc0c496c8f290a436b726216, scope.project.id=041bf4405bd541158bdb50b4fa9874e6) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:32.684085 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e7560-b090-4a31-8814-594cb847eece None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:32.685882 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e7560-b090-4a31-8814-594cb847eece None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:32.692951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 189/382] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 28 12:01:32 2022] GET /identity/v3/role_assignments?group.id=8db74032c4b044b1a3348672e4389a4b&scope.project.id=041bf4405bd541158bdb50b4fa9874e6&role.id=66456d39fc0c496c8f290a436b726216 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:32.815306 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8b937-4102-475f-a44d-f52d666c4381 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:32.949385 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8b937-4102-475f-a44d-f52d666c4381 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:32.952330 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:32.985701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39379917-2b04-4e26-8ded-53ccafddd53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:32.986327 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39379917-2b04-4e26-8ded-53ccafddd53e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:32.986602 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39379917-2b04-4e26-8ded-53ccafddd53e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:32.986873 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39379917-2b04-4e26-8ded-53ccafddd53e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:32.998099 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39379917-2b04-4e26-8ded-53ccafddd53e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:33.006026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-39379917-2b04-4e26-8ded-53ccafddd53e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:01:33.006026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:33.006026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:33.006026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:33.006026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:33.006026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:33.006026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:33.006026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:33.006026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:33.006026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:33.006026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:33.006026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:33.006026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:33.006026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:33.006026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:33.006026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:33.006906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:33.006906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:33.006906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:33.006906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:33.006906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:33.006906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:33.006906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:33.006906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:33.006906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:33.006906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:33.006906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:33.006906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:33.006906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:33.006906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:33.006906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:33.006906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:33.007754 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:33.007754 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:33.007754 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:33.007754 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:33.007754 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:33.007754 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:33.007754 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:33.007754 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:33.007754 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:33.007754 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:33.007754 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:01:33.007754 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:33.007754 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 194/383] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:33.013684 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e7560-b090-4a31-8814-594cb847eece None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:33.061056 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:33.149592 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e7560-b090-4a31-8814-594cb847eece None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:33.195802 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c277fc-cad2-4e26-ae4a-c2d814cddbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:33.196438 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c277fc-cad2-4e26-ae4a-c2d814cddbdc None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:33.196677 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c277fc-cad2-4e26-ae4a-c2d814cddbdc None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:33.196953 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c277fc-cad2-4e26-ae4a-c2d814cddbdc None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:33.197636 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c277fc-cad2-4e26-ae4a-c2d814cddbdc None admin] RBAC: Adding query filter params (name=member) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:33.204103 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c277fc-cad2-4e26-ae4a-c2d814cddbdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:33.205454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c277fc-cad2-4e26-ae4a-c2d814cddbdc None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:33.215777 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 190/384] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:01:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:33.224101 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39379917-2b04-4e26-8ded-53ccafddd53e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:33.354874 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39379917-2b04-4e26-8ded-53ccafddd53e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:33.393722 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417398f-d63b-4bf0-b42c-1295a235b701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:33.394732 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417398f-d63b-4bf0-b42c-1295a235b701 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:33.395257 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417398f-d63b-4bf0-b42c-1295a235b701 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:33.395739 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417398f-d63b-4bf0-b42c-1295a235b701 None admin] PATH_INFO: `/v3/groups/15bc028d41364b2d835602a2066ef030` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:33.397069 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417398f-d63b-4bf0-b42c-1295a235b701 None admin] RBAC: Authorizing `identity:get_group(group_id=15bc028d41364b2d835602a2066ef030)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:33.398704 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417398f-d63b-4bf0-b42c-1295a235b701 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:33.400881 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 195/385] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 28 12:01:33 2022] GET /identity/v3/groups/15bc028d41364b2d835602a2066ef030 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:33.406432 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c277fc-cad2-4e26-ae4a-c2d814cddbdc None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:33.522333 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:33.531475 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c277fc-cad2-4e26-ae4a-c2d814cddbdc None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:33.568927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f7e8a-5b81-4b54-a587-eb298a0caee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:33.569561 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f7e8a-5b81-4b54-a587-eb298a0caee3 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:33.569844 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f7e8a-5b81-4b54-a587-eb298a0caee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:33.570098 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f7e8a-5b81-4b54-a587-eb298a0caee3 None admin] PATH_INFO: `/v3/projects/0976a5e8d4d942399b8522e367e466ba` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:33.571238 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f7e8a-5b81-4b54-a587-eb298a0caee3 None admin] RBAC: Authorizing `identity:get_project(project_id=0976a5e8d4d942399b8522e367e466ba)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:33.572719 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f7e8a-5b81-4b54-a587-eb298a0caee3 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:33.574345 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 191/386] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:33 2022] GET /identity/v3/projects/0976a5e8d4d942399b8522e367e466ba => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:33.579627 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217408f4-208b-418b-9c5b-b29458eebdf7 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:33.579908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217408f4-208b-418b-9c5b-b29458eebdf7 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:33.580180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217408f4-208b-418b-9c5b-b29458eebdf7 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:33.581504 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 196/387] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:33.582350 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f7e8a-5b81-4b54-a587-eb298a0caee3 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:33.586856 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda69e6-cc5f-4d2a-ad7f-fae655aa663d None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:33.587139 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda69e6-cc5f-4d2a-ad7f-fae655aa663d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:33.587407 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda69e6-cc5f-4d2a-ad7f-fae655aa663d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:33.615292 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-7cda69e6-cc5f-4d2a-ad7f-fae655aa663d None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:33.616777 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7cda69e6-cc5f-4d2a-ad7f-fae655aa663d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:33.675830 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:33.755489 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 197/388] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:01:33.769777 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f7e8a-5b81-4b54-a587-eb298a0caee3 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:33.813142 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45de0a-099c-45a1-bbbc-47251b884afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:33.813727 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45de0a-099c-45a1-bbbc-47251b884afa None admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:33.814002 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45de0a-099c-45a1-bbbc-47251b884afa None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:33.814276 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45de0a-099c-45a1-bbbc-47251b884afa None admin] PATH_INFO: `/v3/projects/0976a5e8d4d942399b8522e367e466ba/groups/15bc028d41364b2d835602a2066ef030/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:33.820757 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45de0a-099c-45a1-bbbc-47251b884afa None admin] RBAC: Authorizing `identity:create_grant(project_id=0976a5e8d4d942399b8522e367e466ba, group_id=15bc028d41364b2d835602a2066ef030, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:33.822214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45de0a-099c-45a1-bbbc-47251b884afa None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:33.848796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 192/389] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Sep 28 12:01:33 2022] PUT /identity/v3/projects/0976a5e8d4d942399b8522e367e466ba/groups/15bc028d41364b2d835602a2066ef030/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:01:34.091984 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda69e6-cc5f-4d2a-ad7f-fae655aa663d None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:34.210818 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda69e6-cc5f-4d2a-ad7f-fae655aa663d None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:34.260728 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc9425-5b62-4015-a712-21f401e484fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:34.261475 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc9425-5b62-4015-a712-21f401e484fd None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:34.261661 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc9425-5b62-4015-a712-21f401e484fd None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:34.261914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc9425-5b62-4015-a712-21f401e484fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:34.277441 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc9425-5b62-4015-a712-21f401e484fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:34.282328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-1ddc9425-5b62-4015-a712-21f401e484fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:01:34.282328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:34.282328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:34.282328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:34.282328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:34.282328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:34.282328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:34.282328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:34.282328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:34.282328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:34.282328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:34.282328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:34.282328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:34.282328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:34.282328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:34.282328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:34.283226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:34.283226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:34.283226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:34.283226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:34.283226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:34.283226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:34.283226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:34.283226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:34.283226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:34.283226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:34.283226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:34.283226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:34.283226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:34.283226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:34.283226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:34.283226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:34.284446 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:34.284446 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:34.284446 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:34.284446 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:34.284446 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:34.284446 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:34.284446 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:34.284446 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:34.284446 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:34.284446 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:34.284446 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:01:34.284446 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:34.284446 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 198/390] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 28 12:01:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:34.290200 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45de0a-099c-45a1-bbbc-47251b884afa None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:34.314433 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a4618-88cd-4d09-adf3-743f5b02057f None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:34.314744 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a4618-88cd-4d09-adf3-743f5b02057f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:34.315236 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a4618-88cd-4d09-adf3-743f5b02057f None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:34.316523 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 199/391] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:34.321448 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f31bf-842c-43f7-9899-f4609625d75f None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:34.321731 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f31bf-842c-43f7-9899-f4609625d75f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:34.322007 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f31bf-842c-43f7-9899-f4609625d75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:34.338854 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:34.340825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-719f31bf-842c-43f7-9899-f4609625d75f None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:34.342089 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-719f31bf-842c-43f7-9899-f4609625d75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:34.371793 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:34.460295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 200/392] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:01:34.475384 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45de0a-099c-45a1-bbbc-47251b884afa None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:34.525677 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf74b4-76cb-482f-b38c-1ee77872abae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:34.526292 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf74b4-76cb-482f-b38c-1ee77872abae None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:34.526571 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf74b4-76cb-482f-b38c-1ee77872abae None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:34.526840 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf74b4-76cb-482f-b38c-1ee77872abae None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:34.527530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf74b4-76cb-482f-b38c-1ee77872abae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:34.527838 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf74b4-76cb-482f-b38c-1ee77872abae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:34.529211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf74b4-76cb-482f-b38c-1ee77872abae None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:34.543248 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 193/393] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:01:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:34.548771 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f31bf-842c-43f7-9899-f4609625d75f None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:34.682320 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f31bf-842c-43f7-9899-f4609625d75f None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:34.747190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1c39f-7c4c-4661-ac55-2209c6f792c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:34.748223 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1c39f-7c4c-4661-ac55-2209c6f792c2 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:34.748757 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1c39f-7c4c-4661-ac55-2209c6f792c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:34.749253 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1c39f-7c4c-4661-ac55-2209c6f792c2 None admin] PATH_INFO: `/v3/groups/15bc028d41364b2d835602a2066ef030` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:34.750656 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1c39f-7c4c-4661-ac55-2209c6f792c2 None admin] RBAC: Authorizing `identity:get_group(group_id=15bc028d41364b2d835602a2066ef030)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:34.752417 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1c39f-7c4c-4661-ac55-2209c6f792c2 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:34.754225 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 201/394] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 28 12:01:34 2022] GET /identity/v3/groups/15bc028d41364b2d835602a2066ef030 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:34.760528 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf74b4-76cb-482f-b38c-1ee77872abae None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:34.880998 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1c39f-7c4c-4661-ac55-2209c6f792c2 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:34.904547 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:34.912046 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:34.939748 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf74b4-76cb-482f-b38c-1ee77872abae None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:35.002924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e7d5f-338e-4576-abb2-61aa247be9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:35.003592 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e7d5f-338e-4576-abb2-61aa247be9c2 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:35.003870 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e7d5f-338e-4576-abb2-61aa247be9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:35.004138 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e7d5f-338e-4576-abb2-61aa247be9c2 None admin] PATH_INFO: `/v3/projects/0976a5e8d4d942399b8522e367e466ba` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:35.008105 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e7d5f-338e-4576-abb2-61aa247be9c2 None admin] RBAC: Authorizing `identity:get_project(project_id=0976a5e8d4d942399b8522e367e466ba)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:35.009563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e7d5f-338e-4576-abb2-61aa247be9c2 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:35.011518 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 194/395] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:34 2022] GET /identity/v3/projects/0976a5e8d4d942399b8522e367e466ba => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:35.016835 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e7d5f-338e-4576-abb2-61aa247be9c2 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:35.026110 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1c39f-7c4c-4661-ac55-2209c6f792c2 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:35.075875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122cfd3-e0ef-4820-96e1-45777c5367ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:35.077079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122cfd3-e0ef-4820-96e1-45777c5367ef None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:35.078206 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122cfd3-e0ef-4820-96e1-45777c5367ef None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:35.078843 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122cfd3-e0ef-4820-96e1-45777c5367ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:35.102314 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122cfd3-e0ef-4820-96e1-45777c5367ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:35.108254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-f122cfd3-e0ef-4820-96e1-45777c5367ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:01:35.108254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:35.108254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:35.108254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:35.108254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:35.108254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:35.108254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:35.108254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:35.108254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:35.108254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:35.108254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:35.108254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:35.108254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:35.108254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:35.108254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:35.108254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:35.109157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:35.109157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:35.109157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:35.109157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:35.109157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:35.109157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:35.109157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:35.109157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:35.109157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:35.109157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:35.109157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:35.109157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:35.109157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:35.109157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:35.109157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:35.109157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:35.109951 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:35.109951 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:35.109951 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:35.109951 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:35.109951 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:35.109951 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:35.109951 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:35.109951 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:35.109951 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:35.109951 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:35.109951 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:01:35.109951 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:35.112733 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 202/396] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:01:35.118796 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122cfd3-e0ef-4820-96e1-45777c5367ef None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:35.189442 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e7d5f-338e-4576-abb2-61aa247be9c2 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:35.237416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea750823-5e24-4f44-a240-e454bded1452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:35.238432 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea750823-5e24-4f44-a240-e454bded1452 None admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:35.240335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea750823-5e24-4f44-a240-e454bded1452 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:35.242168 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea750823-5e24-4f44-a240-e454bded1452 None admin] PATH_INFO: `/v3/projects/0976a5e8d4d942399b8522e367e466ba/groups/15bc028d41364b2d835602a2066ef030/roles/67ed180941fd45af996b858232628221` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:35.245870 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea750823-5e24-4f44-a240-e454bded1452 None admin] RBAC: Authorizing `identity:create_grant(project_id=0976a5e8d4d942399b8522e367e466ba, group_id=15bc028d41364b2d835602a2066ef030, role_id=67ed180941fd45af996b858232628221)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:35.248428 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea750823-5e24-4f44-a240-e454bded1452 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:35.272783 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 195/397] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Sep 28 12:01:35 2022] PUT /identity/v3/projects/0976a5e8d4d942399b8522e367e466ba/groups/15bc028d41364b2d835602a2066ef030/roles/67ed180941fd45af996b858232628221 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:01:35.291209 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:35.314718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122cfd3-e0ef-4820-96e1-45777c5367ef None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:35.357143 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ae357-b4f6-480f-87dc-a17ff451ccc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:35.357789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ae357-b4f6-480f-87dc-a17ff451ccc7 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:35.358072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ae357-b4f6-480f-87dc-a17ff451ccc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:35.358349 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ae357-b4f6-480f-87dc-a17ff451ccc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:35.359055 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ae357-b4f6-480f-87dc-a17ff451ccc7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:35.359364 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ae357-b4f6-480f-87dc-a17ff451ccc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:35.360929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ae357-b4f6-480f-87dc-a17ff451ccc7 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:35.372365 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 203/398] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:01:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:35.377592 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea750823-5e24-4f44-a240-e454bded1452 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:35.381569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412752a-2114-488b-9941-86896fe13d61 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:35.381868 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412752a-2114-488b-9941-86896fe13d61 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:35.382197 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412752a-2114-488b-9941-86896fe13d61 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:35.385120 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 204/399] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:35.389538 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892f3db-bb89-4efe-bdb2-2758b553a4bd None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:35.389827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892f3db-bb89-4efe-bdb2-2758b553a4bd None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:35.390206 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892f3db-bb89-4efe-bdb2-2758b553a4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:35.410751 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-2892f3db-bb89-4efe-bdb2-2758b553a4bd None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:35.412019 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-2892f3db-bb89-4efe-bdb2-2758b553a4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:35.422614 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:35.486352 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 205/400] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:01:35.493020 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f67bb-48cd-48d0-ae30-3a8c10ce9f06 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:35.493294 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f67bb-48cd-48d0-ae30-3a8c10ce9f06 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:35.493498 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f67bb-48cd-48d0-ae30-3a8c10ce9f06 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:35.494875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 206/401] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:35.500930 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fe6a0-3165-412a-8915-1165e61e957f None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:35.501232 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fe6a0-3165-412a-8915-1165e61e957f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:35.501491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fe6a0-3165-412a-8915-1165e61e957f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:35.536715 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-295fe6a0-3165-412a-8915-1165e61e957f None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:35.538014 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-295fe6a0-3165-412a-8915-1165e61e957f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:35.545074 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea750823-5e24-4f44-a240-e454bded1452 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:35.591778 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5feff-bdb6-4cbb-b344-dae067c2d189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:35.592421 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5feff-bdb6-4cbb-b344-dae067c2d189 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:35.592704 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5feff-bdb6-4cbb-b344-dae067c2d189 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:35.592981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5feff-bdb6-4cbb-b344-dae067c2d189 None admin] PATH_INFO: `/v3/groups/15bc028d41364b2d835602a2066ef030` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:35.594128 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f5feff-bdb6-4cbb-b344-dae067c2d189 None admin] RBAC: Authorizing `identity:get_group(group_id=15bc028d41364b2d835602a2066ef030)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:35.595859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f5feff-bdb6-4cbb-b344-dae067c2d189 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:35.598999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 196/402] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 28 12:01:35 2022] GET /identity/v3/groups/15bc028d41364b2d835602a2066ef030 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:35.604067 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5feff-bdb6-4cbb-b344-dae067c2d189 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:35.631483 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 207/403] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:35.712882 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:35.743611 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5feff-bdb6-4cbb-b344-dae067c2d189 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:35.802451 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb42f79-f931-46c6-98a0-74d6dc728403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:35.803089 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb42f79-f931-46c6-98a0-74d6dc728403 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:35.803380 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb42f79-f931-46c6-98a0-74d6dc728403 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:35.803682 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb42f79-f931-46c6-98a0-74d6dc728403 None admin] PATH_INFO: `/v3/projects/6f1f0a0a8c824d639602043911e34bb5` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:35.804824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb42f79-f931-46c6-98a0-74d6dc728403 None admin] RBAC: Authorizing `identity:get_project(project_id=6f1f0a0a8c824d639602043911e34bb5)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:35.806265 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb42f79-f931-46c6-98a0-74d6dc728403 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:35.808344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 197/404] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:35 2022] GET /identity/v3/projects/6f1f0a0a8c824d639602043911e34bb5 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:35.816519 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fe6a0-3165-412a-8915-1165e61e957f None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:35.819986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:35.927022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb42f79-f931-46c6-98a0-74d6dc728403 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:35.962493 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fe6a0-3165-412a-8915-1165e61e957f None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:36.005269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef708299-4e21-4876-afff-0919244b7712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:36.005865 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef708299-4e21-4876-afff-0919244b7712 None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:36.006146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef708299-4e21-4876-afff-0919244b7712 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:36.006424 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef708299-4e21-4876-afff-0919244b7712 None admin] PATH_INFO: `/v3/projects/6f1f0a0a8c824d639602043911e34bb5/groups/15bc028d41364b2d835602a2066ef030/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:36.010142 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef708299-4e21-4876-afff-0919244b7712 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f1f0a0a8c824d639602043911e34bb5, group_id=15bc028d41364b2d835602a2066ef030, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:36.011609 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef708299-4e21-4876-afff-0919244b7712 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:36.026756 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 208/405] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Sep 28 12:01:35 2022] PUT /identity/v3/projects/6f1f0a0a8c824d639602043911e34bb5/groups/15bc028d41364b2d835602a2066ef030/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:01:36.027460 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef708299-4e21-4876-afff-0919244b7712 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:36.063587 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb42f79-f931-46c6-98a0-74d6dc728403 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:36.100361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:36.108458 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bd095-7e53-46ce-a9e9-45829e386a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:36.109490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bd095-7e53-46ce-a9e9-45829e386a19 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:36.110175 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bd095-7e53-46ce-a9e9-45829e386a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:36.110647 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bd095-7e53-46ce-a9e9-45829e386a19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:36.125803 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bd095-7e53-46ce-a9e9-45829e386a19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:36.133586 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-439bd095-7e53-46ce-a9e9-45829e386a19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:01:36.133586 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:36.133586 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:36.133586 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:36.133586 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:36.133586 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:36.133586 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:36.133586 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:36.133586 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:36.133586 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:36.133586 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:36.133586 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:36.133586 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:36.133586 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:36.133586 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:36.133586 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:36.134556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:36.134556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:36.134556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:36.134556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:36.134556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:36.134556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:36.134556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:36.134556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:36.134556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:36.134556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:36.134556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:36.134556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:36.134556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:36.134556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:36.134556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:36.134556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:36.135538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:36.135538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:36.135538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:36.135538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:36.135538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:36.135538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:36.135538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:36.135538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:36.135538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:36.135538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:36.135538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:01:36.135538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:36.138380 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 198/406] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:01:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:36.146111 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bd095-7e53-46ce-a9e9-45829e386a19 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:36.146303 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef708299-4e21-4876-afff-0919244b7712 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:36.170470 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:36.187223 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7e9ff-168a-47a2-b9bf-61f5446816aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:36.188142 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7e9ff-168a-47a2-b9bf-61f5446816aa None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:36.188570 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7e9ff-168a-47a2-b9bf-61f5446816aa None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:36.189024 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7e9ff-168a-47a2-b9bf-61f5446816aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:36.206905 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7e9ff-168a-47a2-b9bf-61f5446816aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:36.212460 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-0de7e9ff-168a-47a2-b9bf-61f5446816aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:01:36.212460 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:36.212460 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:36.212460 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:36.212460 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:36.212460 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:36.212460 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:36.212460 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:36.212460 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:36.212460 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:36.212460 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:36.212460 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:36.212460 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:36.212460 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:36.212460 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:36.212460 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:36.213578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:36.213578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:36.213578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:36.213578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:36.213578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:36.213578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:36.213578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:36.213578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:36.213578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:36.213578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:36.213578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:36.213578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:36.213578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:36.213578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:36.213578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:36.213578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:36.214555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:36.214555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:36.214555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:36.214555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:36.214555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:36.214555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:36.214555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:36.214555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:36.214555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:36.214555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:36.214555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:01:36.214555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:36.217135 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 209/407] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 28 12:01:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:36.223709 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7e9ff-168a-47a2-b9bf-61f5446816aa None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:36.354156 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bd095-7e53-46ce-a9e9-45829e386a19 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:36.383812 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7e9ff-168a-47a2-b9bf-61f5446816aa None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:36.390757 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09940451-f155-43a1-95ef-1620b0589d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:36.391524 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09940451-f155-43a1-95ef-1620b0589d5e None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:36.391877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09940451-f155-43a1-95ef-1620b0589d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:36.392243 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09940451-f155-43a1-95ef-1620b0589d5e None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:36.392999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09940451-f155-43a1-95ef-1620b0589d5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:36.393396 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09940451-f155-43a1-95ef-1620b0589d5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:36.394883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09940451-f155-43a1-95ef-1620b0589d5e None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:36.404719 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 199/408] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:36.410225 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09940451-f155-43a1-95ef-1620b0589d5e None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:36.412124 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:36.427288 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345b1b7-7a50-4260-9452-b4ac88fe1194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:36.428172 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345b1b7-7a50-4260-9452-b4ac88fe1194 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:36.428749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345b1b7-7a50-4260-9452-b4ac88fe1194 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:36.429243 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345b1b7-7a50-4260-9452-b4ac88fe1194 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:36.430167 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345b1b7-7a50-4260-9452-b4ac88fe1194 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:36.430615 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345b1b7-7a50-4260-9452-b4ac88fe1194 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:36.432187 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345b1b7-7a50-4260-9452-b4ac88fe1194 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:36.441965 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 210/409] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:01:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:36.449812 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345b1b7-7a50-4260-9452-b4ac88fe1194 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:36.503523 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:36.532513 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09940451-f155-43a1-95ef-1620b0589d5e None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:36.568227 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd6492-4fd8-4d29-9222-a6162bbe6356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:36.568931 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd6492-4fd8-4d29-9222-a6162bbe6356 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:36.569136 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd6492-4fd8-4d29-9222-a6162bbe6356 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:36.569393 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd6492-4fd8-4d29-9222-a6162bbe6356 None admin] PATH_INFO: `/v3/groups/8db74032c4b044b1a3348672e4389a4b` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:36.570502 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd6492-4fd8-4d29-9222-a6162bbe6356 None admin] RBAC: Authorizing `identity:get_group(group_id=8db74032c4b044b1a3348672e4389a4b)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:36.571946 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345b1b7-7a50-4260-9452-b4ac88fe1194 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:36.572059 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd6492-4fd8-4d29-9222-a6162bbe6356 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:36.573913 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 200/410] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 28 12:01:36 2022] GET /identity/v3/groups/8db74032c4b044b1a3348672e4389a4b => generated 229 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:36.579282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd6492-4fd8-4d29-9222-a6162bbe6356 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:36.611787 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990d1c7-8f75-4a76-bb7f-f2d37f77c147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:36.613061 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990d1c7-8f75-4a76-bb7f-f2d37f77c147 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:36.613792 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990d1c7-8f75-4a76-bb7f-f2d37f77c147 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:36.614840 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990d1c7-8f75-4a76-bb7f-f2d37f77c147 None admin] PATH_INFO: `/v3/groups/15bc028d41364b2d835602a2066ef030` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:36.616526 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990d1c7-8f75-4a76-bb7f-f2d37f77c147 None admin] RBAC: Authorizing `identity:get_group(group_id=15bc028d41364b2d835602a2066ef030)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:36.618234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990d1c7-8f75-4a76-bb7f-f2d37f77c147 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:36.620320 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 211/411] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 28 12:01:36 2022] GET /identity/v3/groups/15bc028d41364b2d835602a2066ef030 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:36.621609 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206afa2-1e16-4667-885d-726677899ea6 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:36.622158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206afa2-1e16-4667-885d-726677899ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:36.622577 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206afa2-1e16-4667-885d-726677899ea6 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:36.624191 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 212/412] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:36.627134 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206afa2-1e16-4667-885d-726677899ea6 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:36.704852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:36.710053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd6492-4fd8-4d29-9222-a6162bbe6356 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:36.756769 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb52077-9352-4f8b-b140-82a5c32873cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:36.757774 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb52077-9352-4f8b-b140-82a5c32873cd None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:36.758129 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb52077-9352-4f8b-b140-82a5c32873cd None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:36.758478 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb52077-9352-4f8b-b140-82a5c32873cd None admin] PATH_INFO: `/v3/projects/041bf4405bd541158bdb50b4fa9874e6` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:36.759944 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb52077-9352-4f8b-b140-82a5c32873cd None admin] RBAC: Authorizing `identity:get_project(project_id=041bf4405bd541158bdb50b4fa9874e6)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:36.762136 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb52077-9352-4f8b-b140-82a5c32873cd None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:36.768606 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206afa2-1e16-4667-885d-726677899ea6 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:36.768749 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 201/413] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:36 2022] GET /identity/v3/projects/041bf4405bd541158bdb50b4fa9874e6 => generated 344 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:36.768749 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95e385-8a38-4854-8411-1c7f4e7d89d7 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:36.768749 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95e385-8a38-4854-8411-1c7f4e7d89d7 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:36.768749 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95e385-8a38-4854-8411-1c7f4e7d89d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:36.790544 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-7f95e385-8a38-4854-8411-1c7f4e7d89d7 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:36.791934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-7f95e385-8a38-4854-8411-1c7f4e7d89d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:36.796497 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:36.810800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21e0dc-dc34-4ac3-98b4-478caaf6a800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:36.811806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21e0dc-dc34-4ac3-98b4-478caaf6a800 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:36.812303 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21e0dc-dc34-4ac3-98b4-478caaf6a800 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:36.812797 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21e0dc-dc34-4ac3-98b4-478caaf6a800 None admin] PATH_INFO: `/v3/projects/6f1f0a0a8c824d639602043911e34bb5` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:36.814118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21e0dc-dc34-4ac3-98b4-478caaf6a800 None admin] RBAC: Authorizing `identity:get_project(project_id=6f1f0a0a8c824d639602043911e34bb5)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:36.815936 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21e0dc-dc34-4ac3-98b4-478caaf6a800 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:36.823218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 213/414] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:36 2022] GET /identity/v3/projects/6f1f0a0a8c824d639602043911e34bb5 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:36.824446 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21e0dc-dc34-4ac3-98b4-478caaf6a800 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:36.887283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 202/415] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:36.888395 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95e385-8a38-4854-8411-1c7f4e7d89d7 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:36.955842 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21e0dc-dc34-4ac3-98b4-478caaf6a800 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:36.991473 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:37.024029 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80de1c3-8454-488d-8b9d-18533e0c016b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:37.025036 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80de1c3-8454-488d-8b9d-18533e0c016b None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:37.025535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80de1c3-8454-488d-8b9d-18533e0c016b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:37.026010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80de1c3-8454-488d-8b9d-18533e0c016b None admin] PATH_INFO: `/v3/projects/041bf4405bd541158bdb50b4fa9874e6/groups/8db74032c4b044b1a3348672e4389a4b/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:37.028667 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80de1c3-8454-488d-8b9d-18533e0c016b None admin] RBAC: Authorizing `identity:create_grant(project_id=041bf4405bd541158bdb50b4fa9874e6, group_id=8db74032c4b044b1a3348672e4389a4b, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:37.032295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80de1c3-8454-488d-8b9d-18533e0c016b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:37.060101 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 214/416] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Sep 28 12:01:36 2022] PUT /identity/v3/projects/041bf4405bd541158bdb50b4fa9874e6/groups/8db74032c4b044b1a3348672e4389a4b/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:01:37.076561 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95e385-8a38-4854-8411-1c7f4e7d89d7 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:37.132705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3f931-b815-42c0-be28-3acef59d8eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:37.133418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3f931-b815-42c0-be28-3acef59d8eef None admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:37.133701 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3f931-b815-42c0-be28-3acef59d8eef None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:37.133973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3f931-b815-42c0-be28-3acef59d8eef None admin] PATH_INFO: `/v3/projects/6f1f0a0a8c824d639602043911e34bb5/groups/15bc028d41364b2d835602a2066ef030/roles/67ed180941fd45af996b858232628221` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:37.136218 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3f931-b815-42c0-be28-3acef59d8eef None admin] RBAC: Authorizing `identity:create_grant(project_id=6f1f0a0a8c824d639602043911e34bb5, group_id=15bc028d41364b2d835602a2066ef030, role_id=67ed180941fd45af996b858232628221)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:37.137768 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3f931-b815-42c0-be28-3acef59d8eef None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:37.149517 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:37.153959 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 203/417] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Sep 28 12:01:36 2022] PUT /identity/v3/projects/6f1f0a0a8c824d639602043911e34bb5/groups/15bc028d41364b2d835602a2066ef030/roles/67ed180941fd45af996b858232628221 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:01:37.219864 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80de1c3-8454-488d-8b9d-18533e0c016b None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:37.341972 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80de1c3-8454-488d-8b9d-18533e0c016b None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:37.384937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85855d08-3fba-4144-8f20-4960b76894eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:37.385679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85855d08-3fba-4144-8f20-4960b76894eb None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:37.385870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85855d08-3fba-4144-8f20-4960b76894eb None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:37.386147 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85855d08-3fba-4144-8f20-4960b76894eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:37.397158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85855d08-3fba-4144-8f20-4960b76894eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:37.402453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-85855d08-3fba-4144-8f20-4960b76894eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:01:37.402453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:37.402453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:37.402453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:37.402453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:37.402453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:37.402453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:37.402453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:37.402453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:37.402453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:37.402453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:37.402453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:37.402453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:37.402453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:37.402453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:37.402453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:37.403355 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:37.403355 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:37.403355 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:37.403355 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:37.403355 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:37.403355 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:37.403355 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:37.403355 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:37.403355 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:37.403355 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:37.403355 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:37.403355 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:37.403355 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:37.403355 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:37.403355 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:37.403355 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:37.404198 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:37.404198 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:37.404198 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:37.404198 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:37.404198 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:37.404198 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:37.404198 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:37.404198 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:37.404198 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:37.404198 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:37.404198 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:01:37.404198 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:37.404198 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 215/418] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:37.409829 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3f931-b815-42c0-be28-3acef59d8eef None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:37.547196 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3f931-b815-42c0-be28-3acef59d8eef None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:37.591524 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfef10d-c5b4-4ba4-b45a-2fb40e59c5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:37.592141 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfef10d-c5b4-4ba4-b45a-2fb40e59c5bb None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:37.592419 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfef10d-c5b4-4ba4-b45a-2fb40e59c5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:37.592690 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfef10d-c5b4-4ba4-b45a-2fb40e59c5bb None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:37.593359 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfef10d-c5b4-4ba4-b45a-2fb40e59c5bb None admin] RBAC: Adding query filter params (name=member) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:37.593662 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfef10d-c5b4-4ba4-b45a-2fb40e59c5bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:37.595248 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfef10d-c5b4-4ba4-b45a-2fb40e59c5bb None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:37.607162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 204/419] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:01:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:37.613053 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85855d08-3fba-4144-8f20-4960b76894eb None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:37.687865 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:37.784293 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85855d08-3fba-4144-8f20-4960b76894eb None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:37.834442 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8f954-9d4b-4a44-99e9-bd9ef615b8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:37.835071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8f954-9d4b-4a44-99e9-bd9ef615b8da None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:37.835354 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8f954-9d4b-4a44-99e9-bd9ef615b8da None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:37.835693 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8f954-9d4b-4a44-99e9-bd9ef615b8da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:37.939402 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8f954-9d4b-4a44-99e9-bd9ef615b8da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:37.940828 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8f954-9d4b-4a44-99e9-bd9ef615b8da None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:37.988307 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:38.046190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95cb11-2f3d-448d-a50c-f58c1a1ec633 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:38.046475 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95cb11-2f3d-448d-a50c-f58c1a1ec633 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:38.046749 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95cb11-2f3d-448d-a50c-f58c1a1ec633 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:38.048360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 205/420] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:38.053971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968a748-ed64-4fba-9c6b-3fad0494f2a1 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:38.054251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968a748-ed64-4fba-9c6b-3fad0494f2a1 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:38.054580 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968a748-ed64-4fba-9c6b-3fad0494f2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:38.074006 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 216/421] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:01:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:01:38.076307 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-7968a748-ed64-4fba-9c6b-3fad0494f2a1 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:38.077722 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-7968a748-ed64-4fba-9c6b-3fad0494f2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:38.079394 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8f954-9d4b-4a44-99e9-bd9ef615b8da None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:38.180948 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:38.204889 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 206/422] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:38.222596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8f954-9d4b-4a44-99e9-bd9ef615b8da None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:38.277507 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863cce1-2096-4647-9b07-880e35077521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:38.278156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863cce1-2096-4647-9b07-880e35077521 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:38.278428 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863cce1-2096-4647-9b07-880e35077521 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:38.278691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863cce1-2096-4647-9b07-880e35077521 None admin] PATH_INFO: `/v3/projects/0976a5e8d4d942399b8522e367e466ba` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:38.279927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863cce1-2096-4647-9b07-880e35077521 None admin] RBAC: Authorizing `identity:get_project(project_id=0976a5e8d4d942399b8522e367e466ba)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:38.281373 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863cce1-2096-4647-9b07-880e35077521 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:38.283209 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 217/423] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:38 2022] GET /identity/v3/projects/0976a5e8d4d942399b8522e367e466ba => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:38.288557 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968a748-ed64-4fba-9c6b-3fad0494f2a1 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:38.411916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968a748-ed64-4fba-9c6b-3fad0494f2a1 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:38.447783 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af03376-cccf-45a7-808a-c9b08669d67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:38.448412 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af03376-cccf-45a7-808a-c9b08669d67b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:38.448683 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af03376-cccf-45a7-808a-c9b08669d67b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:38.448953 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af03376-cccf-45a7-808a-c9b08669d67b None admin] PATH_INFO: `/v3/groups/15bc028d41364b2d835602a2066ef030` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:38.450047 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af03376-cccf-45a7-808a-c9b08669d67b None admin] RBAC: Authorizing `identity:get_group(group_id=15bc028d41364b2d835602a2066ef030)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:38.451497 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af03376-cccf-45a7-808a-c9b08669d67b None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:38.453343 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 207/424] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 28 12:01:38 2022] GET /identity/v3/groups/15bc028d41364b2d835602a2066ef030 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:38.458896 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863cce1-2096-4647-9b07-880e35077521 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:38.485995 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:38.594209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af03376-cccf-45a7-808a-c9b08669d67b None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:38.597204 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863cce1-2096-4647-9b07-880e35077521 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:38.660332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336e6db-5267-4596-ad23-703eb2c1a8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:38.661789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336e6db-5267-4596-ad23-703eb2c1a8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:38.662282 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336e6db-5267-4596-ad23-703eb2c1a8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:38.662693 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336e6db-5267-4596-ad23-703eb2c1a8e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:38.663611 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a336e6db-5267-4596-ad23-703eb2c1a8e4 None admin] RBAC: Adding query filter params (group.id=15bc028d41364b2d835602a2066ef030, role.id=9aa9b054939e4fc1ad0387e43c500693, scope.project.id=0976a5e8d4d942399b8522e367e466ba) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:38.664390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a336e6db-5267-4596-ad23-703eb2c1a8e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:38.666046 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a336e6db-5267-4596-ad23-703eb2c1a8e4 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:38.672746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 218/425] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 28 12:01:38 2022] GET /identity/v3/role_assignments?group.id=15bc028d41364b2d835602a2066ef030&scope.project.id=0976a5e8d4d942399b8522e367e466ba&role.id=9aa9b054939e4fc1ad0387e43c500693 => generated 611 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:38.706502 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:38.779704 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af03376-cccf-45a7-808a-c9b08669d67b None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:38.822079 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96776eb9-6bbd-4604-93cd-3ed89e55410d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:38.823074 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96776eb9-6bbd-4604-93cd-3ed89e55410d None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:38.823556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96776eb9-6bbd-4604-93cd-3ed89e55410d None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:38.824001 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96776eb9-6bbd-4604-93cd-3ed89e55410d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:38.844313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96776eb9-6bbd-4604-93cd-3ed89e55410d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:38.850216 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-96776eb9-6bbd-4604-93cd-3ed89e55410d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:01:38.850216 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:38.850216 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:38.850216 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:38.850216 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:38.850216 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:38.850216 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:38.850216 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:38.850216 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:38.850216 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:38.850216 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:38.850216 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:38.850216 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:38.850216 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:38.850216 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:38.850216 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:38.851187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:38.851187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:38.851187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:38.851187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:38.851187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:38.851187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:38.851187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:38.851187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:38.851187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:38.851187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:38.851187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:38.851187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:38.851187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:38.851187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:38.851187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:38.851187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:38.852028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:38.852028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:38.852028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:38.852028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:38.852028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:38.852028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:38.852028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:38.852028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:38.852028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:38.852028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:38.852028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:01:38.852028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:38.852634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c7e1c-3d77-4846-8813-9108f9a79b5a None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:38.852634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c7e1c-3d77-4846-8813-9108f9a79b5a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:38.852634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c7e1c-3d77-4846-8813-9108f9a79b5a None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:38.852634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 219/426] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:01:38.854420 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 208/427] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 28 12:01:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:38.860037 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c7e1c-3d77-4846-8813-9108f9a79b5a None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:38.865165 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964d4f0-c5f2-4438-80b5-7854d6985962 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:38.865724 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964d4f0-c5f2-4438-80b5-7854d6985962 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:38.866400 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964d4f0-c5f2-4438-80b5-7854d6985962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:38.886440 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-4964d4f0-c5f2-4438-80b5-7854d6985962 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:38.888047 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-4964d4f0-c5f2-4438-80b5-7854d6985962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:38.967233 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:38.990226 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 209/428] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:01:39.011236 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c7e1c-3d77-4846-8813-9108f9a79b5a None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:39.047429 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c900be-821d-435e-93a8-6ea12a22c54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:39.048343 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c900be-821d-435e-93a8-6ea12a22c54d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:39.048793 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c900be-821d-435e-93a8-6ea12a22c54d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:39.049223 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c900be-821d-435e-93a8-6ea12a22c54d None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:39.050094 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c900be-821d-435e-93a8-6ea12a22c54d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:39.050545 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c900be-821d-435e-93a8-6ea12a22c54d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:39.052651 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c900be-821d-435e-93a8-6ea12a22c54d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:39.061532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 220/429] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:01:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:39.067987 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964d4f0-c5f2-4438-80b5-7854d6985962 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:39.128472 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:39.182393 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964d4f0-c5f2-4438-80b5-7854d6985962 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:39.217592 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b28ce7-eef1-482d-a4e9-8abbaef03d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:39.218206 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b28ce7-eef1-482d-a4e9-8abbaef03d01 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:39.218488 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b28ce7-eef1-482d-a4e9-8abbaef03d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:39.218760 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b28ce7-eef1-482d-a4e9-8abbaef03d01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:39.292951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b28ce7-eef1-482d-a4e9-8abbaef03d01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:39.294430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b28ce7-eef1-482d-a4e9-8abbaef03d01 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:39.347810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c900be-821d-435e-93a8-6ea12a22c54d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:39.357624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:39.429689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 210/430] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:01:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:01:39.439753 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b28ce7-eef1-482d-a4e9-8abbaef03d01 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:39.476846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c900be-821d-435e-93a8-6ea12a22c54d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:39.526090 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabfbc4-cb93-4c62-82fc-fe2264912d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:39.526090 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabfbc4-cb93-4c62-82fc-fe2264912d59 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:39.527072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabfbc4-cb93-4c62-82fc-fe2264912d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:39.527376 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabfbc4-cb93-4c62-82fc-fe2264912d59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:39.529938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:39.543488 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabfbc4-cb93-4c62-82fc-fe2264912d59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:39.548533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-ebabfbc4-cb93-4c62-82fc-fe2264912d59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:01:39.548533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:39.548533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:39.548533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:39.548533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:39.548533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:39.548533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:39.548533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:39.548533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:39.548533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:39.548533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:39.548533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:39.548533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:39.548533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:39.548533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:39.548533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:39.549447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:39.549447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:39.549447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:39.549447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:39.549447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:39.549447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:39.549447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:39.549447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:39.549447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:39.549447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:39.549447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:39.549447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:39.549447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:39.549447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:39.549447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:39.549447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:39.550235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:39.550235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:39.550235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:39.550235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:39.550235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:39.550235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:39.550235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:39.550235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:39.550235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:39.550235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:39.550235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:01:39.550235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:39.550235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 221/431] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:01:39.557291 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabfbc4-cb93-4c62-82fc-fe2264912d59 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:39.591380 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b28ce7-eef1-482d-a4e9-8abbaef03d01 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:39.643962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94056d08-7492-4edc-ae24-017491639f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:39.644802 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94056d08-7492-4edc-ae24-017491639f67 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:39.645165 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94056d08-7492-4edc-ae24-017491639f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:39.646073 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94056d08-7492-4edc-ae24-017491639f67 None admin] PATH_INFO: `/v3/projects/0976a5e8d4d942399b8522e367e466ba` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:39.648120 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94056d08-7492-4edc-ae24-017491639f67 None admin] RBAC: Authorizing `identity:get_project(project_id=0976a5e8d4d942399b8522e367e466ba)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:39.650776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94056d08-7492-4edc-ae24-017491639f67 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:39.655520 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 211/432] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:39 2022] GET /identity/v3/projects/0976a5e8d4d942399b8522e367e466ba => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:39.658860 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94056d08-7492-4edc-ae24-017491639f67 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:39.686446 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:39.686624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabfbc4-cb93-4c62-82fc-fe2264912d59 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:39.741697 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6488dc2-85b8-4efc-b08a-ce8c34534211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:39.742533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6488dc2-85b8-4efc-b08a-ce8c34534211 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:39.742818 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6488dc2-85b8-4efc-b08a-ce8c34534211 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:39.743090 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6488dc2-85b8-4efc-b08a-ce8c34534211 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:39.743806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6488dc2-85b8-4efc-b08a-ce8c34534211 None admin] RBAC: Adding query filter params (name=member) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:39.744358 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6488dc2-85b8-4efc-b08a-ce8c34534211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:39.745586 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6488dc2-85b8-4efc-b08a-ce8c34534211 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:39.756598 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 222/433] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:01:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:39.762086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6488dc2-85b8-4efc-b08a-ce8c34534211 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:39.812780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94056d08-7492-4edc-ae24-017491639f67 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:39.841615 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:39.866518 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c6505-7642-48a4-b47e-3fb2fb604245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:39.867184 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c6505-7642-48a4-b47e-3fb2fb604245 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:39.867484 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c6505-7642-48a4-b47e-3fb2fb604245 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:39.867765 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c6505-7642-48a4-b47e-3fb2fb604245 None admin] PATH_INFO: `/v3/groups/15bc028d41364b2d835602a2066ef030` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:39.868899 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c6505-7642-48a4-b47e-3fb2fb604245 None admin] RBAC: Authorizing `identity:get_group(group_id=15bc028d41364b2d835602a2066ef030)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:39.870333 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c6505-7642-48a4-b47e-3fb2fb604245 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:39.872254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 212/434] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 28 12:01:39 2022] GET /identity/v3/groups/15bc028d41364b2d835602a2066ef030 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:39.878961 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c6505-7642-48a4-b47e-3fb2fb604245 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:39.898979 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6488dc2-85b8-4efc-b08a-ce8c34534211 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:39.937007 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9779e-c23f-43ae-b956-734d6bdbecf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:39.937618 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9779e-c23f-43ae-b956-734d6bdbecf5 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:39.937896 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9779e-c23f-43ae-b956-734d6bdbecf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:39.938166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9779e-c23f-43ae-b956-734d6bdbecf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:39.972557 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:39.987966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c6505-7642-48a4-b47e-3fb2fb604245 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:40.006489 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9779e-c23f-43ae-b956-734d6bdbecf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:40.007975 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9779e-c23f-43ae-b956-734d6bdbecf5 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:40.021317 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1eac4f-a609-4fa7-8efa-96e2792f9844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:40.021914 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1eac4f-a609-4fa7-8efa-96e2792f9844 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:40.022186 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1eac4f-a609-4fa7-8efa-96e2792f9844 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:40.022452 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1eac4f-a609-4fa7-8efa-96e2792f9844 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:40.023208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1eac4f-a609-4fa7-8efa-96e2792f9844 None admin] RBAC: Adding query filter params (group.id=15bc028d41364b2d835602a2066ef030, role.id=67ed180941fd45af996b858232628221, scope.project.id=0976a5e8d4d942399b8522e367e466ba) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:40.023537 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1eac4f-a609-4fa7-8efa-96e2792f9844 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:40.024936 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1eac4f-a609-4fa7-8efa-96e2792f9844 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:40.030489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 213/435] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 28 12:01:39 2022] GET /identity/v3/role_assignments?group.id=15bc028d41364b2d835602a2066ef030&scope.project.id=0976a5e8d4d942399b8522e367e466ba&role.id=67ed180941fd45af996b858232628221 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:40.031628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751aef9-c0d3-4514-92ff-23d05409a13b None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:40.031906 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751aef9-c0d3-4514-92ff-23d05409a13b None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:40.032177 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751aef9-c0d3-4514-92ff-23d05409a13b None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:40.033358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 214/436] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:40.037692 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74fcc9-f70b-49a9-b4fa-505c90e849d8 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:40.037692 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74fcc9-f70b-49a9-b4fa-505c90e849d8 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:40.037692 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74fcc9-f70b-49a9-b4fa-505c90e849d8 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:40.037692 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 215/437] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:40.041841 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f050e0-e81d-4afa-b379-9bafdb2dfb83 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:40.042124 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f050e0-e81d-4afa-b379-9bafdb2dfb83 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:40.042390 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f050e0-e81d-4afa-b379-9bafdb2dfb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:40.061680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-e2f050e0-e81d-4afa-b379-9bafdb2dfb83 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:40.062918 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-e2f050e0-e81d-4afa-b379-9bafdb2dfb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:40.076586 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:40.132496 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 223/438] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:01:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 28 12:01:40.133775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b500d-b1fb-4d2a-9d13-e0c4026c15ac None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:40.134060 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b500d-b1fb-4d2a-9d13-e0c4026c15ac None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:40.134328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b500d-b1fb-4d2a-9d13-e0c4026c15ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:40.142883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 216/439] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:40.144165 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f050e0-e81d-4afa-b379-9bafdb2dfb83 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:40.156612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-9b4b500d-b1fb-4d2a-9d13-e0c4026c15ac None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:40.159209 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9b4b500d-b1fb-4d2a-9d13-e0c4026c15ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:40.248480 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 224/440] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:40.250790 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:40.271366 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f050e0-e81d-4afa-b379-9bafdb2dfb83 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:40.308761 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707944bd-683d-42ad-8042-a9ae1b223a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:40.309397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707944bd-683d-42ad-8042-a9ae1b223a2f None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:40.309675 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707944bd-683d-42ad-8042-a9ae1b223a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:40.309946 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707944bd-683d-42ad-8042-a9ae1b223a2f None admin] PATH_INFO: `/v3/projects/6f1f0a0a8c824d639602043911e34bb5` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:40.311073 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707944bd-683d-42ad-8042-a9ae1b223a2f None admin] RBAC: Authorizing `identity:get_project(project_id=6f1f0a0a8c824d639602043911e34bb5)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:40.312566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707944bd-683d-42ad-8042-a9ae1b223a2f None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:40.314688 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 217/441] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:40 2022] GET /identity/v3/projects/6f1f0a0a8c824d639602043911e34bb5 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:40.320541 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b500d-b1fb-4d2a-9d13-e0c4026c15ac None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:40.417684 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:40.429806 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707944bd-683d-42ad-8042-a9ae1b223a2f None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:40.436270 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b500d-b1fb-4d2a-9d13-e0c4026c15ac None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:40.489728 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9593810-55b4-4c65-a4fe-301e6e0f74cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:40.490655 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9593810-55b4-4c65-a4fe-301e6e0f74cd None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:40.491209 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9593810-55b4-4c65-a4fe-301e6e0f74cd None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:40.491509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9593810-55b4-4c65-a4fe-301e6e0f74cd None admin] PATH_INFO: `/v3/groups/15bc028d41364b2d835602a2066ef030` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:40.492697 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9593810-55b4-4c65-a4fe-301e6e0f74cd None admin] RBAC: Authorizing `identity:get_group(group_id=15bc028d41364b2d835602a2066ef030)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:40.494139 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9593810-55b4-4c65-a4fe-301e6e0f74cd None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:40.496587 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 225/442] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 28 12:01:40 2022] GET /identity/v3/groups/15bc028d41364b2d835602a2066ef030 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:40.501781 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9593810-55b4-4c65-a4fe-301e6e0f74cd None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:40.555647 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707944bd-683d-42ad-8042-a9ae1b223a2f None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:40.589345 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff15317-62ea-41be-aae9-6bd92db11705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:40.589969 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff15317-62ea-41be-aae9-6bd92db11705 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:40.590246 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff15317-62ea-41be-aae9-6bd92db11705 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:40.590516 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff15317-62ea-41be-aae9-6bd92db11705 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:40.600829 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff15317-62ea-41be-aae9-6bd92db11705 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:40.605572 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9593810-55b4-4c65-a4fe-301e6e0f74cd None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:40.605706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-6ff15317-62ea-41be-aae9-6bd92db11705 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:01:40.605706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:40.605706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:40.605706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:40.605706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:40.605706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:40.605706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:40.605706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:40.605706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:40.605706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:40.605706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:40.605706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:40.605706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:40.605706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:40.605706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:40.605706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:40.606689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:40.606689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:40.606689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:40.606689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:40.606689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:40.606689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:40.606689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:40.606689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:40.606689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:40.606689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:40.606689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:40.606689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:40.606689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:40.606689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:40.606689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:40.606689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:40.607542 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:40.607542 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:40.607542 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:40.607542 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:40.607542 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:40.607542 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:40.607542 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:40.607542 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:40.607542 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:40.607542 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:40.607542 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:01:40.607542 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:40.607542 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 218/443] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 28 12:01:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:01:40.608201 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff15317-62ea-41be-aae9-6bd92db11705 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:40.619583 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:40.643674 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65faae93-344a-46a4-b71c-bd7256f4bdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:40.644280 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65faae93-344a-46a4-b71c-bd7256f4bdfc None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:40.644563 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65faae93-344a-46a4-b71c-bd7256f4bdfc None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:40.644858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65faae93-344a-46a4-b71c-bd7256f4bdfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:40.645583 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65faae93-344a-46a4-b71c-bd7256f4bdfc None admin] RBAC: Adding query filter params (group.id=15bc028d41364b2d835602a2066ef030, role.id=9aa9b054939e4fc1ad0387e43c500693, scope.project.id=6f1f0a0a8c824d639602043911e34bb5) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:40.645891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65faae93-344a-46a4-b71c-bd7256f4bdfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:40.647322 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65faae93-344a-46a4-b71c-bd7256f4bdfc None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:40.653184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 226/444] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 28 12:01:40 2022] GET /identity/v3/role_assignments?group.id=15bc028d41364b2d835602a2066ef030&scope.project.id=6f1f0a0a8c824d639602043911e34bb5&role.id=9aa9b054939e4fc1ad0387e43c500693 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:40.653864 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65faae93-344a-46a4-b71c-bd7256f4bdfc None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:40.686069 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:40.718156 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff15317-62ea-41be-aae9-6bd92db11705 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:40.760902 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d5f20-fb20-47c2-b596-d09f55b6214b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:40.761638 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d5f20-fb20-47c2-b596-d09f55b6214b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:40.761901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d5f20-fb20-47c2-b596-d09f55b6214b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:40.762094 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d5f20-fb20-47c2-b596-d09f55b6214b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:40.775176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d5f20-fb20-47c2-b596-d09f55b6214b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:40.782178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-b11d5f20-fb20-47c2-b596-d09f55b6214b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:01:40.782178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:40.782178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:40.782178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:40.782178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:40.782178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:40.782178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:40.782178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:40.782178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:40.782178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:40.782178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:40.782178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:40.782178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:40.782178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:40.782178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:40.782178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:40.783161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:40.783161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:40.783161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:40.783161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:40.783161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:40.783161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:40.783161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:40.783161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:40.783161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:40.783161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:40.783161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:40.783161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:40.783161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:40.783161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:40.783161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:40.783161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:40.784553 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:40.784553 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:40.784553 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:40.784553 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:40.784553 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:40.784553 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:40.784553 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:40.784553 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:40.784553 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:40.784553 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:40.784553 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:01:40.784553 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:40.785166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65faae93-344a-46a4-b71c-bd7256f4bdfc None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:40.785239 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 219/445] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:01:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:40.791259 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d5f20-fb20-47c2-b596-d09f55b6214b None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:40.821304 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db9bfb-faf8-4d2a-87db-bcd4a6915041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:40.821925 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db9bfb-faf8-4d2a-87db-bcd4a6915041 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:40.822204 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db9bfb-faf8-4d2a-87db-bcd4a6915041 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:40.822478 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db9bfb-faf8-4d2a-87db-bcd4a6915041 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:40.823136 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db9bfb-faf8-4d2a-87db-bcd4a6915041 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:40.823463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db9bfb-faf8-4d2a-87db-bcd4a6915041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:40.824845 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db9bfb-faf8-4d2a-87db-bcd4a6915041 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:40.834878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 227/446] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:01:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:40.840238 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db9bfb-faf8-4d2a-87db-bcd4a6915041 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:40.868215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:40.902950 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d5f20-fb20-47c2-b596-d09f55b6214b None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:40.938632 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:40.944727 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2bb9b-5f1b-4357-aad7-ad0caef2cca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:40.945338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2bb9b-5f1b-4357-aad7-ad0caef2cca0 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:40.945615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2bb9b-5f1b-4357-aad7-ad0caef2cca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:40.945885 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2bb9b-5f1b-4357-aad7-ad0caef2cca0 None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:40.946546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2bb9b-5f1b-4357-aad7-ad0caef2cca0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:40.946846 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2bb9b-5f1b-4357-aad7-ad0caef2cca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:40.948335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2bb9b-5f1b-4357-aad7-ad0caef2cca0 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:40.957947 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 220/447] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:40.964018 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2bb9b-5f1b-4357-aad7-ad0caef2cca0 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:40.970688 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db9bfb-faf8-4d2a-87db-bcd4a6915041 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:41.010051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95604054-7ccc-4cb9-926d-c213228402d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:41.010664 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95604054-7ccc-4cb9-926d-c213228402d8 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:41.010938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95604054-7ccc-4cb9-926d-c213228402d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:41.011211 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95604054-7ccc-4cb9-926d-c213228402d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:41.084345 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2bb9b-5f1b-4357-aad7-ad0caef2cca0 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:41.087016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95604054-7ccc-4cb9-926d-c213228402d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:41.088623 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95604054-7ccc-4cb9-926d-c213228402d8 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:41.114279 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:41.120876 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb1491-7d04-47ee-ada3-679d4018706f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:41.121698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb1491-7d04-47ee-ada3-679d4018706f None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:41.121977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb1491-7d04-47ee-ada3-679d4018706f None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:41.122249 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb1491-7d04-47ee-ada3-679d4018706f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:41.166793 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:41.187073 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 228/448] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:01:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 28 12:01:41.193272 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95604054-7ccc-4cb9-926d-c213228402d8 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:41.195341 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb1491-7d04-47ee-ada3-679d4018706f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:41.196907 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb1491-7d04-47ee-ada3-679d4018706f None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:41.291065 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95604054-7ccc-4cb9-926d-c213228402d8 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:41.294183 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 221/449] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:01:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 28 12:01:41.299699 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb1491-7d04-47ee-ada3-679d4018706f None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:41.327944 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24378c2-8dc8-4136-b953-d066671a606c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:41.328700 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24378c2-8dc8-4136-b953-d066671a606c None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:41.329024 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24378c2-8dc8-4136-b953-d066671a606c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:41.329335 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24378c2-8dc8-4136-b953-d066671a606c None admin] PATH_INFO: `/v3/projects/6f1f0a0a8c824d639602043911e34bb5` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:41.330525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24378c2-8dc8-4136-b953-d066671a606c None admin] RBAC: Authorizing `identity:get_project(project_id=6f1f0a0a8c824d639602043911e34bb5)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:41.331994 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24378c2-8dc8-4136-b953-d066671a606c None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:41.332451 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:41.333954 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 229/450] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:41 2022] GET /identity/v3/projects/6f1f0a0a8c824d639602043911e34bb5 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:41.339528 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24378c2-8dc8-4136-b953-d066671a606c None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:41.390041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:41.406928 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb1491-7d04-47ee-ada3-679d4018706f None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:41.440079 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6d693-b3c3-4bd6-a864-66d6d3e65784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:41.440747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6d693-b3c3-4bd6-a864-66d6d3e65784 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:41.441029 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6d693-b3c3-4bd6-a864-66d6d3e65784 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:41.441294 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6d693-b3c3-4bd6-a864-66d6d3e65784 None admin] PATH_INFO: `/v3/projects/041bf4405bd541158bdb50b4fa9874e6` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:41.442860 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24378c2-8dc8-4136-b953-d066671a606c None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:41.442987 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6d693-b3c3-4bd6-a864-66d6d3e65784 None admin] RBAC: Authorizing `identity:get_project(project_id=041bf4405bd541158bdb50b4fa9874e6)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:41.444470 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6d693-b3c3-4bd6-a864-66d6d3e65784 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:41.446017 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 222/451] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:01:41 2022] GET /identity/v3/projects/041bf4405bd541158bdb50b4fa9874e6 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:41.451497 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6d693-b3c3-4bd6-a864-66d6d3e65784 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:41.475617 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0878e-0ea5-4a26-9e59-57517f50e0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:41.476248 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0878e-0ea5-4a26-9e59-57517f50e0d4 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:41.476525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0878e-0ea5-4a26-9e59-57517f50e0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:41.476794 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0878e-0ea5-4a26-9e59-57517f50e0d4 None admin] PATH_INFO: `/v3/groups/15bc028d41364b2d835602a2066ef030` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:41.477903 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0878e-0ea5-4a26-9e59-57517f50e0d4 None admin] RBAC: Authorizing `identity:get_group(group_id=15bc028d41364b2d835602a2066ef030)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:41.479321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0878e-0ea5-4a26-9e59-57517f50e0d4 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:41.480913 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 230/452] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 28 12:01:41 2022] GET /identity/v3/groups/15bc028d41364b2d835602a2066ef030 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:41.486662 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0878e-0ea5-4a26-9e59-57517f50e0d4 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:41.544879 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:41.548769 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6d693-b3c3-4bd6-a864-66d6d3e65784 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:41.582883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa6ef4-9b89-41f5-9d7f-6963069f5deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:41.583519 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa6ef4-9b89-41f5-9d7f-6963069f5deb None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:41.583795 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa6ef4-9b89-41f5-9d7f-6963069f5deb None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:41.584060 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa6ef4-9b89-41f5-9d7f-6963069f5deb None admin] PATH_INFO: `/v3/groups/8db74032c4b044b1a3348672e4389a4b` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:41.584884 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0878e-0ea5-4a26-9e59-57517f50e0d4 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:41.585316 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa6ef4-9b89-41f5-9d7f-6963069f5deb None admin] RBAC: Authorizing `identity:get_group(group_id=8db74032c4b044b1a3348672e4389a4b)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:41.586591 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa6ef4-9b89-41f5-9d7f-6963069f5deb None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:41.588173 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 223/453] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 28 12:01:41 2022] GET /identity/v3/groups/8db74032c4b044b1a3348672e4389a4b => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:41.593801 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa6ef4-9b89-41f5-9d7f-6963069f5deb None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:41.601736 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:41.622443 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de216840-164f-44b0-9199-d2c3222a4988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:41.623076 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de216840-164f-44b0-9199-d2c3222a4988 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:41.623357 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de216840-164f-44b0-9199-d2c3222a4988 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:41.623657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de216840-164f-44b0-9199-d2c3222a4988 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:41.624405 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de216840-164f-44b0-9199-d2c3222a4988 None admin] RBAC: Adding query filter params (group.id=15bc028d41364b2d835602a2066ef030, role.id=67ed180941fd45af996b858232628221, scope.project.id=6f1f0a0a8c824d639602043911e34bb5) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:41.624715 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de216840-164f-44b0-9199-d2c3222a4988 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:41.626135 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de216840-164f-44b0-9199-d2c3222a4988 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:41.632378 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 231/454] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 28 12:01:41 2022] GET /identity/v3/role_assignments?group.id=15bc028d41364b2d835602a2066ef030&scope.project.id=6f1f0a0a8c824d639602043911e34bb5&role.id=67ed180941fd45af996b858232628221 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:41.701589 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa6ef4-9b89-41f5-9d7f-6963069f5deb None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:41.740360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb7477-4d4f-4e1f-b9fa-c6b29541e7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:41.741251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb7477-4d4f-4e1f-b9fa-c6b29541e7f7 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:41.741528 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb7477-4d4f-4e1f-b9fa-c6b29541e7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:41.741799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb7477-4d4f-4e1f-b9fa-c6b29541e7f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:41.742535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb7477-4d4f-4e1f-b9fa-c6b29541e7f7 None admin] RBAC: Adding query filter params (group.id=8db74032c4b044b1a3348672e4389a4b, role.id=66456d39fc0c496c8f290a436b726216, scope.project.id=041bf4405bd541158bdb50b4fa9874e6) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:41.742840 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb7477-4d4f-4e1f-b9fa-c6b29541e7f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:41.744319 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb7477-4d4f-4e1f-b9fa-c6b29541e7f7 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:41.750684 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 224/455] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 28 12:01:41 2022] GET /identity/v3/role_assignments?group.id=8db74032c4b044b1a3348672e4389a4b&scope.project.id=041bf4405bd541158bdb50b4fa9874e6&role.id=66456d39fc0c496c8f290a436b726216 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:44.641411 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980206a-80cd-4f37-9816-4ad7e84f4646 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:44.642454 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980206a-80cd-4f37-9816-4ad7e84f4646 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:44.642941 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980206a-80cd-4f37-9816-4ad7e84f4646 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:44.644497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 232/456] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:44.650569 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912151d-520f-4479-a65a-6f3bc26e3458 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:44.651375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912151d-520f-4479-a65a-6f3bc26e3458 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:44.651877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912151d-520f-4479-a65a-6f3bc26e3458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:44.680448 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-2912151d-520f-4479-a65a-6f3bc26e3458 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:44.681983 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-2912151d-520f-4479-a65a-6f3bc26e3458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:44.703691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0731da-52b4-4f52-b943-d63fda1dd95b None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:44.706501 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0731da-52b4-4f52-b943-d63fda1dd95b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:44.706999 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0731da-52b4-4f52-b943-d63fda1dd95b None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:44.708683 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 233/457] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:44.714851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e2ed0-a40f-4fd8-b335-aa744c9f95b4 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:44.715154 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e2ed0-a40f-4fd8-b335-aa744c9f95b4 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:44.715420 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e2ed0-a40f-4fd8-b335-aa744c9f95b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:44.724794 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:44.739527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-337e2ed0-a40f-4fd8-b335-aa744c9f95b4 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:44.740734 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-337e2ed0-a40f-4fd8-b335-aa744c9f95b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:44.784150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 225/458] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:44.786160 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c1485-4ce1-4844-8398-a2beb3bcb77f None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:44.786440 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c1485-4ce1-4844-8398-a2beb3bcb77f None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:44.786712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c1485-4ce1-4844-8398-a2beb3bcb77f None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:44.792031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 226/459] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:44.793789 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e6f16-cefb-4ff6-90be-a20703dacb40 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:44.794304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e6f16-cefb-4ff6-90be-a20703dacb40 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:44.794784 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e6f16-cefb-4ff6-90be-a20703dacb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:44.823090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-022e6f16-cefb-4ff6-90be-a20703dacb40 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:44.824758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-022e6f16-cefb-4ff6-90be-a20703dacb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:44.855182 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 234/460] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:01:44.930787 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 227/461] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:01:45.109983 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e2ed0-a40f-4fd8-b335-aa744c9f95b4 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:45.137613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e6f16-cefb-4ff6-90be-a20703dacb40 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:45.240004 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e2ed0-a40f-4fd8-b335-aa744c9f95b4 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:45.248025 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:45.256177 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:45.260477 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e6f16-cefb-4ff6-90be-a20703dacb40 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:45.284296 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738d257-d4c2-48a8-bccd-fe3470cd5578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:45.285540 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738d257-d4c2-48a8-bccd-fe3470cd5578 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:45.285824 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738d257-d4c2-48a8-bccd-fe3470cd5578 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:45.286175 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738d257-d4c2-48a8-bccd-fe3470cd5578 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:45.296567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738d257-d4c2-48a8-bccd-fe3470cd5578 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:45.298018 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738d257-d4c2-48a8-bccd-fe3470cd5578 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:45.299076 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363a98a-a827-443f-8909-2589f5553a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:45.299769 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363a98a-a827-443f-8909-2589f5553a58 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:45.300046 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363a98a-a827-443f-8909-2589f5553a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:45.300313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363a98a-a827-443f-8909-2589f5553a58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:45.311401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363a98a-a827-443f-8909-2589f5553a58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:45.312895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363a98a-a827-443f-8909-2589f5553a58 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:45.313891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-7738d257-d4c2-48a8-bccd-fe3470cd5578 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:45.313891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:45.313891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:45.313891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:45.313891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:45.313891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:45.313891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:45.313891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:45.313891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:45.313891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:45.313891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:45.313891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:45.313891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:01:45.313891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:01:45.313891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:01:45.313891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:01:45.314776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:45.314776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:45.314776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:45.314776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:45.314776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:45.314776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:45.314776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:45.314776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:45.314776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:45.314776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:45.314776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:45.314776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:45.314776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:45.314776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:45.314776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:45.314776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:45.314776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:01:45.316218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:01:45.316218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:45.316218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:45.316218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 235/462] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:45.316614 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8b9be-bf62-4f2a-b668-3cc11e520971 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:45.316920 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8b9be-bf62-4f2a-b668-3cc11e520971 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:45.317194 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8b9be-bf62-4f2a-b668-3cc11e520971 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:45.318581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 236/463] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:45.319118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8b9be-bf62-4f2a-b668-3cc11e520971 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:45.329474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-2363a98a-a827-443f-8909-2589f5553a58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:45.329474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:45.329474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:45.329474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:45.329474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:45.329474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:45.329474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:45.329474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:45.329474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:45.329474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:45.329474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:45.329474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:45.329474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:01:45.329474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:01:45.329474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:01:45.329474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:01:45.330595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:45.330595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:45.330595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:45.330595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:45.330595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:45.330595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:45.330595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:45.330595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:45.330595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:45.330595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:45.330595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:45.330595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:45.330595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:45.330595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:45.330595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:45.330595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:45.330595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:01:45.336449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:01:45.336449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:45.336449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:45.336449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 228/464] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:45.336449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd6a34-a456-4df7-92a9-93d8f9dea957 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:45.336449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd6a34-a456-4df7-92a9-93d8f9dea957 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:45.336449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd6a34-a456-4df7-92a9-93d8f9dea957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:45.353184 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-cacd6a34-a456-4df7-92a9-93d8f9dea957 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:45.354379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-cacd6a34-a456-4df7-92a9-93d8f9dea957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:45.422998 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 229/465] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:45.423877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd6a34-a456-4df7-92a9-93d8f9dea957 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:45.442401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8b9be-bf62-4f2a-b668-3cc11e520971 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:45.483839 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3675a76-6ce2-49da-9b90-a193a909c2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:45.484474 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3675a76-6ce2-49da-9b90-a193a909c2d6 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:45.484757 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3675a76-6ce2-49da-9b90-a193a909c2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:45.485021 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3675a76-6ce2-49da-9b90-a193a909c2d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:45.498530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3675a76-6ce2-49da-9b90-a193a909c2d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:45.500615 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3675a76-6ce2-49da-9b90-a193a909c2d6 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:45.510710 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:45.517906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-a3675a76-6ce2-49da-9b90-a193a909c2d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:45.517906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:45.517906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:45.517906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:45.517906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:45.517906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:45.517906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:45.517906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:45.517906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:45.517906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:45.517906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:45.517906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:45.517906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:01:45.517906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:01:45.517906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:01:45.517906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:01:45.518820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:45.518820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:45.518820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:45.518820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:45.518820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:45.518820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:45.518820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:45.518820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:45.518820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:45.518820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:45.518820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:45.518820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:45.518820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:45.518820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:45.518820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:45.518820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:45.518820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:01:45.520642 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:01:45.520642 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:45.520642 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:45.520642 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 237/466] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:45.520642 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3675a76-6ce2-49da-9b90-a193a909c2d6 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:45.540388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:45.549045 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd6a34-a456-4df7-92a9-93d8f9dea957 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:45.594833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d231c-b8d8-4730-bccc-6473c25e3b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:45.596006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d231c-b8d8-4730-bccc-6473c25e3b36 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:45.596760 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d231c-b8d8-4730-bccc-6473c25e3b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:45.597248 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d231c-b8d8-4730-bccc-6473c25e3b36 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:45.599531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d231c-b8d8-4730-bccc-6473c25e3b36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:45.599877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d231c-b8d8-4730-bccc-6473c25e3b36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:45.601548 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d231c-b8d8-4730-bccc-6473c25e3b36 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:45.621686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 230/467] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:45.623557 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d231c-b8d8-4730-bccc-6473c25e3b36 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:45.645368 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3675a76-6ce2-49da-9b90-a193a909c2d6 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:45.690283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab01bd6-5db0-4039-aa2e-398d0f0ef3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:45.691226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab01bd6-5db0-4039-aa2e-398d0f0ef3d7 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:45.692270 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab01bd6-5db0-4039-aa2e-398d0f0ef3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:45.692737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab01bd6-5db0-4039-aa2e-398d0f0ef3d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:45.693573 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab01bd6-5db0-4039-aa2e-398d0f0ef3d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:45.694091 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab01bd6-5db0-4039-aa2e-398d0f0ef3d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:45.695689 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab01bd6-5db0-4039-aa2e-398d0f0ef3d7 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:45.719519 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 238/468] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:45.719519 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab01bd6-5db0-4039-aa2e-398d0f0ef3d7 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:45.740301 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d231c-b8d8-4730-bccc-6473c25e3b36 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:45.772818 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:45.778575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329381b9-7fc3-4b41-b1d7-d81a9b5beb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:45.779936 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329381b9-7fc3-4b41-b1d7-d81a9b5beb87 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:45.779936 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329381b9-7fc3-4b41-b1d7-d81a9b5beb87 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:45.780227 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329381b9-7fc3-4b41-b1d7-d81a9b5beb87 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:45.780871 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329381b9-7fc3-4b41-b1d7-d81a9b5beb87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:45.781174 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329381b9-7fc3-4b41-b1d7-d81a9b5beb87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:45.782529 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329381b9-7fc3-4b41-b1d7-d81a9b5beb87 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:45.795071 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 231/469] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:45.795885 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329381b9-7fc3-4b41-b1d7-d81a9b5beb87 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:45.808314 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:45.837890 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab01bd6-5db0-4039-aa2e-398d0f0ef3d7 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:45.877533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f6ff7-83a5-41a4-91cc-04cbe321808b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:45.878320 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f6ff7-83a5-41a4-91cc-04cbe321808b None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:45.878688 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f6ff7-83a5-41a4-91cc-04cbe321808b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:45.879057 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f6ff7-83a5-41a4-91cc-04cbe321808b None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:45.879818 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f6ff7-83a5-41a4-91cc-04cbe321808b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:45.881267 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f6ff7-83a5-41a4-91cc-04cbe321808b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:45.903051 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329381b9-7fc3-4b41-b1d7-d81a9b5beb87 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:45.911723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 239/470] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 28 12:01:45 2022] POST /identity/v3/users => generated 246 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:01:45.911723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f6ff7-83a5-41a4-91cc-04cbe321808b None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:45.962928 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c6f8b-ea65-43c6-a529-e0f3d5847a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:45.964131 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c6f8b-ea65-43c6-a529-e0f3d5847a74 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:45.964131 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c6f8b-ea65-43c6-a529-e0f3d5847a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:45.964131 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c6f8b-ea65-43c6-a529-e0f3d5847a74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:45.976878 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c6f8b-ea65-43c6-a529-e0f3d5847a74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:45.978362 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c6f8b-ea65-43c6-a529-e0f3d5847a74 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:45.995357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-516c6f8b-ea65-43c6-a529-e0f3d5847a74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:45.995357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:45.995357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:45.995357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:45.995357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:45.995357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:45.995357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:45.995357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:45.995357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:45.995357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:45.995357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:45.995357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:45.995357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:01:45.995357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:01:45.995357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:01:45.995357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:01:45.996540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:45.996540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:45.996540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:45.996540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:45.996540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:45.996540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:45.996540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:45.996540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:45.996540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:45.996540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:45.996540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:45.996540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:45.996540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:45.996540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:45.996540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:45.996540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:45.996540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:01:45.997401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:01:45.997401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:45.997401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:45.997401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 232/471] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:45.997401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c6f8b-ea65-43c6-a529-e0f3d5847a74 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:46.044660 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f6ff7-83a5-41a4-91cc-04cbe321808b None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:46.048036 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:46.077003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:46.086593 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf2744-45e1-4b77-8062-da64d6f692d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:46.087861 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf2744-45e1-4b77-8062-da64d6f692d9 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:46.088360 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf2744-45e1-4b77-8062-da64d6f692d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:46.088638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf2744-45e1-4b77-8062-da64d6f692d9 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:46.089289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf2744-45e1-4b77-8062-da64d6f692d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:46.090733 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf2744-45e1-4b77-8062-da64d6f692d9 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:46.109323 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c6f8b-ea65-43c6-a529-e0f3d5847a74 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:46.118132 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 240/472] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 28 12:01:45 2022] POST /identity/v3/users => generated 248 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:01:46.119376 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d370d1-c826-4b87-90c3-dbced2cc9c8b None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:46.120325 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d370d1-c826-4b87-90c3-dbced2cc9c8b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:46.120325 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d370d1-c826-4b87-90c3-dbced2cc9c8b None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:46.121786 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 241/473] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:46.122175 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d370d1-c826-4b87-90c3-dbced2cc9c8b None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:46.167797 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb431b59-eddd-49af-81b6-22fb0d240e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:46.167797 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb431b59-eddd-49af-81b6-22fb0d240e86 None admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:46.167797 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb431b59-eddd-49af-81b6-22fb0d240e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:46.168120 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb431b59-eddd-49af-81b6-22fb0d240e86 None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:46.168631 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb431b59-eddd-49af-81b6-22fb0d240e86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:46.170264 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb431b59-eddd-49af-81b6-22fb0d240e86 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:46.203466 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 233/474] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 28 12:01:45 2022] POST /identity/v3/users => generated 248 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:01:46.203466 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aff318-96d6-492f-87fc-90cb521c0019 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:46.203466 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aff318-96d6-492f-87fc-90cb521c0019 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:46.203466 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aff318-96d6-492f-87fc-90cb521c0019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:46.220449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-f9aff318-96d6-492f-87fc-90cb521c0019 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:46.221712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-f9aff318-96d6-492f-87fc-90cb521c0019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:46.281306 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d370d1-c826-4b87-90c3-dbced2cc9c8b None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:46.341985 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 234/475] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:46.345212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd39e7-d86d-48df-ba1c-ced04fe75470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:46.345827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd39e7-d86d-48df-ba1c-ced04fe75470 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:46.346104 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd39e7-d86d-48df-ba1c-ced04fe75470 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:46.346372 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd39e7-d86d-48df-ba1c-ced04fe75470 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:46.347080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd39e7-d86d-48df-ba1c-ced04fe75470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:46.347382 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd39e7-d86d-48df-ba1c-ced04fe75470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:46.349361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd39e7-d86d-48df-ba1c-ced04fe75470 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:46.363007 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 242/476] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:46.368556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aff318-96d6-492f-87fc-90cb521c0019 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:46.407931 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:46.482626 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aff318-96d6-492f-87fc-90cb521c0019 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:46.519733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf57131-21a6-4458-b279-348eaa8774d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:46.520638 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf57131-21a6-4458-b279-348eaa8774d2 None admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:46.521081 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf57131-21a6-4458-b279-348eaa8774d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:46.521521 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf57131-21a6-4458-b279-348eaa8774d2 None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:46.522344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf57131-21a6-4458-b279-348eaa8774d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:46.523996 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf57131-21a6-4458-b279-348eaa8774d2 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:46.549265 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 235/477] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 28 12:01:46 2022] POST /identity/v3/users => generated 249 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:01:46.632478 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd39e7-d86d-48df-ba1c-ced04fe75470 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:46.686049 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:46.747384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd39e7-d86d-48df-ba1c-ced04fe75470 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:46.785373 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1883ad-3ca9-494e-b887-258e4c7206fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:46.785983 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1883ad-3ca9-494e-b887-258e4c7206fa None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:46.786257 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1883ad-3ca9-494e-b887-258e4c7206fa None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:46.786531 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1883ad-3ca9-494e-b887-258e4c7206fa None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:46.787268 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1883ad-3ca9-494e-b887-258e4c7206fa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:46.788657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1883ad-3ca9-494e-b887-258e4c7206fa None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:46.796445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.sql.core [None req-ed1883ad-3ca9-494e-b887-258e4c7206fa None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 28 12:01:46.796445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 28 12:01:46.796445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [parameters: {'id': '5322cb3ebf0b4ff687181906e746ed25', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 28 12:01:46.796445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81598) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 28 12:01:46.813805 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-ed1883ad-3ca9-494e-b887-258e4c7206fa None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 28 12:01:46.813805 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:46.813805 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 28 12:01:46.813805 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 28 12:01:46.813805 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 28 12:01:46.813805 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 28 12:01:46.813805 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 28 12:01:46.813805 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application result = self._query(query) Sep 28 12:01:46.813805 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 28 12:01:46.813805 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application conn.query(q) Sep 28 12:01:46.813805 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 28 12:01:46.813805 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 28 12:01:46.813805 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 28 12:01:46.813805 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application result.read() Sep 28 12:01:46.813805 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 28 12:01:46.814760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 28 12:01:46.814760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 28 12:01:46.814760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 28 12:01:46.814760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 28 12:01:46.814760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 28 12:01:46.814760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 28 12:01:46.814760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 28 12:01:46.814760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 28 12:01:46.814760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:46.814760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 28 12:01:46.814760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:46.814760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:46.814760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 28 12:01:46.814760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 28 12:01:46.814760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 28 12:01:46.814760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return ref.to_dict() Sep 28 12:01:46.814760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 28 12:01:46.814760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application next(self.gen) Sep 28 12:01:46.816156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 28 12:01:46.816156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application yield resource Sep 28 12:01:46.816156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 28 12:01:46.816156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application next(self.gen) Sep 28 12:01:46.816156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 28 12:01:46.816156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self.session.rollback() Sep 28 12:01:46.816156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 28 12:01:46.816156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self.force_reraise() Sep 28 12:01:46.816156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 28 12:01:46.816156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise self.value Sep 28 12:01:46.816156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 28 12:01:46.816156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 28 12:01:46.816156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 28 12:01:46.816156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application session.commit() Sep 28 12:01:46.816156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 28 12:01:46.816156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 28 12:01:46.816156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 28 12:01:46.817837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._prepare_impl() Sep 28 12:01:46.817837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 28 12:01:46.817837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self.session.flush() Sep 28 12:01:46.817837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 28 12:01:46.817837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._flush(objects) Sep 28 12:01:46.817837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 28 12:01:46.817837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 28 12:01:46.817837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 28 12:01:46.817837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application compat.raise_( Sep 28 12:01:46.817837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 28 12:01:46.817837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception Sep 28 12:01:46.817837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 28 12:01:46.817837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application flush_context.execute() Sep 28 12:01:46.817837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 28 12:01:46.817837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rec.execute(self) Sep 28 12:01:46.817837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 28 12:01:46.817837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 28 12:01:46.818810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 28 12:01:46.818810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 28 12:01:46.818810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 28 12:01:46.818810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 28 12:01:46.818810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 28 12:01:46.818810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 28 12:01:46.818810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 28 12:01:46.818810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 28 12:01:46.818810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 28 12:01:46.818810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 28 12:01:46.818810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 28 12:01:46.818810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 28 12:01:46.818810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 28 12:01:46.818810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 28 12:01:46.818810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 28 12:01:46.818810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception Sep 28 12:01:46.819679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 28 12:01:46.819679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 28 12:01:46.819679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 28 12:01:46.819679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 28 12:01:46.819679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 28 12:01:46.819679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application result = self._query(query) Sep 28 12:01:46.819679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 28 12:01:46.819679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application conn.query(q) Sep 28 12:01:46.819679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 28 12:01:46.819679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 28 12:01:46.819679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 28 12:01:46.819679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application result.read() Sep 28 12:01:46.819679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 28 12:01:46.819679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 28 12:01:46.819679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 28 12:01:46.819679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 28 12:01:46.823052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 28 12:01:46.823052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 28 12:01:46.823052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 28 12:01:46.823052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 28 12:01:46.823052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 28 12:01:46.823052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 28 12:01:46.823052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [parameters: {'id': '5322cb3ebf0b4ff687181906e746ed25', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 28 12:01:46.823052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 28 12:01:46.823052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:46.823052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:01:46.823052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:46.823052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:46.823052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:46.823052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:46.823052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:46.823052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:46.825479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:46.825479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:46.825479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:46.825479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:46.825479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:46.825479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:46.825479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 28 12:01:46.825479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 28 12:01:46.825479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:46.825479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:46.825479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 28 12:01:46.825479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 28 12:01:46.825479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 28 12:01:46.825479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 28 12:01:46.825479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 28 12:01:46.825479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:46.829067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 243/478] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Sep 28 12:01:46 2022] POST /identity/v3/roles => generated 144 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:46.829208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf57131-21a6-4458-b279-348eaa8774d2 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:46.943543 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:46.962915 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf57131-21a6-4458-b279-348eaa8774d2 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:47.008243 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af35a2-6729-40a3-b7a9-2c59efad2baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:47.008911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af35a2-6729-40a3-b7a9-2c59efad2baa None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:47.009189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af35a2-6729-40a3-b7a9-2c59efad2baa None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:47.009461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af35a2-6729-40a3-b7a9-2c59efad2baa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:47.023186 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af35a2-6729-40a3-b7a9-2c59efad2baa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:47.028746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-c1af35a2-6729-40a3-b7a9-2c59efad2baa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:01:47.028746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:47.028746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:47.028746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:47.028746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:47.028746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:47.028746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:47.028746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:47.028746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:47.028746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:47.028746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:47.028746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:47.028746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:47.028746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:47.028746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:47.028746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:47.029713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:47.029713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:47.029713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:47.029713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:47.029713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:47.029713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:47.029713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:47.029713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:47.029713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:47.029713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:47.029713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:47.029713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:47.029713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:47.029713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:47.029713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:47.029713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:47.030964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:47.030964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:47.030964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:47.030964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:47.030964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:47.030964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:47.030964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:47.030964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:47.030964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:47.030964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:47.030964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:01:47.030964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:47.030964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 236/479] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 28 12:01:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:47.036181 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1883ad-3ca9-494e-b887-258e4c7206fa None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:47.215249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1883ad-3ca9-494e-b887-258e4c7206fa None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:47.233016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:47.259479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f6bb7-59a2-47bc-9d11-81f458a6f15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:47.260101 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f6bb7-59a2-47bc-9d11-81f458a6f15e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:47.260382 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f6bb7-59a2-47bc-9d11-81f458a6f15e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:47.260656 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f6bb7-59a2-47bc-9d11-81f458a6f15e None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:47.261332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f6bb7-59a2-47bc-9d11-81f458a6f15e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:47.261640 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f6bb7-59a2-47bc-9d11-81f458a6f15e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:47.263023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f6bb7-59a2-47bc-9d11-81f458a6f15e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:47.271971 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 244/480] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:01:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:48.371047 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8ccc7-dbc0-44c3-bfe9-074da73e7e26 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:48.371616 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8ccc7-dbc0-44c3-bfe9-074da73e7e26 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:48.371616 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8ccc7-dbc0-44c3-bfe9-074da73e7e26 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:48.373210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 237/481] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:48.378726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88d2c1-09f1-42d0-8570-2993a42391ad None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:48.379190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88d2c1-09f1-42d0-8570-2993a42391ad None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:48.379382 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88d2c1-09f1-42d0-8570-2993a42391ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:48.408541 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-eb88d2c1-09f1-42d0-8570-2993a42391ad None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:48.409760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-eb88d2c1-09f1-42d0-8570-2993a42391ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:48.502002 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 245/482] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:48.852587 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8ccc7-dbc0-44c3-bfe9-074da73e7e26 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:48.979190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8ccc7-dbc0-44c3-bfe9-074da73e7e26 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:49.015298 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f7028-40cc-412f-831b-49d4442630d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:49.015972 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f7028-40cc-412f-831b-49d4442630d1 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:49.016250 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f7028-40cc-412f-831b-49d4442630d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:49.016523 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f7028-40cc-412f-831b-49d4442630d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:49.029218 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f7028-40cc-412f-831b-49d4442630d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:49.034208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-810f7028-40cc-412f-831b-49d4442630d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:01:49.034208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:49.034208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:49.034208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:49.034208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:49.034208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:49.034208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:49.034208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:49.034208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:49.034208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:49.034208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:49.034208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:49.034208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:49.034208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:49.034208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:49.034208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:49.035144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:49.035144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:49.035144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:49.035144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:49.035144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:49.035144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:49.035144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:49.035144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:49.035144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:49.035144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:49.035144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:49.035144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:49.035144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:49.035144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:49.035144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:49.035144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:49.037335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:49.037335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:49.037335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:49.037335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:49.037335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:49.037335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:49.037335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:49.037335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:49.037335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:49.037335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:49.037335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:01:49.037335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:49.037335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 238/483] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 28 12:01:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:49.042034 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88d2c1-09f1-42d0-8570-2993a42391ad None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:49.048973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9afe71-81dd-4a50-90ab-8fc72c59286a None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:49.049256 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9afe71-81dd-4a50-90ab-8fc72c59286a None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:49.049534 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9afe71-81dd-4a50-90ab-8fc72c59286a None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:49.051168 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 239/484] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:49.059452 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e23262-ccca-4528-bd75-e69f8973a91c None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:49.059757 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e23262-ccca-4528-bd75-e69f8973a91c None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:49.060034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e23262-ccca-4528-bd75-e69f8973a91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:49.084411 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:49.104525 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-72e23262-ccca-4528-bd75-e69f8973a91c None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:49.105747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-72e23262-ccca-4528-bd75-e69f8973a91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:49.198807 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88d2c1-09f1-42d0-8570-2993a42391ad None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:49.203822 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:49.226201 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 240/485] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:01:49.227707 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da563f7-350a-4cd4-9446-60c47bb08a7d None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:49.228139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da563f7-350a-4cd4-9446-60c47bb08a7d None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:49.228584 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da563f7-350a-4cd4-9446-60c47bb08a7d None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:49.230191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 241/486] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:49.250841 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eca95c-c97a-4060-916d-449f4fe5d9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:49.251723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eca95c-c97a-4060-916d-449f4fe5d9c4 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:49.252144 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eca95c-c97a-4060-916d-449f4fe5d9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:49.252582 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eca95c-c97a-4060-916d-449f4fe5d9c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:49.252864 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c1d98-6a4b-415a-b963-4b7eee10713e None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:49.253377 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c1d98-6a4b-415a-b963-4b7eee10713e None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:49.253482 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eca95c-c97a-4060-916d-449f4fe5d9c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:49.253693 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eca95c-c97a-4060-916d-449f4fe5d9c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:49.254196 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c1d98-6a4b-415a-b963-4b7eee10713e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:49.255124 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eca95c-c97a-4060-916d-449f4fe5d9c4 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:49.264347 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 246/487] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 28 12:01:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:49.271014 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eca95c-c97a-4060-916d-449f4fe5d9c4 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:49.288918 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-b97c1d98-6a4b-415a-b963-4b7eee10713e None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:49.290153 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b97c1d98-6a4b-415a-b963-4b7eee10713e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:49.419698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 242/488] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:49.421645 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f14439-6814-4b77-a812-16bddbcbd00d None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:49.422111 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f14439-6814-4b77-a812-16bddbcbd00d None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:49.422562 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f14439-6814-4b77-a812-16bddbcbd00d None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:49.424060 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 243/489] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:49.429933 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceaecc3-b4d8-4fc4-95b4-1f35d4f74616 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:49.430409 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceaecc3-b4d8-4fc4-95b4-1f35d4f74616 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:49.430858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceaecc3-b4d8-4fc4-95b4-1f35d4f74616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:49.446257 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eca95c-c97a-4060-916d-449f4fe5d9c4 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:49.449518 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-8ceaecc3-b4d8-4fc4-95b4-1f35d4f74616 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:49.450963 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-8ceaecc3-b4d8-4fc4-95b4-1f35d4f74616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:49.515290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c6eef-2e5f-4b53-b8b8-88f7fd7f4fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:49.516267 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c6eef-2e5f-4b53-b8b8-88f7fd7f4fdf None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:49.516726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c6eef-2e5f-4b53-b8b8-88f7fd7f4fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:49.517174 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c6eef-2e5f-4b53-b8b8-88f7fd7f4fdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:49.538318 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c6eef-2e5f-4b53-b8b8-88f7fd7f4fdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:49.540123 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c6eef-2e5f-4b53-b8b8-88f7fd7f4fdf None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:49.559478 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:49.561093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-4a1c6eef-2e5f-4b53-b8b8-88f7fd7f4fdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:49.561093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:49.561093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:49.561093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:49.561093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:49.561093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:49.561093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:49.561093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:49.561093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:49.561093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:49.561093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:49.561093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:49.561093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:01:49.561093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:01:49.561093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:01:49.561093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:01:49.561976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:49.561976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:49.561976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:49.561976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:49.561976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:49.561976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:49.561976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:49.561976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:49.561976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:49.561976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:49.561976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:49.561976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:49.561976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:49.561976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:49.561976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:49.561976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:49.561976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:01:49.562827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:01:49.562827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:49.562827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:49.564276 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 247/490] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:01:49.568459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c6eef-2e5f-4b53-b8b8-88f7fd7f4fdf None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:49.569652 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 244/491] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:01:49.599614 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:49.659840 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceaecc3-b4d8-4fc4-95b4-1f35d4f74616 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:49.735576 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c6eef-2e5f-4b53-b8b8-88f7fd7f4fdf None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:49.779776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987b74b-081a-48c3-ac76-e71dae8db479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:49.780466 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987b74b-081a-48c3-ac76-e71dae8db479 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:49.780752 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987b74b-081a-48c3-ac76-e71dae8db479 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:49.781351 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987b74b-081a-48c3-ac76-e71dae8db479 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:49.782300 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987b74b-081a-48c3-ac76-e71dae8db479 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:49.782648 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987b74b-081a-48c3-ac76-e71dae8db479 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:49.784547 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987b74b-081a-48c3-ac76-e71dae8db479 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:49.787387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceaecc3-b4d8-4fc4-95b4-1f35d4f74616 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:49.800655 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 248/492] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:49.801626 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987b74b-081a-48c3-ac76-e71dae8db479 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:49.825895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e6f5c-6325-4055-9b88-201facf260b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:49.826674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e6f5c-6325-4055-9b88-201facf260b1 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:49.827073 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e6f5c-6325-4055-9b88-201facf260b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:49.827458 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e6f5c-6325-4055-9b88-201facf260b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:49.838735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e6f5c-6325-4055-9b88-201facf260b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:49.844319 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-5e0e6f5c-6325-4055-9b88-201facf260b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:01:49.844319 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:49.844319 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:49.844319 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:49.844319 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:49.844319 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:49.844319 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:49.844319 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:49.844319 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:49.844319 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:49.844319 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:49.844319 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:49.844319 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:49.844319 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:49.844319 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:49.844319 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:49.845251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:49.845251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:49.845251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:49.845251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:49.845251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:49.845251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:49.845251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:49.845251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:49.845251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:49.845251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:49.845251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:49.845251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:49.845251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:49.845251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:49.845251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:49.845251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:49.850792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:49.850792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:49.850792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:49.850792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:49.850792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:49.850792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:49.850792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:49.850792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:49.850792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:49.850792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:49.850792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:01:49.850792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:49.850792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 245/493] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 28 12:01:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:01:49.850792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e6f5c-6325-4055-9b88-201facf260b1 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:49.901657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:49.911690 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:49.926135 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987b74b-081a-48c3-ac76-e71dae8db479 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:49.961406 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e6f5c-6325-4055-9b88-201facf260b1 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:49.962816 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fdab4-0b03-4961-93fe-41eaac8c6455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:49.963650 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fdab4-0b03-4961-93fe-41eaac8c6455 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:49.964072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fdab4-0b03-4961-93fe-41eaac8c6455 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:49.964523 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fdab4-0b03-4961-93fe-41eaac8c6455 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:49.974900 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781fdab4-0b03-4961-93fe-41eaac8c6455 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:49.979713 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-781fdab4-0b03-4961-93fe-41eaac8c6455 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:01:49.979713 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:49.979713 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:49.979713 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:49.979713 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:49.979713 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:49.979713 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:49.979713 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:49.979713 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:49.979713 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:49.979713 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:49.979713 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:49.979713 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:49.979713 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:49.979713 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:49.979713 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:49.980620 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:49.980620 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:49.980620 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:49.980620 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:49.980620 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:49.980620 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:49.980620 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:49.980620 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:49.980620 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:49.980620 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:49.980620 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:49.980620 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:49.980620 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:49.980620 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:49.980620 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:49.980620 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:49.986386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:49.986386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:49.986386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:49.986386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:49.986386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:49.986386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:49.986386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:49.986386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:49.986386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:49.986386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:49.986386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:01:49.986386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:49.986386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 249/494] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 28 12:01:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:49.986386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fdab4-0b03-4961-93fe-41eaac8c6455 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:50.001992 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe19ee-d9ba-48f7-a541-662348e8d73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:50.002726 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe19ee-d9ba-48f7-a541-662348e8d73b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:50.003076 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe19ee-d9ba-48f7-a541-662348e8d73b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:50.003423 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe19ee-d9ba-48f7-a541-662348e8d73b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:50.011173 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe19ee-d9ba-48f7-a541-662348e8d73b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:50.012661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe19ee-d9ba-48f7-a541-662348e8d73b None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:50.025620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-7ebe19ee-d9ba-48f7-a541-662348e8d73b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:01:50.025620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:50.025620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:50.025620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:50.025620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:50.025620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:50.025620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:50.025620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:50.025620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:50.025620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:50.025620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:50.025620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:50.025620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:01:50.025620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:01:50.025620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:01:50.025620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:01:50.026598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:50.026598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:50.026598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:01:50.026598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:01:50.026598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:01:50.026598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:01:50.026598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:50.026598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:50.026598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:50.026598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:50.026598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:50.026598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:50.026598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:50.026598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:50.026598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:50.026598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:50.026598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:50.026598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:50.028042 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:50.028042 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:50.028042 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:01:50.028042 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:01:50.028042 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:01:50.028042 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:01:50.028042 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:01:50.028042 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:01:50.028042 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:01:50.028042 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:50.028042 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 246/495] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Sep 28 12:01:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:50.028042 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe19ee-d9ba-48f7-a541-662348e8d73b None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:50.099903 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fdab4-0b03-4961-93fe-41eaac8c6455 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:50.137977 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfe4f5-9854-4d9a-be91-539aa67e900a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:50.138918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfe4f5-9854-4d9a-be91-539aa67e900a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:50.139355 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfe4f5-9854-4d9a-be91-539aa67e900a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:50.139661 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfe4f5-9854-4d9a-be91-539aa67e900a None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:50.140328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdfe4f5-9854-4d9a-be91-539aa67e900a None admin] RBAC: Adding query filter params (name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:50.140638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdfe4f5-9854-4d9a-be91-539aa67e900a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:50.140959 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe19ee-d9ba-48f7-a541-662348e8d73b None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:50.142054 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdfe4f5-9854-4d9a-be91-539aa67e900a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:50.144346 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:50.155935 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 250/496] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 28 12:01:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:50.155935 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfe4f5-9854-4d9a-be91-539aa67e900a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:50.164801 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:50.183845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596661f-740d-484e-a8aa-f47022492522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:50.184480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596661f-740d-484e-a8aa-f47022492522 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:50.184764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596661f-740d-484e-a8aa-f47022492522 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:50.185038 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596661f-740d-484e-a8aa-f47022492522 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:50.195981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596661f-740d-484e-a8aa-f47022492522 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:50.201295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-b596661f-740d-484e-a8aa-f47022492522 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:01:50.201295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:50.201295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:50.201295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:50.201295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:50.201295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:50.201295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:50.201295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:50.201295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:50.201295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:50.201295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:50.201295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:50.201295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:50.201295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:50.201295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:50.201295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:50.202191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:50.202191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:50.202191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:50.202191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:50.202191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:50.202191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:50.202191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:50.202191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:50.202191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:50.202191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:50.202191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:50.202191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:50.202191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:50.202191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:50.202191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:50.202191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:50.203006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:50.203006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:50.203006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:50.203006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:50.203006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:50.203006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:50.203006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:50.203006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:50.203006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:50.203006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:50.203006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:01:50.203006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:50.203006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 247/497] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 28 12:01:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:50.203708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596661f-740d-484e-a8aa-f47022492522 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:50.261822 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfe4f5-9854-4d9a-be91-539aa67e900a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:50.294471 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60817899-14cc-46cb-b88f-b5ad9b610536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:50.295069 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60817899-14cc-46cb-b88f-b5ad9b610536 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:50.295371 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60817899-14cc-46cb-b88f-b5ad9b610536 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:50.295670 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60817899-14cc-46cb-b88f-b5ad9b610536 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:50.296331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60817899-14cc-46cb-b88f-b5ad9b610536 None admin] RBAC: Adding query filter params (name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:50.296630 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60817899-14cc-46cb-b88f-b5ad9b610536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:50.297994 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60817899-14cc-46cb-b88f-b5ad9b610536 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:50.304087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596661f-740d-484e-a8aa-f47022492522 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:50.306367 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 251/498] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 28 12:01:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:50.306950 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60817899-14cc-46cb-b88f-b5ad9b610536 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:50.339987 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e434d-2428-4f2d-b054-4ea5f6b97923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:50.340598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e434d-2428-4f2d-b054-4ea5f6b97923 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:50.340881 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e434d-2428-4f2d-b054-4ea5f6b97923 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:50.341159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e434d-2428-4f2d-b054-4ea5f6b97923 None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:50.341892 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e434d-2428-4f2d-b054-4ea5f6b97923 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:50.342198 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e434d-2428-4f2d-b054-4ea5f6b97923 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:50.343740 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e434d-2428-4f2d-b054-4ea5f6b97923 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:50.365055 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:50.380625 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 248/499] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Sep 28 12:01:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:50.381304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e434d-2428-4f2d-b054-4ea5f6b97923 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:50.405844 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60817899-14cc-46cb-b88f-b5ad9b610536 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:50.413823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:50.438583 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb5eaa-cbcf-4dae-aa99-ece18edd2c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:50.439214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb5eaa-cbcf-4dae-aa99-ece18edd2c83 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:50.439532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb5eaa-cbcf-4dae-aa99-ece18edd2c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:50.439814 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb5eaa-cbcf-4dae-aa99-ece18edd2c83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:50.450872 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb5eaa-cbcf-4dae-aa99-ece18edd2c83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:50.452342 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb5eaa-cbcf-4dae-aa99-ece18edd2c83 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:50.466361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-91bb5eaa-cbcf-4dae-aa99-ece18edd2c83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:50.466361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:50.466361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:50.466361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:50.466361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:50.466361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:50.466361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:50.466361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:50.466361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:50.466361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:50.466361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:50.466361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:50.466361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:01:50.466361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:01:50.466361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:01:50.466361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:01:50.467281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:50.467281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:50.467281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:50.467281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:50.467281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:50.467281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:50.467281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:50.467281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:50.467281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:50.467281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:50.467281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:50.467281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:50.467281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:50.467281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:50.467281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:50.467281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:50.467281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:01:50.468591 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:01:50.468591 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:50.468591 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:50.468591 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 252/500] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:50.468857 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd741a-662c-43a3-9632-d8b697dacf1e None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:50.468942 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd741a-662c-43a3-9632-d8b697dacf1e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:50.469247 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd741a-662c-43a3-9632-d8b697dacf1e None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:50.470476 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 253/501] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:50.471164 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd741a-662c-43a3-9632-d8b697dacf1e None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:50.485326 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e434d-2428-4f2d-b054-4ea5f6b97923 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:50.519778 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baba5c1-77ea-4189-ad48-539a8fa1df25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:50.520381 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baba5c1-77ea-4189-ad48-539a8fa1df25 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:50.520657 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baba5c1-77ea-4189-ad48-539a8fa1df25 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:50.520925 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baba5c1-77ea-4189-ad48-539a8fa1df25 None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:50.521576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baba5c1-77ea-4189-ad48-539a8fa1df25 None admin] RBAC: Adding query filter params (name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:50.521874 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baba5c1-77ea-4189-ad48-539a8fa1df25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:50.523244 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baba5c1-77ea-4189-ad48-539a8fa1df25 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:50.531339 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 249/502] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 28 12:01:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:50.532163 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baba5c1-77ea-4189-ad48-539a8fa1df25 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:50.571796 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd741a-662c-43a3-9632-d8b697dacf1e None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:50.584490 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:50.605659 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda17f3-b7ef-4786-9357-fd19ab4e5a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:50.606286 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda17f3-b7ef-4786-9357-fd19ab4e5a87 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:50.606563 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda17f3-b7ef-4786-9357-fd19ab4e5a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:50.606833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda17f3-b7ef-4786-9357-fd19ab4e5a87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:50.617455 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda17f3-b7ef-4786-9357-fd19ab4e5a87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:50.618840 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda17f3-b7ef-4786-9357-fd19ab4e5a87 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:50.626617 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:50.633725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-eeda17f3-b7ef-4786-9357-fd19ab4e5a87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:50.633725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:50.633725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:50.633725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:50.633725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:50.633725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:50.633725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:50.633725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:50.633725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:50.633725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:50.633725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:50.633725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:50.633725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:01:50.633725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:01:50.633725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:01:50.633725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:01:50.634637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:50.634637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:50.634637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:50.634637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:50.634637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:50.634637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:50.634637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:50.634637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:50.634637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:50.634637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:50.634637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:50.634637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:50.634637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:50.634637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:50.634637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:50.634637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:50.634637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:01:50.635513 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:01:50.635513 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:50.635513 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:50.635677 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baba5c1-77ea-4189-ad48-539a8fa1df25 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:50.635746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 254/503] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:50.636448 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda17f3-b7ef-4786-9357-fd19ab4e5a87 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:50.669214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2449043-b780-4311-b8e9-46ad16b665ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:50.669811 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2449043-b780-4311-b8e9-46ad16b665ed None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:50.670088 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2449043-b780-4311-b8e9-46ad16b665ed None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:50.670354 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2449043-b780-4311-b8e9-46ad16b665ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:50.735195 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda17f3-b7ef-4786-9357-fd19ab4e5a87 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:50.741793 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2449043-b780-4311-b8e9-46ad16b665ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:50.743293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2449043-b780-4311-b8e9-46ad16b665ed None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:50.768520 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1910c-2218-45ba-a4bf-d3b81e8dfa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:50.769115 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1910c-2218-45ba-a4bf-d3b81e8dfa51 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:50.769396 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1910c-2218-45ba-a4bf-d3b81e8dfa51 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:50.769732 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1910c-2218-45ba-a4bf-d3b81e8dfa51 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:50.771092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1910c-2218-45ba-a4bf-d3b81e8dfa51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:50.771401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1910c-2218-45ba-a4bf-d3b81e8dfa51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:50.772796 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1910c-2218-45ba-a4bf-d3b81e8dfa51 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:50.785102 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 255/504] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:50.786605 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47faa5-ade7-4029-9362-74a0e5586faa None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:50.786879 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47faa5-ade7-4029-9362-74a0e5586faa None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:50.787143 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47faa5-ade7-4029-9362-74a0e5586faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:50.804487 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-8f47faa5-ade7-4029-9362-74a0e5586faa None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:50.805665 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8f47faa5-ade7-4029-9362-74a0e5586faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:50.822571 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:50.838832 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:50.850252 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 250/505] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:01:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:01:50.850252 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2449043-b780-4311-b8e9-46ad16b665ed None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:50.877959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 256/506] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:50.879013 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47faa5-ade7-4029-9362-74a0e5586faa None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:50.960921 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2449043-b780-4311-b8e9-46ad16b665ed None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:50.986704 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47faa5-ade7-4029-9362-74a0e5586faa None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:50.998011 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e0e2b-f763-41c0-9a1b-2e6fb32ad2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:50.998852 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e0e2b-f763-41c0-9a1b-2e6fb32ad2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:50.999131 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e0e2b-f763-41c0-9a1b-2e6fb32ad2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:50.999404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e0e2b-f763-41c0-9a1b-2e6fb32ad2f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:51.010497 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e0e2b-f763-41c0-9a1b-2e6fb32ad2f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:51.011983 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e0e2b-f763-41c0-9a1b-2e6fb32ad2f0 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:51.022884 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56d8b8-a09d-4c51-9865-d1e9b5d99064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:51.023502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56d8b8-a09d-4c51-9865-d1e9b5d99064 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:51.023778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56d8b8-a09d-4c51-9865-d1e9b5d99064 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:51.024043 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56d8b8-a09d-4c51-9865-d1e9b5d99064 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:51.024673 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56d8b8-a09d-4c51-9865-d1e9b5d99064 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:51.024969 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56d8b8-a09d-4c51-9865-d1e9b5d99064 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:51.026301 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56d8b8-a09d-4c51-9865-d1e9b5d99064 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:51.027474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-c58e0e2b-f763-41c0-9a1b-2e6fb32ad2f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:51.027474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:51.027474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:51.027474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:51.027474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:51.027474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:51.027474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:51.027474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:51.027474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:51.027474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:51.027474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:51.027474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:51.027474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:01:51.027474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:01:51.027474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:01:51.027474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:01:51.028344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:51.028344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:51.028344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:51.028344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:51.028344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:51.028344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:51.028344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:51.028344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:51.028344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:51.028344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:51.028344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:51.028344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:51.028344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:51.028344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:51.028344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:51.028344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:51.028344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:01:51.029224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:01:51.029224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:51.029224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:51.029224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 251/507] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:51.029442 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e0e2b-f763-41c0-9a1b-2e6fb32ad2f0 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:51.046411 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 257/508] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:51.047082 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56d8b8-a09d-4c51-9865-d1e9b5d99064 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:51.062732 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:51.088058 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:51.141367 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e0e2b-f763-41c0-9a1b-2e6fb32ad2f0 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:51.150894 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56d8b8-a09d-4c51-9865-d1e9b5d99064 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:51.175007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635385af-dcf7-40a2-98c1-83d5ffe51ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:51.176648 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635385af-dcf7-40a2-98c1-83d5ffe51ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:51.176931 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635385af-dcf7-40a2-98c1-83d5ffe51ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:51.177203 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635385af-dcf7-40a2-98c1-83d5ffe51ad5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:51.185192 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635385af-dcf7-40a2-98c1-83d5ffe51ad5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:51.186646 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635385af-dcf7-40a2-98c1-83d5ffe51ad5 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:51.191004 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1ad69-b82f-4621-92e1-30a5ef3352a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:51.191678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1ad69-b82f-4621-92e1-30a5ef3352a0 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:51.191955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1ad69-b82f-4621-92e1-30a5ef3352a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:51.192228 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1ad69-b82f-4621-92e1-30a5ef3352a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:51.198390 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-635385af-dcf7-40a2-98c1-83d5ffe51ad5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 28 12:01:51.198390 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:51.198390 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:51.198390 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:51.198390 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:51.198390 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:51.198390 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:51.198390 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:51.198390 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:51.198390 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:51.198390 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:51.198390 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:51.198390 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:01:51.198390 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:01:51.198390 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:01:51.198390 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:01:51.199283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:51.199283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:51.199283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:01:51.199283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:01:51.199283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:01:51.199283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:01:51.199283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:51.199283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:51.199283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:51.199283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:51.199283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:51.199283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:51.199283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:51.199283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:51.199283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:51.199283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:51.199283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:51.199283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:51.200222 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:51.200222 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:51.200222 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:01:51.200222 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:01:51.200222 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:01:51.200222 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:01:51.200222 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:01:51.200222 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:01:51.200222 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 28 12:01:51.200222 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:51.200222 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 252/509] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:51.200222 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635385af-dcf7-40a2-98c1-83d5ffe51ad5 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:51.204869 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1ad69-b82f-4621-92e1-30a5ef3352a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:51.206431 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1ad69-b82f-4621-92e1-30a5ef3352a0 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:51.220695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-4ae1ad69-b82f-4621-92e1-30a5ef3352a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:51.220695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:51.220695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:51.220695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:51.220695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:51.220695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:51.220695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:51.220695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:51.220695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:51.220695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:51.220695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:51.220695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:51.220695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:01:51.220695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:01:51.220695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:01:51.220695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:01:51.221767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:51.221767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:51.221767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:51.221767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:51.221767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:51.221767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:51.221767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:51.221767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:51.221767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:51.221767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:51.221767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:51.221767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:51.221767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:51.221767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:51.221767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:51.221767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:51.221767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:01:51.227216 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:01:51.227216 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:51.227216 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:51.227216 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 258/510] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:51.227216 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1ad69-b82f-4621-92e1-30a5ef3352a0 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:51.286848 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:51.305084 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635385af-dcf7-40a2-98c1-83d5ffe51ad5 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:51.314209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:51.321029 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1ad69-b82f-4621-92e1-30a5ef3352a0 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:51.341591 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7e76d-4493-4df8-ad48-a12d860ff8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:51.342191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7e76d-4493-4df8-ad48-a12d860ff8d2 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:51.342466 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7e76d-4493-4df8-ad48-a12d860ff8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:51.342755 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7e76d-4493-4df8-ad48-a12d860ff8d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:51.343389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7e76d-4493-4df8-ad48-a12d860ff8d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:51.343713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7e76d-4493-4df8-ad48-a12d860ff8d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:51.345114 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7e76d-4493-4df8-ad48-a12d860ff8d2 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:51.355342 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f6a43-981d-4a1f-82f1-000947cb398a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:51.355991 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f6a43-981d-4a1f-82f1-000947cb398a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:51.356276 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f6a43-981d-4a1f-82f1-000947cb398a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:51.356546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f6a43-981d-4a1f-82f1-000947cb398a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:51.357058 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 253/511] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:51.357806 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7e76d-4493-4df8-ad48-a12d860ff8d2 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:51.365536 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f6a43-981d-4a1f-82f1-000947cb398a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:51.367281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f6a43-981d-4a1f-82f1-000947cb398a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:51.380158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-8c2f6a43-981d-4a1f-82f1-000947cb398a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 28 12:01:51.380158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:51.380158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:51.380158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:51.380158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:51.380158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:51.380158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:51.380158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:51.380158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:51.380158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:51.380158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:51.380158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:51.380158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:01:51.380158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:01:51.380158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:01:51.380158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:01:51.381111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:51.381111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:51.381111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:01:51.381111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:01:51.381111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:01:51.381111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:01:51.381111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:51.381111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:51.381111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:51.381111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:51.381111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:51.381111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:51.381111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:51.381111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:51.381111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:51.381111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:51.381111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:51.381111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:51.382028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:51.382028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:51.382028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:01:51.382028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:01:51.382028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:01:51.382028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:01:51.382028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:01:51.382028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:01:51.382028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 28 12:01:51.382028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:51.382028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 259/512] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:51.382586 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f6a43-981d-4a1f-82f1-000947cb398a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:51.458823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7e76d-4493-4df8-ad48-a12d860ff8d2 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:51.481561 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f6a43-981d-4a1f-82f1-000947cb398a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:51.495307 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1b1c0-3345-4493-b1af-08ce8ba8682b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:51.495977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1b1c0-3345-4493-b1af-08ce8ba8682b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:51.496255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1b1c0-3345-4493-b1af-08ce8ba8682b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:51.496528 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1b1c0-3345-4493-b1af-08ce8ba8682b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:51.506737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:51.506984 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1b1c0-3345-4493-b1af-08ce8ba8682b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:51.508489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1b1c0-3345-4493-b1af-08ce8ba8682b None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:51.516244 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbecf1-8ae0-4a52-8b5e-93b122081d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:51.516842 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbecf1-8ae0-4a52-8b5e-93b122081d6b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:51.517126 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbecf1-8ae0-4a52-8b5e-93b122081d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:51.517395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbecf1-8ae0-4a52-8b5e-93b122081d6b None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:51.518125 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbecf1-8ae0-4a52-8b5e-93b122081d6b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:51.518439 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbecf1-8ae0-4a52-8b5e-93b122081d6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:51.519926 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbecf1-8ae0-4a52-8b5e-93b122081d6b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:51.523052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-46c1b1c0-3345-4493-b1af-08ce8ba8682b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:51.523052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:51.523052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:51.523052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:51.523052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:51.523052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:51.523052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:51.523052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:51.523052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:51.523052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:51.523052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:51.523052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:51.523052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:01:51.523052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:01:51.523052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:01:51.523052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:01:51.524119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:51.524119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:51.524119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:51.524119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:51.524119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:51.524119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:51.524119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:51.524119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:51.524119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:51.524119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:51.524119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:51.524119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:51.524119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:51.524119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:51.524119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:51.524119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:51.524119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:01:51.525161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:01:51.525161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:51.525161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:51.525161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 254/513] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:51.525161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1b1c0-3345-4493-b1af-08ce8ba8682b None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:51.548692 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:51.557082 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 260/514] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Sep 28 12:01:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:51.557917 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbecf1-8ae0-4a52-8b5e-93b122081d6b None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:51.631680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1b1c0-3345-4493-b1af-08ce8ba8682b None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:51.655869 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbecf1-8ae0-4a52-8b5e-93b122081d6b None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:51.664858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8d04b-f0f5-432a-9ed2-cf877148c444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:51.665468 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8d04b-f0f5-432a-9ed2-cf877148c444 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:51.665750 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8d04b-f0f5-432a-9ed2-cf877148c444 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:51.666026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8d04b-f0f5-432a-9ed2-cf877148c444 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:51.666678 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8d04b-f0f5-432a-9ed2-cf877148c444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:51.666979 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8d04b-f0f5-432a-9ed2-cf877148c444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:51.668381 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8d04b-f0f5-432a-9ed2-cf877148c444 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:51.680443 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 255/515] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:51.681220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8d04b-f0f5-432a-9ed2-cf877148c444 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:51.690780 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7035151-a4b7-4e61-b974-5aef85806a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:51.691421 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7035151-a4b7-4e61-b974-5aef85806a4e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:51.691717 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7035151-a4b7-4e61-b974-5aef85806a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:51.691996 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7035151-a4b7-4e61-b974-5aef85806a4e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:51.699236 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7035151-a4b7-4e61-b974-5aef85806a4e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:51.700801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7035151-a4b7-4e61-b974-5aef85806a4e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:51.715497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-f7035151-a4b7-4e61-b974-5aef85806a4e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 28 12:01:51.715497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:51.715497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:51.715497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:51.715497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:51.715497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:51.715497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:51.715497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:51.715497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:51.715497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:51.715497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:51.715497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:51.715497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:01:51.715497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:01:51.715497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:01:51.715497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:01:51.716575 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:51.716575 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:51.716575 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:01:51.716575 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:01:51.716575 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:01:51.716575 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:01:51.716575 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:51.716575 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:51.716575 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:51.716575 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:51.716575 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:51.716575 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:51.716575 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:51.716575 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:51.716575 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:51.716575 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:51.716575 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:51.716575 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:51.717646 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:51.717646 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:51.717646 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:01:51.717646 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:01:51.717646 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:01:51.717646 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:01:51.717646 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:01:51.717646 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:01:51.717646 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 28 12:01:51.717646 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:51.717646 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 261/516] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 28 12:01:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:51.717646 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7035151-a4b7-4e61-b974-5aef85806a4e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:51.764329 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:51.764965 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:51.786110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8d04b-f0f5-432a-9ed2-cf877148c444 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:51.818845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf380a-9b0f-4ed8-9c98-8095c8553a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:51.819471 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf380a-9b0f-4ed8-9c98-8095c8553a15 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:51.819758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf380a-9b0f-4ed8-9c98-8095c8553a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:51.820036 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf380a-9b0f-4ed8-9c98-8095c8553a15 None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:51.820770 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf380a-9b0f-4ed8-9c98-8095c8553a15 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:51.821077 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf380a-9b0f-4ed8-9c98-8095c8553a15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:51.822122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7035151-a4b7-4e61-b974-5aef85806a4e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:51.822550 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf380a-9b0f-4ed8-9c98-8095c8553a15 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:51.840942 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 256/517] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Sep 28 12:01:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:51.841783 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf380a-9b0f-4ed8-9c98-8095c8553a15 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:51.862116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2726b6-ae71-4c99-83ac-a470e59a0881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:51.862721 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2726b6-ae71-4c99-83ac-a470e59a0881 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:51.862993 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2726b6-ae71-4c99-83ac-a470e59a0881 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:51.863290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2726b6-ae71-4c99-83ac-a470e59a0881 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:51.863957 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2726b6-ae71-4c99-83ac-a470e59a0881 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:51.864259 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2726b6-ae71-4c99-83ac-a470e59a0881 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:51.865648 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2726b6-ae71-4c99-83ac-a470e59a0881 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:51.877477 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 262/518] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:51.878271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2726b6-ae71-4c99-83ac-a470e59a0881 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:51.944424 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf380a-9b0f-4ed8-9c98-8095c8553a15 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:51.974838 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2726b6-ae71-4c99-83ac-a470e59a0881 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:51.977125 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:51.978821 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762d331-6773-48a0-af47-48c3339281ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:51.979485 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762d331-6773-48a0-af47-48c3339281ce None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:51.979766 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762d331-6773-48a0-af47-48c3339281ce None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:51.980039 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762d331-6773-48a0-af47-48c3339281ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:51.988009 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:52.008879 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212229d-e1fd-465d-91c5-e65c2f8e2bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:52.009496 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212229d-e1fd-465d-91c5-e65c2f8e2bcf None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:52.009769 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212229d-e1fd-465d-91c5-e65c2f8e2bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:52.010038 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212229d-e1fd-465d-91c5-e65c2f8e2bcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:52.016483 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212229d-e1fd-465d-91c5-e65c2f8e2bcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:52.017929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212229d-e1fd-465d-91c5-e65c2f8e2bcf None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:52.031111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-8212229d-e1fd-465d-91c5-e65c2f8e2bcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:01:52.031111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:52.031111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:52.031111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:52.031111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:52.031111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:52.031111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:52.031111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:52.031111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:52.031111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:52.031111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:52.031111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:52.031111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:01:52.031111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:01:52.031111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:01:52.032184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:01:52.032184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:52.032184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:52.032184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:52.032184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:52.032184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:52.032184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:52.032184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:52.032184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:52.032184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:52.032184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:52.032184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:52.032184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:52.032184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:52.032184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:52.032184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:52.032184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:52.033052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:01:52.033052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:01:52.033052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:01:52.033052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:01:52.033052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:01:52.033052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:01:52.033052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:01:52.033052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:52.033052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 263/519] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:01:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:52.033052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212229d-e1fd-465d-91c5-e65c2f8e2bcf None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:52.049845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762d331-6773-48a0-af47-48c3339281ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:52.051339 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762d331-6773-48a0-af47-48c3339281ce None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:52.135504 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212229d-e1fd-465d-91c5-e65c2f8e2bcf None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:52.149382 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 257/520] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:01:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:01:52.152594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762d331-6773-48a0-af47-48c3339281ce None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:52.168362 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d6e4b-da86-4f2f-90f1-cdb15eec8518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:52.169202 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d6e4b-da86-4f2f-90f1-cdb15eec8518 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:52.169479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d6e4b-da86-4f2f-90f1-cdb15eec8518 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:52.169748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d6e4b-da86-4f2f-90f1-cdb15eec8518 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:52.170491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d6e4b-da86-4f2f-90f1-cdb15eec8518 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:52.170773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d6e4b-da86-4f2f-90f1-cdb15eec8518 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:52.172228 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d6e4b-da86-4f2f-90f1-cdb15eec8518 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:52.190992 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 264/521] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Sep 28 12:01:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:52.192353 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d6e4b-da86-4f2f-90f1-cdb15eec8518 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:52.197079 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:52.219682 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:52.258242 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762d331-6773-48a0-af47-48c3339281ce None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:52.291692 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c9eee-6601-4f1f-8bd0-96637b9a222e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:52.292291 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c9eee-6601-4f1f-8bd0-96637b9a222e None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:52.292565 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c9eee-6601-4f1f-8bd0-96637b9a222e None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:52.292828 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c9eee-6601-4f1f-8bd0-96637b9a222e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:52.297328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d6e4b-da86-4f2f-90f1-cdb15eec8518 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:52.330703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fdb9f-9aee-4b9a-9f73-a0cda2639e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:52.331405 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fdb9f-9aee-4b9a-9f73-a0cda2639e4d None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:52.331775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fdb9f-9aee-4b9a-9f73-a0cda2639e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:52.332679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fdb9f-9aee-4b9a-9f73-a0cda2639e4d None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:52.333391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fdb9f-9aee-4b9a-9f73-a0cda2639e4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:52.334873 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fdb9f-9aee-4b9a-9f73-a0cda2639e4d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:52.355657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 265/522] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 28 12:01:52 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:01:52.356547 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fdb9f-9aee-4b9a-9f73-a0cda2639e4d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:52.373679 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c9eee-6601-4f1f-8bd0-96637b9a222e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:52.376222 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c9eee-6601-4f1f-8bd0-96637b9a222e None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:52.422140 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:52.447070 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:52.476481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fdb9f-9aee-4b9a-9f73-a0cda2639e4d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:52.493560 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 258/523] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:01:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:01:52.494498 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c9eee-6601-4f1f-8bd0-96637b9a222e None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:52.521050 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e4e28-6841-4d8e-ae3c-d0eddefdf036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:52.521729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e4e28-6841-4d8e-ae3c-d0eddefdf036 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:52.522009 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e4e28-6841-4d8e-ae3c-d0eddefdf036 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:52.522305 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e4e28-6841-4d8e-ae3c-d0eddefdf036 None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:52.522983 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e4e28-6841-4d8e-ae3c-d0eddefdf036 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:52.523304 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e4e28-6841-4d8e-ae3c-d0eddefdf036 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:52.524803 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e4e28-6841-4d8e-ae3c-d0eddefdf036 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:52.545943 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 266/524] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:01:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:52.550598 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e4e28-6841-4d8e-ae3c-d0eddefdf036 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:52.615605 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c9eee-6601-4f1f-8bd0-96637b9a222e None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:52.651634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca4bad-05a6-441e-b29b-1a396dcc65c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:52.652262 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca4bad-05a6-441e-b29b-1a396dcc65c5 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:52.652540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca4bad-05a6-441e-b29b-1a396dcc65c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:52.652818 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca4bad-05a6-441e-b29b-1a396dcc65c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:52.659408 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:52.660488 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e4e28-6841-4d8e-ae3c-d0eddefdf036 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:52.664413 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca4bad-05a6-441e-b29b-1a396dcc65c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:52.665938 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca4bad-05a6-441e-b29b-1a396dcc65c5 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:52.681288 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-3bca4bad-05a6-441e-b29b-1a396dcc65c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:52.681288 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:52.681288 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:52.681288 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:52.681288 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:52.681288 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:52.681288 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:52.681288 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:52.681288 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:52.681288 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:52.681288 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:52.681288 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:52.681288 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:01:52.681288 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:01:52.681288 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:01:52.681288 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:01:52.682410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:52.682410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:52.682410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:52.682410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:52.682410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:52.682410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:52.682410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:52.682410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:52.682410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:52.682410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:52.682410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:52.682410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:52.682410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:52.682410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:52.682410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:52.682410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:52.682410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:01:52.683589 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:01:52.683589 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:52.683589 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:52.688642 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 259/525] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:52.688642 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca4bad-05a6-441e-b29b-1a396dcc65c5 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:52.707383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684cb77-2670-4c4e-838c-565095f01569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:52.708349 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684cb77-2670-4c4e-838c-565095f01569 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:52.708631 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684cb77-2670-4c4e-838c-565095f01569 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:52.708900 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684cb77-2670-4c4e-838c-565095f01569 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:52.717894 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:52.786938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684cb77-2670-4c4e-838c-565095f01569 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:52.788353 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684cb77-2670-4c4e-838c-565095f01569 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:52.797019 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca4bad-05a6-441e-b29b-1a396dcc65c5 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:52.833748 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3593ac-0415-48ad-8f00-7b5420dfbaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:52.834387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3593ac-0415-48ad-8f00-7b5420dfbaa8 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:52.834666 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3593ac-0415-48ad-8f00-7b5420dfbaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:52.834934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3593ac-0415-48ad-8f00-7b5420dfbaa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:52.845680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3593ac-0415-48ad-8f00-7b5420dfbaa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:52.847140 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3593ac-0415-48ad-8f00-7b5420dfbaa8 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:52.862143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-2e3593ac-0415-48ad-8f00-7b5420dfbaa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:52.862143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:52.862143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:52.862143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:52.862143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:52.862143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:52.862143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:52.862143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:52.862143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:52.862143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:52.862143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:52.862143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:52.862143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:01:52.862143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:01:52.862143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:01:52.862143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:01:52.863379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:52.863379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:52.863379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:52.863379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:52.863379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:52.863379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:52.863379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:52.863379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:52.863379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:52.863379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:52.863379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:52.863379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:52.863379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:52.863379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:52.863379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:52.863379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:52.863379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:01:52.865160 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:01:52.865160 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:52.865160 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:52.865160 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 260/526] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:52.865160 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3593ac-0415-48ad-8f00-7b5420dfbaa8 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:52.899908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 267/527] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:01:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:01:52.900778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684cb77-2670-4c4e-838c-565095f01569 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:52.917774 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:52.945541 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:52.978638 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3593ac-0415-48ad-8f00-7b5420dfbaa8 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:53.013713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5333d4-1068-4865-a91c-fc3291fba3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:53.014314 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5333d4-1068-4865-a91c-fc3291fba3da None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:53.014594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5333d4-1068-4865-a91c-fc3291fba3da None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:53.014863 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5333d4-1068-4865-a91c-fc3291fba3da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:53.015166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684cb77-2670-4c4e-838c-565095f01569 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:53.015617 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5333d4-1068-4865-a91c-fc3291fba3da None admin] RBAC: Adding query filter params (role.id=9b8671e5f63c4b08982273f189eab5ec, scope.project.id=c854d366f35145e8b2fadb9b014d0199, user.id=0e81804e04514ae882a1fd93789db025) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:53.015925 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5333d4-1068-4865-a91c-fc3291fba3da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:53.017360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5333d4-1068-4865-a91c-fc3291fba3da None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:53.022698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 261/528] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:01:52 2022] GET /identity/v3/role_assignments?user.id=0e81804e04514ae882a1fd93789db025&scope.project.id=c854d366f35145e8b2fadb9b014d0199&role.id=9b8671e5f63c4b08982273f189eab5ec => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:53.023492 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5333d4-1068-4865-a91c-fc3291fba3da None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:53.056371 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48257128-bcd5-4acb-b580-d1cb0af34a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:53.057364 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48257128-bcd5-4acb-b580-d1cb0af34a07 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:53.057807 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48257128-bcd5-4acb-b580-d1cb0af34a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:53.058085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48257128-bcd5-4acb-b580-d1cb0af34a07 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:53.058753 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48257128-bcd5-4acb-b580-d1cb0af34a07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:53.059064 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48257128-bcd5-4acb-b580-d1cb0af34a07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:53.060606 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48257128-bcd5-4acb-b580-d1cb0af34a07 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:53.075604 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 268/529] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:53.076346 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48257128-bcd5-4acb-b580-d1cb0af34a07 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:53.165279 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5333d4-1068-4865-a91c-fc3291fba3da None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:53.175650 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:53.213749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:53.214253 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6c885-44ad-4958-a96a-65fe30f1cd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:53.214954 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6c885-44ad-4958-a96a-65fe30f1cd31 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:53.215224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6c885-44ad-4958-a96a-65fe30f1cd31 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:53.215675 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6c885-44ad-4958-a96a-65fe30f1cd31 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:53.216475 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6c885-44ad-4958-a96a-65fe30f1cd31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:53.217241 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6c885-44ad-4958-a96a-65fe30f1cd31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:53.218926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6c885-44ad-4958-a96a-65fe30f1cd31 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:53.221014 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48257128-bcd5-4acb-b580-d1cb0af34a07 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:53.234352 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 262/530] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:53.235220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6c885-44ad-4958-a96a-65fe30f1cd31 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:53.271681 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8fbdba-15c6-4f01-a2ce-eb878206adb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:53.273256 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fbdba-15c6-4f01-a2ce-eb878206adb7 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:53.273734 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fbdba-15c6-4f01-a2ce-eb878206adb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:53.274226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fbdba-15c6-4f01-a2ce-eb878206adb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:53.290735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8fbdba-15c6-4f01-a2ce-eb878206adb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:53.293191 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8fbdba-15c6-4f01-a2ce-eb878206adb7 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:53.314691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-cd8fbdba-15c6-4f01-a2ce-eb878206adb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:53.314691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:53.314691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:53.314691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:53.314691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:53.314691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:53.314691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:53.314691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:53.314691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:53.314691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:53.314691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:53.314691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:53.314691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:01:53.314691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:01:53.314691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:01:53.314691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:01:53.315677 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:53.315677 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:53.315677 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:53.315677 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:53.315677 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:53.315677 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:53.315677 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:53.315677 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:53.315677 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:53.315677 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:53.315677 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:53.315677 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:53.315677 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:53.315677 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:53.315677 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:53.315677 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:53.315677 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:01:53.316589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:01:53.316589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:53.316589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:53.319502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 269/531] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:53.320497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8fbdba-15c6-4f01-a2ce-eb878206adb7 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:53.363832 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6c885-44ad-4958-a96a-65fe30f1cd31 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:53.400519 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c069d39-ad6e-447b-ac85-44af8a024d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:53.401150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c069d39-ad6e-447b-ac85-44af8a024d45 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:53.401431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c069d39-ad6e-447b-ac85-44af8a024d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:53.401703 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c069d39-ad6e-447b-ac85-44af8a024d45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:53.408770 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c069d39-ad6e-447b-ac85-44af8a024d45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:53.410325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c069d39-ad6e-447b-ac85-44af8a024d45 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:53.422613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-9c069d39-ad6e-447b-ac85-44af8a024d45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:01:53.422613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:53.422613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:53.422613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:53.422613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:53.422613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:53.422613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:53.422613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:53.422613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:53.422613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:53.422613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:53.422613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:53.422613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:01:53.422613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:01:53.422613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:01:53.423529 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:01:53.423529 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:53.423529 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:53.423529 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:53.423529 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:53.423529 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:53.423529 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:53.423529 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:53.423529 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:53.423529 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:53.423529 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:53.423529 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:53.423529 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:53.423529 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:53.423529 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:53.423529 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:53.423529 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:53.424394 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:01:53.424394 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:01:53.424394 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:01:53.424394 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:01:53.424394 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:01:53.424394 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:01:53.424394 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:01:53.424394 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:53.429467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 263/532] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:01:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:53.430357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c069d39-ad6e-447b-ac85-44af8a024d45 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:53.457500 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8fbdba-15c6-4f01-a2ce-eb878206adb7 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:53.459602 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:53.497259 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c6c07-25ed-49e5-b6b9-4e8b1dc6222d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:53.497952 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c6c07-25ed-49e5-b6b9-4e8b1dc6222d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:53.498237 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c6c07-25ed-49e5-b6b9-4e8b1dc6222d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:53.498513 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c6c07-25ed-49e5-b6b9-4e8b1dc6222d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:53.506626 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c6c07-25ed-49e5-b6b9-4e8b1dc6222d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:53.508471 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c6c07-25ed-49e5-b6b9-4e8b1dc6222d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:53.520578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-567c6c07-25ed-49e5-b6b9-4e8b1dc6222d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:01:53.520578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:53.520578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:53.520578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:53.520578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:53.520578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:53.520578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:53.520578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:53.520578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:53.520578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:53.520578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:53.520578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:53.520578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:01:53.520578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:01:53.520578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:01:53.521902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:01:53.521902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:53.521902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:53.521902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:53.521902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:53.521902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:53.521902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:53.521902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:53.521902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:53.521902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:53.521902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:53.521902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:53.521902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:53.521902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:53.521902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:53.521902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:53.521902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:53.523293 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:01:53.523293 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:01:53.523293 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:01:53.523293 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:01:53.523293 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:01:53.523293 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:01:53.523293 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:01:53.523293 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:53.523293 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 270/533] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:01:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:53.523293 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c6c07-25ed-49e5-b6b9-4e8b1dc6222d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:53.540905 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:53.556424 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c069d39-ad6e-447b-ac85-44af8a024d45 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:53.593708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe79c7-742c-4523-8858-9e8d7d224866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:53.594740 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe79c7-742c-4523-8858-9e8d7d224866 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:53.595368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe79c7-742c-4523-8858-9e8d7d224866 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:53.595864 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe79c7-742c-4523-8858-9e8d7d224866 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:53.596693 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe79c7-742c-4523-8858-9e8d7d224866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:53.597185 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe79c7-742c-4523-8858-9e8d7d224866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:53.599757 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe79c7-742c-4523-8858-9e8d7d224866 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:53.613157 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 264/534] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:53.614403 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe79c7-742c-4523-8858-9e8d7d224866 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:53.640796 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c6c07-25ed-49e5-b6b9-4e8b1dc6222d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:53.677337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba5813-2dc3-46f7-a7af-4cc5150f16be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:53.678002 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba5813-2dc3-46f7-a7af-4cc5150f16be None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:53.678291 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba5813-2dc3-46f7-a7af-4cc5150f16be None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:53.678566 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba5813-2dc3-46f7-a7af-4cc5150f16be None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:53.679286 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba5813-2dc3-46f7-a7af-4cc5150f16be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:53.679704 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba5813-2dc3-46f7-a7af-4cc5150f16be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:53.681143 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba5813-2dc3-46f7-a7af-4cc5150f16be None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:53.698756 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 271/535] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:01:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:53.699710 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba5813-2dc3-46f7-a7af-4cc5150f16be None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:53.719857 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:53.743412 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe79c7-742c-4523-8858-9e8d7d224866 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:53.775183 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:53.786603 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a924996-69b0-49d2-963c-e7c0206ad6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:53.787561 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a924996-69b0-49d2-963c-e7c0206ad6ca None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:53.788046 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a924996-69b0-49d2-963c-e7c0206ad6ca None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:53.788528 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a924996-69b0-49d2-963c-e7c0206ad6ca None admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:53.789524 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a924996-69b0-49d2-963c-e7c0206ad6ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:53.790073 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a924996-69b0-49d2-963c-e7c0206ad6ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:53.791768 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a924996-69b0-49d2-963c-e7c0206ad6ca None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:53.809574 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba5813-2dc3-46f7-a7af-4cc5150f16be None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:53.812398 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 265/536] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:01:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:53.813641 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a924996-69b0-49d2-963c-e7c0206ad6ca None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:53.846714 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce26b8-8e20-434a-b8bd-f4d0911e5322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:53.847362 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce26b8-8e20-434a-b8bd-f4d0911e5322 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:53.848231 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce26b8-8e20-434a-b8bd-f4d0911e5322 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:53.848603 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce26b8-8e20-434a-b8bd-f4d0911e5322 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:53.857420 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce26b8-8e20-434a-b8bd-f4d0911e5322 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:53.860828 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce26b8-8e20-434a-b8bd-f4d0911e5322 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:53.875914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-11ce26b8-8e20-434a-b8bd-f4d0911e5322 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:01:53.875914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:53.875914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:53.875914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:53.875914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:53.875914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:53.875914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:53.875914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:53.875914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:53.875914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:53.875914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:53.875914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:53.875914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:01:53.875914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:01:53.875914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:01:53.877072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:01:53.877072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:53.877072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:53.877072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:53.877072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:53.877072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:53.877072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:53.877072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:53.877072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:53.877072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:53.877072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:53.877072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:53.877072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:53.877072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:53.877072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:53.877072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:53.877072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:53.877903 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:01:53.877903 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:01:53.877903 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:01:53.877903 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:01:53.877903 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:01:53.877903 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:01:53.877903 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:01:53.877903 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:53.883785 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 272/537] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:01:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:53.884733 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce26b8-8e20-434a-b8bd-f4d0911e5322 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:53.935007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a924996-69b0-49d2-963c-e7c0206ad6ca None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:53.974792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f66f7-3ef3-4066-94e9-01d5d931b3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:53.975776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f66f7-3ef3-4066-94e9-01d5d931b3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:53.976354 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f66f7-3ef3-4066-94e9-01d5d931b3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:53.976818 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f66f7-3ef3-4066-94e9-01d5d931b3f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:53.977862 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f66f7-3ef3-4066-94e9-01d5d931b3f4 None admin] RBAC: Adding query filter params (role.id=9b8671e5f63c4b08982273f189eab5ec, scope.project.id=c854d366f35145e8b2fadb9b014d0199, user.id=f09354b404d94e9db2e21292a61a06f2) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:53.978381 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f66f7-3ef3-4066-94e9-01d5d931b3f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:53.980206 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f66f7-3ef3-4066-94e9-01d5d931b3f4 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:53.986775 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 266/538] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:01:53 2022] GET /identity/v3/role_assignments?user.id=f09354b404d94e9db2e21292a61a06f2&scope.project.id=c854d366f35145e8b2fadb9b014d0199&role.id=9b8671e5f63c4b08982273f189eab5ec => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:53.987807 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f66f7-3ef3-4066-94e9-01d5d931b3f4 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:54.001492 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:54.020679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce26b8-8e20-434a-b8bd-f4d0911e5322 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:54.078262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:54.092648 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d27d53-cd6e-40ee-8b93-8df228bb8780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:54.093634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d27d53-cd6e-40ee-8b93-8df228bb8780 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:54.095391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d27d53-cd6e-40ee-8b93-8df228bb8780 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:54.095930 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d27d53-cd6e-40ee-8b93-8df228bb8780 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:54.096951 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d27d53-cd6e-40ee-8b93-8df228bb8780 None admin] RBAC: Adding query filter params (role.id=9b8671e5f63c4b08982273f189eab5ec, scope.project.id=c854d366f35145e8b2fadb9b014d0199, user.id=9180b1616c524905b86769a9eb8f7757) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:54.100056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d27d53-cd6e-40ee-8b93-8df228bb8780 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:54.101791 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d27d53-cd6e-40ee-8b93-8df228bb8780 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:54.118501 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 273/539] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:01:53 2022] GET /identity/v3/role_assignments?user.id=9180b1616c524905b86769a9eb8f7757&scope.project.id=c854d366f35145e8b2fadb9b014d0199&role.id=9b8671e5f63c4b08982273f189eab5ec => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:54.145781 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f66f7-3ef3-4066-94e9-01d5d931b3f4 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:54.186608 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cb9eb-43d5-42a6-8e11-b5a37f8cc637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:54.187635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cb9eb-43d5-42a6-8e11-b5a37f8cc637 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:54.188150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cb9eb-43d5-42a6-8e11-b5a37f8cc637 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:54.188619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cb9eb-43d5-42a6-8e11-b5a37f8cc637 None admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:54.189778 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cb9eb-43d5-42a6-8e11-b5a37f8cc637 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:54.190298 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cb9eb-43d5-42a6-8e11-b5a37f8cc637 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:54.193292 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cb9eb-43d5-42a6-8e11-b5a37f8cc637 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:54.210331 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 267/540] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:01:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:54.215852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d27d53-cd6e-40ee-8b93-8df228bb8780 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:54.373651 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d27d53-cd6e-40ee-8b93-8df228bb8780 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:54.420152 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc63463-9161-4660-a189-22007d9ec0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:54.421144 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc63463-9161-4660-a189-22007d9ec0c2 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:54.421616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc63463-9161-4660-a189-22007d9ec0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:54.422079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc63463-9161-4660-a189-22007d9ec0c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:54.423022 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc63463-9161-4660-a189-22007d9ec0c2 None admin] RBAC: Adding query filter params (role.id=9b8671e5f63c4b08982273f189eab5ec, scope.project.id=c854d366f35145e8b2fadb9b014d0199, user.id=ca51ff621664452db7dd991714462e3b) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:54.423546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc63463-9161-4660-a189-22007d9ec0c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:54.425171 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc63463-9161-4660-a189-22007d9ec0c2 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:54.432182 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 274/541] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:01:54 2022] GET /identity/v3/role_assignments?user.id=ca51ff621664452db7dd991714462e3b&scope.project.id=c854d366f35145e8b2fadb9b014d0199&role.id=9b8671e5f63c4b08982273f189eab5ec => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:54.732872 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42df3c-429f-47fd-a12a-7ac4cb07da12 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:54.733798 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42df3c-429f-47fd-a12a-7ac4cb07da12 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:54.734289 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42df3c-429f-47fd-a12a-7ac4cb07da12 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:54.735837 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 268/542] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:54.743230 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44d726-753e-4991-a479-9cd759304672 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:54.744109 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44d726-753e-4991-a479-9cd759304672 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:54.744599 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44d726-753e-4991-a479-9cd759304672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:54.770195 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-1f44d726-753e-4991-a479-9cd759304672 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:54.771392 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-1f44d726-753e-4991-a479-9cd759304672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:54.836299 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:54.854173 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 275/543] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:55.258501 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42df3c-429f-47fd-a12a-7ac4cb07da12 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:55.355595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:55.400197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42df3c-429f-47fd-a12a-7ac4cb07da12 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:55.450513 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3462f27-590a-4e05-9b31-8eb07cd64f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:55.451152 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3462f27-590a-4e05-9b31-8eb07cd64f9a None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:55.451451 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3462f27-590a-4e05-9b31-8eb07cd64f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:55.451727 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3462f27-590a-4e05-9b31-8eb07cd64f9a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:55.467663 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3462f27-590a-4e05-9b31-8eb07cd64f9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:55.472563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-f3462f27-590a-4e05-9b31-8eb07cd64f9a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:01:55.472563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:55.472563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:55.472563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:55.472563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:55.472563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:55.472563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:55.472563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:55.472563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:55.472563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:55.472563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:55.472563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:55.472563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:55.472563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:55.472563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:55.472563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:55.473495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:55.473495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:55.473495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:55.473495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:55.473495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:55.473495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:55.473495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:55.473495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:55.473495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:55.473495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:55.473495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:55.473495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:55.473495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:55.473495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:55.473495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:55.473495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:55.474293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:55.474293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:55.474293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:55.474293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:55.474293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:55.474293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:55.474293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:55.474293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:55.474293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:55.474293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:55.474293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:01:55.474293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:55.474293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 269/544] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 28 12:01:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:55.479793 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44d726-753e-4991-a479-9cd759304672 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:55.617513 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44d726-753e-4991-a479-9cd759304672 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:55.670038 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5263b3-c082-40e9-9125-cd3c9bf17a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:55.670658 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5263b3-c082-40e9-9125-cd3c9bf17a80 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:55.670937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5263b3-c082-40e9-9125-cd3c9bf17a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:55.671226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5263b3-c082-40e9-9125-cd3c9bf17a80 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:55.671911 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5263b3-c082-40e9-9125-cd3c9bf17a80 None admin] RBAC: Adding query filter params (name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:55.672216 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5263b3-c082-40e9-9125-cd3c9bf17a80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:55.673573 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5263b3-c082-40e9-9125-cd3c9bf17a80 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:55.686796 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 276/545] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 28 12:01:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:55.692402 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3462f27-590a-4e05-9b31-8eb07cd64f9a None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:55.734819 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafba50f-c05e-441a-bfe0-c81d17874c37 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:55.735384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafba50f-c05e-441a-bfe0-c81d17874c37 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:55.736202 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafba50f-c05e-441a-bfe0-c81d17874c37 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:55.738001 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 277/546] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:55.744088 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f81fd-d052-4fb5-a0cf-36d8cf26f363 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:55.744984 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f81fd-d052-4fb5-a0cf-36d8cf26f363 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:55.745436 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f81fd-d052-4fb5-a0cf-36d8cf26f363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:55.765368 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-074f81fd-d052-4fb5-a0cf-36d8cf26f363 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:55.766930 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-074f81fd-d052-4fb5-a0cf-36d8cf26f363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:55.818797 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:55.841726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 278/547] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:55.890972 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3462f27-590a-4e05-9b31-8eb07cd64f9a None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:55.940686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:55.946391 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163948d-4b40-45e9-a92b-05e9370cb3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:55.947484 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163948d-4b40-45e9-a92b-05e9370cb3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:55.948001 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163948d-4b40-45e9-a92b-05e9370cb3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:55.948602 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163948d-4b40-45e9-a92b-05e9370cb3f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:55.963248 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e163948d-4b40-45e9-a92b-05e9370cb3f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:55.964747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e163948d-4b40-45e9-a92b-05e9370cb3f0 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:55.992211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-e163948d-4b40-45e9-a92b-05e9370cb3f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:55.992211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:55.992211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:55.992211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:55.992211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:55.992211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:55.992211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:55.992211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:55.992211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:55.992211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:55.992211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:55.992211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:55.992211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:01:55.992211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:01:55.992211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:01:55.992211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:01:55.993167 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:55.993167 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:55.993167 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:55.993167 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:55.993167 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:55.993167 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:55.993167 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:55.993167 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:55.993167 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:55.993167 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:55.993167 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:55.993167 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:55.993167 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:55.993167 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:55.993167 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:55.993167 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:55.993167 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:01:55.994034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:01:55.994034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:55.994034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:55.994034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 270/548] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:55.999306 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f81fd-d052-4fb5-a0cf-36d8cf26f363 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:56.174261 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163948d-4b40-45e9-a92b-05e9370cb3f0 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:56.210201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f81fd-d052-4fb5-a0cf-36d8cf26f363 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:56.279343 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb9a01-a476-482f-8230-42df820fab5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:56.279985 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb9a01-a476-482f-8230-42df820fab5a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:56.280260 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb9a01-a476-482f-8230-42df820fab5a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:56.280524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb9a01-a476-482f-8230-42df820fab5a None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:56.281174 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb9a01-a476-482f-8230-42df820fab5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:56.281477 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb9a01-a476-482f-8230-42df820fab5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:56.282908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb9a01-a476-482f-8230-42df820fab5a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:56.295366 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 279/549] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:56.300392 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb9a01-a476-482f-8230-42df820fab5a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:56.352188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163948d-4b40-45e9-a92b-05e9370cb3f0 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:56.359152 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:56.412617 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffb560-8100-419d-be21-9068cd1c9155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:56.413265 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffb560-8100-419d-be21-9068cd1c9155 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:56.413546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffb560-8100-419d-be21-9068cd1c9155 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:56.413820 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffb560-8100-419d-be21-9068cd1c9155 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:56.425577 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffb560-8100-419d-be21-9068cd1c9155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:56.431220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-02ffb560-8100-419d-be21-9068cd1c9155 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:01:56.431220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:56.431220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:56.431220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:56.431220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:56.431220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:56.431220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:56.431220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:56.431220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:56.431220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:56.431220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:56.431220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:56.431220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:56.431220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:56.431220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:56.431220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:56.432824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:56.432824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:56.432824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:56.432824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:56.432824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:56.432824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:56.432824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:56.432824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:56.432824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:56.432824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:56.432824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:56.432824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:56.432824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:56.432824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:56.432824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:56.432824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:56.433738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:56.433738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:56.433738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:56.433738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:56.433738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:56.433738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:56.433738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:56.433738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:56.433738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:56.433738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:56.433738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:01:56.433738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:56.433738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 271/550] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 28 12:01:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:01:56.440958 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffb560-8100-419d-be21-9068cd1c9155 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:56.486301 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb9a01-a476-482f-8230-42df820fab5a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:56.516869 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:56.572158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0ed0e-8680-4244-96f3-918ecfb705e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:56.573199 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0ed0e-8680-4244-96f3-918ecfb705e6 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:56.573685 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0ed0e-8680-4244-96f3-918ecfb705e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:56.574161 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0ed0e-8680-4244-96f3-918ecfb705e6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:56.586160 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0ed0e-8680-4244-96f3-918ecfb705e6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:56.586344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffb560-8100-419d-be21-9068cd1c9155 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:56.588094 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0ed0e-8680-4244-96f3-918ecfb705e6 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:56.600472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-b1d0ed0e-8680-4244-96f3-918ecfb705e6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 28 12:01:56.600472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:56.600472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:56.600472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:56.600472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:56.600472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:56.600472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:56.600472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:56.600472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:56.600472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:56.600472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:56.600472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:56.600472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:01:56.600472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:01:56.600472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:01:56.600472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:01:56.601432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:56.601432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:56.601432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:01:56.601432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:01:56.601432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:01:56.601432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:01:56.601432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:56.601432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:56.601432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:56.601432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:56.601432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:56.601432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:56.601432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:56.601432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:56.601432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:56.601432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:56.601432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:56.601432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:56.602517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:56.602517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:56.602517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:01:56.602517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:01:56.602517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:01:56.602517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:01:56.602517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:01:56.602517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:01:56.602517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 28 12:01:56.602517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:56.604985 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 280/551] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:01:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:01:56.606377 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fd88b-9ac4-411b-871b-473591fa6726 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:56.606880 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fd88b-9ac4-411b-871b-473591fa6726 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:56.607362 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fd88b-9ac4-411b-871b-473591fa6726 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:56.609091 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 281/552] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:56.610132 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c4149-e601-4e80-96e8-c73b51bc7a67 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:56.610417 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c4149-e601-4e80-96e8-c73b51bc7a67 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:56.610692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c4149-e601-4e80-96e8-c73b51bc7a67 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:56.612025 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 282/553] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:56.612593 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c4149-e601-4e80-96e8-c73b51bc7a67 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:56.625578 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d6222-99e5-409c-aa9b-b63a5433fb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:56.626703 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d6222-99e5-409c-aa9b-b63a5433fb73 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:56.626992 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d6222-99e5-409c-aa9b-b63a5433fb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:56.627262 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d6222-99e5-409c-aa9b-b63a5433fb73 None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:56.627957 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d6222-99e5-409c-aa9b-b63a5433fb73 None admin] RBAC: Adding query filter params (name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:56.628262 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d6222-99e5-409c-aa9b-b63a5433fb73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:56.630282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d6222-99e5-409c-aa9b-b63a5433fb73 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:56.638716 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 272/554] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 28 12:01:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:01:56.640003 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e2284-80e4-4c03-bae5-08800d243aae None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:56.640291 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e2284-80e4-4c03-bae5-08800d243aae None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:56.640566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e2284-80e4-4c03-bae5-08800d243aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:56.659164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-295e2284-80e4-4c03-bae5-08800d243aae None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:56.660414 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-295e2284-80e4-4c03-bae5-08800d243aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:56.724311 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:56.732838 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c4149-e601-4e80-96e8-c73b51bc7a67 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:56.735929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 273/555] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:56.738170 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37438adf-d676-42fc-9a43-68cc735771af None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:56.738458 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37438adf-d676-42fc-9a43-68cc735771af None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:56.738731 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37438adf-d676-42fc-9a43-68cc735771af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:56.757620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-37438adf-d676-42fc-9a43-68cc735771af None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:56.758824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-37438adf-d676-42fc-9a43-68cc735771af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:56.773604 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25334b-f120-49ea-84f5-1403bb6ef7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:56.774910 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25334b-f120-49ea-84f5-1403bb6ef7c8 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:56.775390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25334b-f120-49ea-84f5-1403bb6ef7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:56.775901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25334b-f120-49ea-84f5-1403bb6ef7c8 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:56.777149 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25334b-f120-49ea-84f5-1403bb6ef7c8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:56.777890 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25334b-f120-49ea-84f5-1403bb6ef7c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:56.779484 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25334b-f120-49ea-84f5-1403bb6ef7c8 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:56.788050 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:56.802031 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 283/556] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Sep 28 12:01:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:56.803136 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25334b-f120-49ea-84f5-1403bb6ef7c8 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:56.834072 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 274/557] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:56.835178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37438adf-d676-42fc-9a43-68cc735771af None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:56.977633 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25334b-f120-49ea-84f5-1403bb6ef7c8 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:57.013906 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37438adf-d676-42fc-9a43-68cc735771af None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:57.038008 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cac4e-b0a0-4537-bcb8-5b32f0e2caee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:57.038636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cac4e-b0a0-4537-bcb8-5b32f0e2caee None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:57.038909 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cac4e-b0a0-4537-bcb8-5b32f0e2caee None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:57.039176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cac4e-b0a0-4537-bcb8-5b32f0e2caee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:57.049485 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cac4e-b0a0-4537-bcb8-5b32f0e2caee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:57.051183 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cac4e-b0a0-4537-bcb8-5b32f0e2caee None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:57.051423 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a9487-21d5-466e-82ee-e7bb11da43c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:57.052242 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a9487-21d5-466e-82ee-e7bb11da43c6 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:57.052668 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a9487-21d5-466e-82ee-e7bb11da43c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:57.053085 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a9487-21d5-466e-82ee-e7bb11da43c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:57.065988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-0e9cac4e-b0a0-4537-bcb8-5b32f0e2caee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:57.065988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:57.065988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:57.065988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:57.065988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:57.065988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:57.065988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:57.065988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:57.065988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:57.065988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:57.065988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:57.065988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:57.065988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:01:57.065988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:01:57.065988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:01:57.065988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:01:57.067042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:57.067042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:57.067042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:57.067042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:57.067042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:57.067042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:57.067042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:57.067042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:57.067042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:57.067042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:57.067042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:57.067042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:57.067042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:57.067042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:57.067042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:57.067042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:57.067042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:01:57.068030 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:01:57.068030 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:57.068030 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:57.071754 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 284/558] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:57.072608 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cac4e-b0a0-4537-bcb8-5b32f0e2caee None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:57.090415 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:57.118788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:57.175249 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a9487-21d5-466e-82ee-e7bb11da43c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:57.176931 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a9487-21d5-466e-82ee-e7bb11da43c6 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:57.207785 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cac4e-b0a0-4537-bcb8-5b32f0e2caee None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:57.245284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833636a8-59ec-4fce-a68d-0f1edfde68c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:57.245840 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833636a8-59ec-4fce-a68d-0f1edfde68c3 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:57.246342 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833636a8-59ec-4fce-a68d-0f1edfde68c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:57.246496 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833636a8-59ec-4fce-a68d-0f1edfde68c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:57.257536 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833636a8-59ec-4fce-a68d-0f1edfde68c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:57.264546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-833636a8-59ec-4fce-a68d-0f1edfde68c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:01:57.264546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:57.264546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:57.264546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:57.264546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:57.264546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:57.264546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:57.264546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:57.264546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:57.264546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:57.264546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:57.264546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:57.264546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:57.264546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:57.264546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:57.264546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:57.265509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:57.265509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:57.265509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:57.265509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:57.265509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:57.265509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:57.265509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:57.265509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:57.265509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:57.265509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:57.265509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:57.265509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:57.265509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:57.265509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:57.265509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:57.265509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:57.266349 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:57.266349 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:57.266349 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:57.266349 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:57.266349 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:57.266349 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:57.266349 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:57.266349 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:57.266349 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:57.266349 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:57.266349 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:01:57.266349 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:57.271483 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 285/559] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 28 12:01:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:57.271483 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833636a8-59ec-4fce-a68d-0f1edfde68c3 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:57.293215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 275/560] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:01:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:01:57.294055 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a9487-21d5-466e-82ee-e7bb11da43c6 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:57.340564 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:57.356622 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:57.373820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833636a8-59ec-4fce-a68d-0f1edfde68c3 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:57.394237 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a9487-21d5-466e-82ee-e7bb11da43c6 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:57.407025 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801bb6e-b403-417e-ae14-aa4585158415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:57.407645 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801bb6e-b403-417e-ae14-aa4585158415 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:57.407919 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801bb6e-b403-417e-ae14-aa4585158415 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:57.408186 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801bb6e-b403-417e-ae14-aa4585158415 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:57.408821 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801bb6e-b403-417e-ae14-aa4585158415 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:57.409117 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801bb6e-b403-417e-ae14-aa4585158415 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:57.410530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801bb6e-b403-417e-ae14-aa4585158415 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:57.421764 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 286/561] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:57.422537 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801bb6e-b403-417e-ae14-aa4585158415 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:57.427930 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00055f-4d9b-41ca-a35f-6b625dcf2549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:57.428562 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00055f-4d9b-41ca-a35f-6b625dcf2549 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:57.428840 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00055f-4d9b-41ca-a35f-6b625dcf2549 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:57.429134 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00055f-4d9b-41ca-a35f-6b625dcf2549 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:57.439497 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00055f-4d9b-41ca-a35f-6b625dcf2549 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:57.444812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-0a00055f-4d9b-41ca-a35f-6b625dcf2549 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:01:57.444812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:57.444812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:57.444812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:57.444812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:57.444812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:57.444812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:57.444812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:57.444812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:57.444812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:57.444812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:57.444812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:57.444812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:57.444812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:57.444812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:57.444812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:57.445747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:57.445747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:57.445747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:57.445747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:57.445747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:57.445747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:57.445747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:57.445747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:57.445747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:57.445747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:57.445747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:57.445747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:57.445747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:57.445747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:57.445747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:57.445747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:57.446621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:57.446621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:57.446621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:57.446621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:57.446621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:57.446621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:57.446621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:57.446621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:57.446621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:57.446621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:57.446621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:01:57.446621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:57.446621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 276/562] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 28 12:01:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:57.447472 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb06d1-6422-4330-a04c-b97cff2d86c1 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:57.447472 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb06d1-6422-4330-a04c-b97cff2d86c1 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:57.447616 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb06d1-6422-4330-a04c-b97cff2d86c1 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:57.448890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 277/563] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:01:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:01:57.449420 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb06d1-6422-4330-a04c-b97cff2d86c1 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:57.526131 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801bb6e-b403-417e-ae14-aa4585158415 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:57.549644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb06d1-6422-4330-a04c-b97cff2d86c1 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:57.555328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:57.562200 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89343cad-e3a5-4582-9a03-3783eef0435d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:57.564763 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89343cad-e3a5-4582-9a03-3783eef0435d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:57.565042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89343cad-e3a5-4582-9a03-3783eef0435d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:57.565315 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89343cad-e3a5-4582-9a03-3783eef0435d None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:57.565993 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89343cad-e3a5-4582-9a03-3783eef0435d None admin] RBAC: Adding query filter params (name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:57.566328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89343cad-e3a5-4582-9a03-3783eef0435d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:57.567726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89343cad-e3a5-4582-9a03-3783eef0435d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:57.576427 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:57.579098 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 287/564] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 28 12:01:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:57.579960 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89343cad-e3a5-4582-9a03-3783eef0435d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:57.592934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15fdcf-aa82-4b02-b90e-5ebbb13ddbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:57.593560 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15fdcf-aa82-4b02-b90e-5ebbb13ddbfe None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:57.593835 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15fdcf-aa82-4b02-b90e-5ebbb13ddbfe None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:57.594102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15fdcf-aa82-4b02-b90e-5ebbb13ddbfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:57.604594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d15fdcf-aa82-4b02-b90e-5ebbb13ddbfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:57.606035 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d15fdcf-aa82-4b02-b90e-5ebbb13ddbfe None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:57.620976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-0d15fdcf-aa82-4b02-b90e-5ebbb13ddbfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:57.620976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:57.620976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:57.620976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:57.620976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:57.620976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:57.620976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:57.620976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:57.620976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:57.620976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:57.620976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:57.620976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:57.620976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:01:57.620976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:01:57.620976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:01:57.620976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:01:57.621926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:57.621926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:57.621926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:57.621926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:57.621926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:57.621926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:57.621926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:57.621926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:57.621926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:57.621926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:57.621926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:57.621926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:57.621926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:57.621926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:57.621926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:57.621926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:57.621926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:01:57.622847 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:01:57.622847 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:57.622847 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:57.622847 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 278/565] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:57.622847 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15fdcf-aa82-4b02-b90e-5ebbb13ddbfe None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:57.694638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89343cad-e3a5-4582-9a03-3783eef0435d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:57.720577 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15fdcf-aa82-4b02-b90e-5ebbb13ddbfe None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:57.730546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e5d4c-8de4-45ad-aacc-255257a3f790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:57.730546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e5d4c-8de4-45ad-aacc-255257a3f790 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:57.730546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e5d4c-8de4-45ad-aacc-255257a3f790 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:57.730546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e5d4c-8de4-45ad-aacc-255257a3f790 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:57.737284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e5d4c-8de4-45ad-aacc-255257a3f790 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:57.739271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e5d4c-8de4-45ad-aacc-255257a3f790 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:57.750481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-967e5d4c-8de4-45ad-aacc-255257a3f790 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:01:57.750481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:57.750481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:57.750481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:57.750481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:57.750481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:57.750481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:57.750481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:57.750481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:57.750481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:57.750481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:57.750481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:57.750481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:01:57.750481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:01:57.750481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:01:57.750481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:01:57.751517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:57.751517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:57.751517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:01:57.751517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:01:57.751517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:01:57.751517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:01:57.751517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:57.751517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:57.751517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:57.751517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:57.751517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:57.751517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:57.751517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:57.751517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:57.751517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:57.751517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:57.751517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:57.751517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:57.752459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:57.752459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:57.752459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:01:57.752459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:01:57.752459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:01:57.752459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:01:57.752459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:01:57.752459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:01:57.752459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:01:57.752459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:57.752459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 288/566] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Sep 28 12:01:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:57.753072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08253c-331f-46dc-8add-0519f47b769a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:57.753173 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08253c-331f-46dc-8add-0519f47b769a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:57.753451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08253c-331f-46dc-8add-0519f47b769a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:57.759659 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324205f-cdf6-4c26-8fff-3c72f2343db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:57.760271 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324205f-cdf6-4c26-8fff-3c72f2343db2 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:57.760730 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324205f-cdf6-4c26-8fff-3c72f2343db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:57.761004 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324205f-cdf6-4c26-8fff-3c72f2343db2 None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:57.761673 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324205f-cdf6-4c26-8fff-3c72f2343db2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:57.761979 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324205f-cdf6-4c26-8fff-3c72f2343db2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:57.763350 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324205f-cdf6-4c26-8fff-3c72f2343db2 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:57.771214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-9a08253c-331f-46dc-8add-0519f47b769a None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:01:57.771418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 279/567] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 28 12:01:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:57.772219 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324205f-cdf6-4c26-8fff-3c72f2343db2 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:57.772806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9a08253c-331f-46dc-8add-0519f47b769a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:01:57.811574 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:57.822415 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:57.841776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 289/568] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:01:57.842818 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08253c-331f-46dc-8add-0519f47b769a None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:57.889947 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324205f-cdf6-4c26-8fff-3c72f2343db2 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:57.924169 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132627f-f9bf-4090-9268-810b0da93ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:57.924796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132627f-f9bf-4090-9268-810b0da93ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:57.925079 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132627f-f9bf-4090-9268-810b0da93ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:57.925354 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132627f-f9bf-4090-9268-810b0da93ac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:57.937231 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132627f-f9bf-4090-9268-810b0da93ac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:57.938692 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132627f-f9bf-4090-9268-810b0da93ac8 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:57.949049 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08253c-331f-46dc-8add-0519f47b769a None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:57.953020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-6132627f-f9bf-4090-9268-810b0da93ac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:57.953020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:57.953020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:57.953020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:57.953020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:57.953020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:57.953020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:57.953020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:57.953020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:57.953020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:57.953020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:57.953020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:57.953020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:01:57.953020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:01:57.953020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:01:57.953020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:01:57.953940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:57.953940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:57.953940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:57.953940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:57.953940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:57.953940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:57.953940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:57.953940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:57.953940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:57.953940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:57.953940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:57.953940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:57.953940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:57.953940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:57.953940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:57.953940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:57.953940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:01:57.959691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:01:57.959691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:57.959691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:57.959691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 280/569] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:57.959691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132627f-f9bf-4090-9268-810b0da93ac8 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:57.989588 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a87d4-fe83-400d-a149-34a4b9bcad67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:57.990276 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a87d4-fe83-400d-a149-34a4b9bcad67 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:57.990624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a87d4-fe83-400d-a149-34a4b9bcad67 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:57.991306 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a87d4-fe83-400d-a149-34a4b9bcad67 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:57.992162 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a87d4-fe83-400d-a149-34a4b9bcad67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:57.992465 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a87d4-fe83-400d-a149-34a4b9bcad67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:57.993837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a87d4-fe83-400d-a149-34a4b9bcad67 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:58.010611 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 290/570] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:58.010611 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a87d4-fe83-400d-a149-34a4b9bcad67 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:58.052215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:58.057976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:58.062354 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132627f-f9bf-4090-9268-810b0da93ac8 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:58.095827 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6994851-daac-4535-b7b7-bbf83f90133d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:58.096565 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6994851-daac-4535-b7b7-bbf83f90133d None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:58.096846 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6994851-daac-4535-b7b7-bbf83f90133d None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:58.097112 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6994851-daac-4535-b7b7-bbf83f90133d None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:58.098361 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6994851-daac-4535-b7b7-bbf83f90133d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:58.098660 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6994851-daac-4535-b7b7-bbf83f90133d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:58.100105 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6994851-daac-4535-b7b7-bbf83f90133d None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:58.118207 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 281/571] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Sep 28 12:01:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:58.119007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6994851-daac-4535-b7b7-bbf83f90133d None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:58.122558 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a87d4-fe83-400d-a149-34a4b9bcad67 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:58.155388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495484a-0c33-4496-9fea-10c63a918da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:58.156035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495484a-0c33-4496-9fea-10c63a918da5 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:58.156317 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495484a-0c33-4496-9fea-10c63a918da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:58.156589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495484a-0c33-4496-9fea-10c63a918da5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:58.167632 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495484a-0c33-4496-9fea-10c63a918da5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:58.169069 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495484a-0c33-4496-9fea-10c63a918da5 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:58.183395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-6495484a-0c33-4496-9fea-10c63a918da5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:58.183395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:58.183395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:58.183395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:58.183395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:58.183395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:58.183395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:58.183395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:58.183395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:58.183395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:58.183395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:58.183395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:58.183395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:01:58.183395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:01:58.183395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:01:58.183395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:01:58.184535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:58.184535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:58.184535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:58.184535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:58.184535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:58.184535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:58.184535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:58.184535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:58.184535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:58.184535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:58.184535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:58.184535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:58.184535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:58.184535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:58.184535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:58.184535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:58.184535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:01:58.185624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:01:58.185624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:58.185624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:58.185624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 291/572] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:58.185624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495484a-0c33-4496-9fea-10c63a918da5 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:58.221349 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6994851-daac-4535-b7b7-bbf83f90133d None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:58.256405 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942661d4-7456-4927-a15a-928f02eea046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:58.257009 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942661d4-7456-4927-a15a-928f02eea046 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:58.257286 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942661d4-7456-4927-a15a-928f02eea046 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:58.257562 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942661d4-7456-4927-a15a-928f02eea046 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:58.258198 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942661d4-7456-4927-a15a-928f02eea046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:58.258502 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942661d4-7456-4927-a15a-928f02eea046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:58.259901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942661d4-7456-4927-a15a-928f02eea046 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:58.271634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 282/573] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:58.272579 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942661d4-7456-4927-a15a-928f02eea046 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:58.275925 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:58.283398 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495484a-0c33-4496-9fea-10c63a918da5 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:58.286791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:58.318017 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb75bc-fc2b-4eaf-a4e4-09e5adf9e73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:58.318574 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb75bc-fc2b-4eaf-a4e4-09e5adf9e73a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:58.318853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb75bc-fc2b-4eaf-a4e4-09e5adf9e73a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:58.319132 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb75bc-fc2b-4eaf-a4e4-09e5adf9e73a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:58.325666 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb75bc-fc2b-4eaf-a4e4-09e5adf9e73a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:58.327090 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb75bc-fc2b-4eaf-a4e4-09e5adf9e73a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:58.338981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-ecdb75bc-fc2b-4eaf-a4e4-09e5adf9e73a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:01:58.338981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:58.338981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:58.338981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:58.338981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:58.338981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:58.338981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:58.338981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:58.338981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:58.338981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:58.338981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:58.338981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:58.338981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:01:58.338981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:01:58.338981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:01:58.340079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:01:58.340079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:58.340079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:58.340079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:58.340079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:58.340079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:58.340079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:58.340079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:58.340079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:58.340079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:58.340079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:58.340079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:58.340079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:58.340079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:58.340079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:58.340079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:58.340079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:58.341044 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:01:58.341044 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:01:58.341044 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:01:58.341044 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:01:58.341044 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:01:58.341044 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:01:58.341044 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:01:58.341044 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:58.344807 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 292/574] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:01:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:58.345581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb75bc-fc2b-4eaf-a4e4-09e5adf9e73a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:58.374262 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942661d4-7456-4927-a15a-928f02eea046 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:58.407713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0afce-13ba-46d3-98b9-6bfd5112ac8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:58.408332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0afce-13ba-46d3-98b9-6bfd5112ac8a None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:58.408617 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0afce-13ba-46d3-98b9-6bfd5112ac8a None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:58.408889 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0afce-13ba-46d3-98b9-6bfd5112ac8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:58.418770 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0afce-13ba-46d3-98b9-6bfd5112ac8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:01:58.423966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-aeb0afce-13ba-46d3-98b9-6bfd5112ac8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:01:58.423966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:58.423966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:58.423966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:58.423966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:58.423966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:58.423966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:58.423966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:58.423966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:58.423966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:58.423966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:58.423966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:58.423966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:01:58.423966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:01:58.423966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:01:58.423966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:01:58.425111 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:01:58.425111 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:01:58.425111 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:01:58.425111 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:01:58.425111 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:58.425111 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:58.425111 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:58.425111 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:58.425111 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:58.425111 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:58.425111 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:58.425111 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:58.425111 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:58.425111 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:58.425111 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:58.425111 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:58.426011 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:58.426011 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:58.426011 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:58.426011 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:58.426011 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:01:58.426011 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:01:58.426011 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:01:58.426011 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:01:58.426011 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:01:58.426011 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:01:58.426011 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:01:58.426011 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:58.426011 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 283/575] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 28 12:01:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:58.426720 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0afce-13ba-46d3-98b9-6bfd5112ac8a None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:58.447762 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb75bc-fc2b-4eaf-a4e4-09e5adf9e73a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:58.481357 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92200d1e-f87b-434d-ade6-eee43a451e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:58.482059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92200d1e-f87b-434d-ade6-eee43a451e65 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:58.482335 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92200d1e-f87b-434d-ade6-eee43a451e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:58.482602 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92200d1e-f87b-434d-ade6-eee43a451e65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:58.492279 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:58.494085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92200d1e-f87b-434d-ade6-eee43a451e65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:58.495568 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92200d1e-f87b-434d-ade6-eee43a451e65 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:58.510043 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-92200d1e-f87b-434d-ade6-eee43a451e65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:58.510043 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:58.510043 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:58.510043 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:58.510043 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:58.510043 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:58.510043 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:58.510043 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:58.510043 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:58.510043 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:58.510043 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:58.510043 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:58.510043 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:01:58.510043 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:01:58.510043 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:01:58.510043 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:01:58.511051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:58.511051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:58.511051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:58.511051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:58.511051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:58.511051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:58.511051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:58.511051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:58.511051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:58.511051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:58.511051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:58.511051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:58.511051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:58.511051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:58.511051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:58.511051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:58.511051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:01:58.512001 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:01:58.512001 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:58.512001 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:58.512001 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 293/576] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:58.512001 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92200d1e-f87b-434d-ade6-eee43a451e65 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:58.524233 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:58.530386 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0afce-13ba-46d3-98b9-6bfd5112ac8a None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:58.564592 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77487f-5a6f-4b0e-a93e-ef8a2dc1e72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:58.565393 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77487f-5a6f-4b0e-a93e-ef8a2dc1e72f None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:58.565673 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77487f-5a6f-4b0e-a93e-ef8a2dc1e72f None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:58.565946 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77487f-5a6f-4b0e-a93e-ef8a2dc1e72f None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:58.567139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77487f-5a6f-4b0e-a93e-ef8a2dc1e72f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:58.567470 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77487f-5a6f-4b0e-a93e-ef8a2dc1e72f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:58.568915 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77487f-5a6f-4b0e-a93e-ef8a2dc1e72f None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:58.581029 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 284/577] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:58.581830 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77487f-5a6f-4b0e-a93e-ef8a2dc1e72f None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:58.616842 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92200d1e-f87b-434d-ade6-eee43a451e65 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:58.649661 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a444522-1576-4e35-8d62-35e35bdce737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:58.650277 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a444522-1576-4e35-8d62-35e35bdce737 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:58.650551 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a444522-1576-4e35-8d62-35e35bdce737 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:58.650815 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a444522-1576-4e35-8d62-35e35bdce737 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:58.657969 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a444522-1576-4e35-8d62-35e35bdce737 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:58.659398 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a444522-1576-4e35-8d62-35e35bdce737 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:58.670826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-1a444522-1576-4e35-8d62-35e35bdce737 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 28 12:01:58.670826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:58.670826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:58.670826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:58.670826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:58.670826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:58.670826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:58.670826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:58.670826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:58.670826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:58.670826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:58.670826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:58.670826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:01:58.670826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:01:58.670826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:01:58.670826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:01:58.671832 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:58.671832 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:58.671832 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:01:58.671832 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:01:58.671832 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:01:58.671832 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:01:58.671832 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:58.671832 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:58.671832 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:58.671832 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:58.671832 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:58.671832 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:58.671832 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:58.671832 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:58.671832 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:58.671832 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:58.671832 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:58.671832 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:58.672795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:58.672795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:58.672795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:01:58.672795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:01:58.672795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:01:58.672795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:01:58.672795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:01:58.672795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:01:58.672795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 28 12:01:58.672795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:58.675597 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 294/578] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:58.676570 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a444522-1576-4e35-8d62-35e35bdce737 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:58.680078 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77487f-5a6f-4b0e-a93e-ef8a2dc1e72f None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:58.709875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:58.718399 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db2fda-8c65-4b10-8aa2-cbb3da7ef326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:58.719002 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db2fda-8c65-4b10-8aa2-cbb3da7ef326 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:58.719280 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db2fda-8c65-4b10-8aa2-cbb3da7ef326 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:58.719584 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db2fda-8c65-4b10-8aa2-cbb3da7ef326 None admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:58.720271 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db2fda-8c65-4b10-8aa2-cbb3da7ef326 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:58.720574 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db2fda-8c65-4b10-8aa2-cbb3da7ef326 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:58.722011 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db2fda-8c65-4b10-8aa2-cbb3da7ef326 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:58.734286 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 285/579] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:01:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:58.735109 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db2fda-8c65-4b10-8aa2-cbb3da7ef326 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:58.745663 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:58.782894 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a444522-1576-4e35-8d62-35e35bdce737 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:58.817028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a34ca-7edc-4529-89e3-44b09644ca4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:58.817711 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a34ca-7edc-4529-89e3-44b09644ca4d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:58.817990 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a34ca-7edc-4529-89e3-44b09644ca4d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:58.818251 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a34ca-7edc-4529-89e3-44b09644ca4d None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:58.818905 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a34ca-7edc-4529-89e3-44b09644ca4d None admin] RBAC: Adding query filter params (name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:58.819293 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a34ca-7edc-4529-89e3-44b09644ca4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:58.820658 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a34ca-7edc-4529-89e3-44b09644ca4d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:58.828375 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 295/580] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 28 12:01:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:58.829239 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a34ca-7edc-4529-89e3-44b09644ca4d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:58.838612 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db2fda-8c65-4b10-8aa2-cbb3da7ef326 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:58.872300 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50309f-77b5-4b81-9e81-bccde7e49ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:58.872904 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50309f-77b5-4b81-9e81-bccde7e49ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:58.873182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50309f-77b5-4b81-9e81-bccde7e49ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:58.873455 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50309f-77b5-4b81-9e81-bccde7e49ce5 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:58.874085 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50309f-77b5-4b81-9e81-bccde7e49ce5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:58.874386 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50309f-77b5-4b81-9e81-bccde7e49ce5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:58.875781 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50309f-77b5-4b81-9e81-bccde7e49ce5 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:58.892212 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 286/581] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:58.892539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50309f-77b5-4b81-9e81-bccde7e49ce5 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:58.927767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a34ca-7edc-4529-89e3-44b09644ca4d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:58.939312 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:58.956096 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:58.965718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24058497-ead8-42be-8d29-1f12dac8ca60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:58.966349 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24058497-ead8-42be-8d29-1f12dac8ca60 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:58.966621 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24058497-ead8-42be-8d29-1f12dac8ca60 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:58.966890 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24058497-ead8-42be-8d29-1f12dac8ca60 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:58.975149 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24058497-ead8-42be-8d29-1f12dac8ca60 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:58.976624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24058497-ead8-42be-8d29-1f12dac8ca60 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:58.987727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-24058497-ead8-42be-8d29-1f12dac8ca60 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 28 12:01:58.987727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:58.987727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:58.987727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:58.987727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:58.987727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:58.987727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:58.987727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:58.987727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:58.987727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:58.987727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:58.987727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:58.987727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:01:58.987727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:01:58.987727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:01:58.987727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:01:58.988687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:58.988687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:58.988687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:01:58.988687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:01:58.988687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:01:58.988687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:01:58.988687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:58.988687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:58.988687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:58.988687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:58.988687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:58.988687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:58.988687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:58.988687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:58.988687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:58.988687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:58.988687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:58.988687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:58.989630 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:58.989630 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:58.989630 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:01:58.989630 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:01:58.989630 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:01:58.989630 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:01:58.989630 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:01:58.989630 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:01:58.989630 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 28 12:01:58.989630 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:58.989630 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 296/582] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:01:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:58.990233 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24058497-ead8-42be-8d29-1f12dac8ca60 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:58.994969 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50309f-77b5-4b81-9e81-bccde7e49ce5 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:59.029256 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca03227-3a3d-45a2-b334-ea9bc03ca09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:59.029860 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca03227-3a3d-45a2-b334-ea9bc03ca09b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:59.030136 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca03227-3a3d-45a2-b334-ea9bc03ca09b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:59.030407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca03227-3a3d-45a2-b334-ea9bc03ca09b None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:59.031126 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca03227-3a3d-45a2-b334-ea9bc03ca09b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:59.031464 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca03227-3a3d-45a2-b334-ea9bc03ca09b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:59.032890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca03227-3a3d-45a2-b334-ea9bc03ca09b None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:59.050019 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 287/583] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Sep 28 12:01:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:59.050830 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca03227-3a3d-45a2-b334-ea9bc03ca09b None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:59.091835 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24058497-ead8-42be-8d29-1f12dac8ca60 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:59.124551 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdba72-2cea-4b9e-a7a5-8d3d224bb50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:59.125148 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdba72-2cea-4b9e-a7a5-8d3d224bb50f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:59.125427 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdba72-2cea-4b9e-a7a5-8d3d224bb50f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:59.125696 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdba72-2cea-4b9e-a7a5-8d3d224bb50f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:59.126415 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cdba72-2cea-4b9e-a7a5-8d3d224bb50f None admin] RBAC: Adding query filter params (role.id=9b8671e5f63c4b08982273f189eab5ec, scope.project.id=c854d366f35145e8b2fadb9b014d0199, user.id=822e394e80fd41adb54d330adaf65a68) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:59.126723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cdba72-2cea-4b9e-a7a5-8d3d224bb50f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:59.128168 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cdba72-2cea-4b9e-a7a5-8d3d224bb50f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:59.134051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 297/584] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:01:58 2022] GET /identity/v3/role_assignments?user.id=822e394e80fd41adb54d330adaf65a68&scope.project.id=c854d366f35145e8b2fadb9b014d0199&role.id=9b8671e5f63c4b08982273f189eab5ec => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:59.134807 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdba72-2cea-4b9e-a7a5-8d3d224bb50f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:59.157930 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca03227-3a3d-45a2-b334-ea9bc03ca09b None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:59.166379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:59.194697 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:59.199373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdce94d-c020-40bc-ac95-eb910060a1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:59.200168 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdce94d-c020-40bc-ac95-eb910060a1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:59.200352 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdce94d-c020-40bc-ac95-eb910060a1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:59.200594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdce94d-c020-40bc-ac95-eb910060a1e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:59.213132 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdce94d-c020-40bc-ac95-eb910060a1e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:59.214647 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdce94d-c020-40bc-ac95-eb910060a1e6 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:59.234686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-2bdce94d-c020-40bc-ac95-eb910060a1e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:59.234686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:59.234686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:59.234686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:59.234686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:59.234686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:59.234686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:59.234686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:59.234686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:59.234686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:59.234686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:59.234686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:59.234686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:01:59.234686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:01:59.234686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:01:59.234686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:01:59.235981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:59.235981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:59.235981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:59.235981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:59.235981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:59.235981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:59.235981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:59.235981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:59.235981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:59.235981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:59.235981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:59.235981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:59.235981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:59.235981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:59.235981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:59.235981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:59.235981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:01:59.236889 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:01:59.236889 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:59.236889 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:59.237478 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 288/585] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:59.239001 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdce94d-c020-40bc-ac95-eb910060a1e6 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:59.264341 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdba72-2cea-4b9e-a7a5-8d3d224bb50f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:59.304439 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05e768-ad19-408a-8eb0-95856a8c2838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:59.305411 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05e768-ad19-408a-8eb0-95856a8c2838 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:59.305870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05e768-ad19-408a-8eb0-95856a8c2838 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:59.306331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05e768-ad19-408a-8eb0-95856a8c2838 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:59.314950 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05e768-ad19-408a-8eb0-95856a8c2838 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:59.316989 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05e768-ad19-408a-8eb0-95856a8c2838 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:59.330337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-cd05e768-ad19-408a-8eb0-95856a8c2838 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:01:59.330337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:59.330337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:59.330337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:59.330337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:59.330337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:59.330337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:59.330337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:59.330337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:59.330337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:59.330337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:59.330337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:59.330337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:01:59.330337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:01:59.330337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:01:59.331295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:01:59.331295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:59.331295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:59.331295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:59.331295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:59.331295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:59.331295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:59.331295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:59.331295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:59.331295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:59.331295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:59.331295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:59.331295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:59.331295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:59.331295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:59.331295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:59.331295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:59.332788 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:01:59.332788 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:01:59.332788 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:01:59.332788 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:01:59.332788 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:01:59.332788 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:01:59.332788 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:01:59.332788 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:59.332788 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 298/586] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:01:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:59.332788 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05e768-ad19-408a-8eb0-95856a8c2838 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:59.364448 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdce94d-c020-40bc-ac95-eb910060a1e6 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:59.411284 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f597f0-71bf-4d06-9fd7-8ccecc94cceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:59.412188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f597f0-71bf-4d06-9fd7-8ccecc94cceb None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:59.412617 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f597f0-71bf-4d06-9fd7-8ccecc94cceb None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:59.413037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f597f0-71bf-4d06-9fd7-8ccecc94cceb None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:59.413940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f597f0-71bf-4d06-9fd7-8ccecc94cceb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:59.414402 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f597f0-71bf-4d06-9fd7-8ccecc94cceb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:59.416154 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f597f0-71bf-4d06-9fd7-8ccecc94cceb None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:59.437009 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 289/587] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Sep 28 12:01:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:59.438125 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f597f0-71bf-4d06-9fd7-8ccecc94cceb None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:59.448308 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05e768-ad19-408a-8eb0-95856a8c2838 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:59.458822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:59.463007 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:59.486144 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3c1f0-54be-46ea-9df0-5f03cb9d99b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:59.486938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3c1f0-54be-46ea-9df0-5f03cb9d99b3 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:59.487305 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3c1f0-54be-46ea-9df0-5f03cb9d99b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:59.487697 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3c1f0-54be-46ea-9df0-5f03cb9d99b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:59.517382 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3c1f0-54be-46ea-9df0-5f03cb9d99b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:59.518833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3c1f0-54be-46ea-9df0-5f03cb9d99b3 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:59.541180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-02b3c1f0-54be-46ea-9df0-5f03cb9d99b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:59.541180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:59.541180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:59.541180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:59.541180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:59.541180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:59.541180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:59.541180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:59.541180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:59.541180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:59.541180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:59.541180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:59.541180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:01:59.541180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:01:59.541180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:01:59.541180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:01:59.542235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:59.542235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:59.542235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:59.542235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:59.542235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:59.542235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:59.542235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:59.542235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:59.542235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:59.542235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:59.542235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:59.542235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:59.542235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:59.542235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:59.542235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:59.542235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:59.542235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:01:59.543181 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:01:59.543181 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:59.543181 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:01:59.543181 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 299/588] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:59.543425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3c1f0-54be-46ea-9df0-5f03cb9d99b3 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:59.560400 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f597f0-71bf-4d06-9fd7-8ccecc94cceb None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:59.600915 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac596fc-6fe1-4833-a91b-f9346075b5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:59.601650 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac596fc-6fe1-4833-a91b-f9346075b5a2 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:59.602088 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac596fc-6fe1-4833-a91b-f9346075b5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:59.602429 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac596fc-6fe1-4833-a91b-f9346075b5a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:59.603163 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac596fc-6fe1-4833-a91b-f9346075b5a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:59.603682 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac596fc-6fe1-4833-a91b-f9346075b5a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:59.605312 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac596fc-6fe1-4833-a91b-f9346075b5a2 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:59.621753 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 290/589] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:59.622502 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac596fc-6fe1-4833-a91b-f9346075b5a2 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:59.680966 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3c1f0-54be-46ea-9df0-5f03cb9d99b3 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:59.737820 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:59.741995 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3b7de-16a7-40a0-85b0-65aeeb8e795e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:59.742693 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3b7de-16a7-40a0-85b0-65aeeb8e795e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:59.742884 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3b7de-16a7-40a0-85b0-65aeeb8e795e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:59.743196 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3b7de-16a7-40a0-85b0-65aeeb8e795e None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:59.743866 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3b7de-16a7-40a0-85b0-65aeeb8e795e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:59.744177 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3b7de-16a7-40a0-85b0-65aeeb8e795e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:59.745602 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3b7de-16a7-40a0-85b0-65aeeb8e795e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:59.772378 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 300/590] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:01:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:59.773900 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3b7de-16a7-40a0-85b0-65aeeb8e795e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:59.786113 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac596fc-6fe1-4833-a91b-f9346075b5a2 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:59.800212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:01:59.826546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028f10d-ae58-4dd9-a9f5-1f946d51bf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:59.827180 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028f10d-ae58-4dd9-a9f5-1f946d51bf85 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:59.827479 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028f10d-ae58-4dd9-a9f5-1f946d51bf85 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:59.827755 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028f10d-ae58-4dd9-a9f5-1f946d51bf85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:59.840493 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028f10d-ae58-4dd9-a9f5-1f946d51bf85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:59.842015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028f10d-ae58-4dd9-a9f5-1f946d51bf85 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:59.856746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-d028f10d-ae58-4dd9-a9f5-1f946d51bf85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:59.856746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:01:59.856746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:01:59.856746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:01:59.856746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:01:59.856746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:01:59.856746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:01:59.856746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:01:59.856746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:01:59.856746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:01:59.856746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:01:59.856746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:01:59.856746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:01:59.856746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:01:59.856746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:01:59.856746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:01:59.857883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:01:59.857883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:01:59.857883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:01:59.857883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:01:59.857883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:01:59.857883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:01:59.857883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:01:59.857883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:01:59.857883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:01:59.857883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:01:59.857883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:01:59.857883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:01:59.857883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:01:59.857883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:01:59.857883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:01:59.857883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:01:59.857883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:01:59.858935 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:01:59.858935 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:01:59.858935 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:01:59.858935 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 291/591] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:01:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:01:59.863164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028f10d-ae58-4dd9-a9f5-1f946d51bf85 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:59.885342 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3b7de-16a7-40a0-85b0-65aeeb8e795e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:01:59.922872 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f356ed-36b3-40d9-800b-032c9887a232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:01:59.923653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f356ed-36b3-40d9-800b-032c9887a232 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:01:59.924031 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f356ed-36b3-40d9-800b-032c9887a232 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:01:59.924403 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f356ed-36b3-40d9-800b-032c9887a232 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:01:59.925147 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f356ed-36b3-40d9-800b-032c9887a232 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:01:59.925601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f356ed-36b3-40d9-800b-032c9887a232 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:01:59.927058 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f356ed-36b3-40d9-800b-032c9887a232 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:01:59.940063 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 301/592] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:01:59.940784 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f356ed-36b3-40d9-800b-032c9887a232 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:01:59.980606 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028f10d-ae58-4dd9-a9f5-1f946d51bf85 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:00.008716 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:00.017810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191b4ca-83e4-4936-b8aa-c0040be1eb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:00.018461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191b4ca-83e4-4936-b8aa-c0040be1eb1f None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:00.018739 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191b4ca-83e4-4936-b8aa-c0040be1eb1f None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:00.019009 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191b4ca-83e4-4936-b8aa-c0040be1eb1f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:00.028550 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191b4ca-83e4-4936-b8aa-c0040be1eb1f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:00.030014 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191b4ca-83e4-4936-b8aa-c0040be1eb1f None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:00.032420 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:00.042194 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-9191b4ca-83e4-4936-b8aa-c0040be1eb1f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 28 12:02:00.042194 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:00.042194 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:00.042194 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:00.042194 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:00.042194 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:00.042194 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:00.042194 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:00.042194 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:00.042194 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:00.042194 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:00.042194 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:00.042194 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:02:00.042194 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:02:00.042194 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:02:00.042194 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:02:00.043379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:00.043379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:00.043379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:02:00.043379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:00.043379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:02:00.043379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:00.043379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:00.043379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:00.043379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:00.043379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:00.043379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:00.043379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:00.043379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:00.043379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:00.043379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:00.043379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:00.043379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:00.043379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:00.044890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:00.044890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:00.044890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:02:00.044890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:02:00.044890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:02:00.044890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:02:00.044890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:02:00.044890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:02:00.044890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 28 12:02:00.044890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:00.047948 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 292/593] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 28 12:01:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:00.048622 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191b4ca-83e4-4936-b8aa-c0040be1eb1f None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:00.053895 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f356ed-36b3-40d9-800b-032c9887a232 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:00.088707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654fc6c-0b08-4dea-b646-ac0d35e802b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:00.089510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654fc6c-0b08-4dea-b646-ac0d35e802b0 None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:00.089888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654fc6c-0b08-4dea-b646-ac0d35e802b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:00.090256 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654fc6c-0b08-4dea-b646-ac0d35e802b0 None admin] PATH_INFO: `/v3/projects/c854d366f35145e8b2fadb9b014d0199/users/0e81804e04514ae882a1fd93789db025/roles/9b8671e5f63c4b08982273f189eab5ec` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:00.106307 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654fc6c-0b08-4dea-b646-ac0d35e802b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c854d366f35145e8b2fadb9b014d0199, user_id=0e81804e04514ae882a1fd93789db025, role_id=9b8671e5f63c4b08982273f189eab5ec)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:00.107879 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654fc6c-0b08-4dea-b646-ac0d35e802b0 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:00.131474 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 302/594] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 28 12:01:59 2022] PUT /identity/v3/projects/c854d366f35145e8b2fadb9b014d0199/users/0e81804e04514ae882a1fd93789db025/roles/9b8671e5f63c4b08982273f189eab5ec => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:02:00.131474 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654fc6c-0b08-4dea-b646-ac0d35e802b0 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:00.162925 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191b4ca-83e4-4936-b8aa-c0040be1eb1f None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:00.213623 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabce90-e861-421d-b9d0-6525e41af793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:00.214313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabce90-e861-421d-b9d0-6525e41af793 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:00.214751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabce90-e861-421d-b9d0-6525e41af793 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:00.215146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabce90-e861-421d-b9d0-6525e41af793 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:00.215853 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabce90-e861-421d-b9d0-6525e41af793 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:00.216212 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabce90-e861-421d-b9d0-6525e41af793 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:00.219013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabce90-e861-421d-b9d0-6525e41af793 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:00.235630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 293/595] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:00.236705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabce90-e861-421d-b9d0-6525e41af793 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:00.257669 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654fc6c-0b08-4dea-b646-ac0d35e802b0 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:00.297866 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6ba4c-4be2-4a2c-b877-69146050c0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:00.298684 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6ba4c-4be2-4a2c-b877-69146050c0fa None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:00.299079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6ba4c-4be2-4a2c-b877-69146050c0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:00.299474 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6ba4c-4be2-4a2c-b877-69146050c0fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:00.302951 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:00.310063 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6ba4c-4be2-4a2c-b877-69146050c0fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:00.312090 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6ba4c-4be2-4a2c-b877-69146050c0fa None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:00.313340 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:00.330773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-bdd6ba4c-4be2-4a2c-b877-69146050c0fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:00.330773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:00.330773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:00.330773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:00.330773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:00.330773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:00.330773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:00.330773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:00.330773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:00.330773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:00.330773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:00.330773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:00.330773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:02:00.330773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:02:00.330773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:02:00.331833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:02:00.331833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:00.331833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:00.331833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:00.331833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:00.331833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:00.331833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:00.331833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:00.331833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:00.331833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:00.331833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:00.331833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:00.331833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:00.331833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:00.331833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:00.331833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:00.331833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:00.332720 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:02:00.332720 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:02:00.332720 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:02:00.332720 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:02:00.332720 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:02:00.332720 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:02:00.332720 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:00.332720 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:00.335976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 303/596] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:00.337143 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6ba4c-4be2-4a2c-b877-69146050c0fa None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:00.384040 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabce90-e861-421d-b9d0-6525e41af793 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:00.433352 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89883e3-3ef6-48c4-bcfa-4f7f3aa36526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:00.434615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89883e3-3ef6-48c4-bcfa-4f7f3aa36526 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:00.435295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89883e3-3ef6-48c4-bcfa-4f7f3aa36526 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:00.435748 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89883e3-3ef6-48c4-bcfa-4f7f3aa36526 None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:00.436879 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89883e3-3ef6-48c4-bcfa-4f7f3aa36526 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:00.437351 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89883e3-3ef6-48c4-bcfa-4f7f3aa36526 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:00.439738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89883e3-3ef6-48c4-bcfa-4f7f3aa36526 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:00.458129 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6ba4c-4be2-4a2c-b877-69146050c0fa None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:00.464831 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 294/597] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Sep 28 12:02:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:00.466416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89883e3-3ef6-48c4-bcfa-4f7f3aa36526 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:00.495029 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88e6bb-0869-4c39-9737-e2e7bf77053d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:00.495957 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88e6bb-0869-4c39-9737-e2e7bf77053d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:00.496334 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88e6bb-0869-4c39-9737-e2e7bf77053d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:00.496739 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88e6bb-0869-4c39-9737-e2e7bf77053d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:00.505488 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88e6bb-0869-4c39-9737-e2e7bf77053d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:00.507259 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88e6bb-0869-4c39-9737-e2e7bf77053d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:00.520312 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-6f88e6bb-0869-4c39-9737-e2e7bf77053d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:00.520312 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:00.520312 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:00.520312 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:00.520312 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:00.520312 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:00.520312 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:00.520312 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:00.520312 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:00.520312 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:00.520312 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:00.520312 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:00.520312 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:02:00.520312 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:02:00.520312 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:02:00.521516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:02:00.521516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:00.521516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:00.521516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:00.521516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:00.521516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:00.521516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:00.521516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:00.521516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:00.521516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:00.521516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:00.521516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:00.521516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:00.521516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:00.521516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:00.521516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:00.521516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:00.522638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:02:00.522638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:02:00.522638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:02:00.522638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:02:00.522638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:02:00.522638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:02:00.522638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:00.522638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:00.528853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 304/598] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:00.529944 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88e6bb-0869-4c39-9737-e2e7bf77053d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:00.588959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:00.604829 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89883e3-3ef6-48c4-bcfa-4f7f3aa36526 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:00.614840 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:00.646581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88e6bb-0869-4c39-9737-e2e7bf77053d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:00.657882 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d407b39-18d9-4f51-a9cd-e69d1d137681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:00.658990 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d407b39-18d9-4f51-a9cd-e69d1d137681 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:00.659453 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d407b39-18d9-4f51-a9cd-e69d1d137681 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:00.659735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d407b39-18d9-4f51-a9cd-e69d1d137681 None admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:00.661002 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d407b39-18d9-4f51-a9cd-e69d1d137681 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:00.661312 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d407b39-18d9-4f51-a9cd-e69d1d137681 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:00.663555 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d407b39-18d9-4f51-a9cd-e69d1d137681 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:00.681168 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 295/599] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:02:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:00.681893 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d407b39-18d9-4f51-a9cd-e69d1d137681 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:00.684922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a933581-ab67-4d2a-ad16-7e86cc5c94ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:00.685611 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a933581-ab67-4d2a-ad16-7e86cc5c94ca None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:00.685993 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a933581-ab67-4d2a-ad16-7e86cc5c94ca None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:00.686464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a933581-ab67-4d2a-ad16-7e86cc5c94ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:00.698497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a933581-ab67-4d2a-ad16-7e86cc5c94ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:00.700583 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a933581-ab67-4d2a-ad16-7e86cc5c94ca None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:00.720885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-2a933581-ab67-4d2a-ad16-7e86cc5c94ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:00.720885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:00.720885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:00.720885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:00.720885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:00.720885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:00.720885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:00.720885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:00.720885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:00.720885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:00.720885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:00.720885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:00.720885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:00.720885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:00.720885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:00.720885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:00.721918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:00.721918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:00.721918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:00.721918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:00.721918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:00.721918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:00.721918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:00.721918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:00.721918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:00.721918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:00.721918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:00.721918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:00.721918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:00.721918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:00.721918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:00.721918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:00.721918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:00.723392 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:00.723392 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:00.723392 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:00.725266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 305/600] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:00.726240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a933581-ab67-4d2a-ad16-7e86cc5c94ca None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:00.804701 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d407b39-18d9-4f51-a9cd-e69d1d137681 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:00.840555 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf9241-53e7-4744-ad51-efcdc53d4e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:00.841637 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf9241-53e7-4744-ad51-efcdc53d4e4b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:00.842123 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf9241-53e7-4744-ad51-efcdc53d4e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:00.842598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf9241-53e7-4744-ad51-efcdc53d4e4b None admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:00.843533 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf9241-53e7-4744-ad51-efcdc53d4e4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:00.844114 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf9241-53e7-4744-ad51-efcdc53d4e4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:00.845805 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf9241-53e7-4744-ad51-efcdc53d4e4b None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:00.858656 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a933581-ab67-4d2a-ad16-7e86cc5c94ca None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:00.866251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 296/601] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:02:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:00.867188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:00.868779 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf9241-53e7-4744-ad51-efcdc53d4e4b None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:00.905619 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9af47b-8744-4e8f-8b7e-393806f438d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:00.907279 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9af47b-8744-4e8f-8b7e-393806f438d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:00.907833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9af47b-8744-4e8f-8b7e-393806f438d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:00.908315 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:00.908822 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9af47b-8744-4e8f-8b7e-393806f438d0 None admin] PATH_INFO: `/v3/projects/c854d366f35145e8b2fadb9b014d0199/users/f09354b404d94e9db2e21292a61a06f2/roles/9b8671e5f63c4b08982273f189eab5ec` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:00.928157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9af47b-8744-4e8f-8b7e-393806f438d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c854d366f35145e8b2fadb9b014d0199, user_id=f09354b404d94e9db2e21292a61a06f2, role_id=9b8671e5f63c4b08982273f189eab5ec)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:00.930221 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9af47b-8744-4e8f-8b7e-393806f438d0 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:00.945886 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 306/602] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 28 12:02:00 2022] PUT /identity/v3/projects/c854d366f35145e8b2fadb9b014d0199/users/f09354b404d94e9db2e21292a61a06f2/roles/9b8671e5f63c4b08982273f189eab5ec => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:02:00.947150 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9af47b-8744-4e8f-8b7e-393806f438d0 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:00.993629 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf9241-53e7-4744-ad51-efcdc53d4e4b None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:01.030694 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11677f9a-cbeb-46b8-a545-ba67c349caa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:01.031300 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11677f9a-cbeb-46b8-a545-ba67c349caa0 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:01.031608 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11677f9a-cbeb-46b8-a545-ba67c349caa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:01.031878 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11677f9a-cbeb-46b8-a545-ba67c349caa0 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:01.032522 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11677f9a-cbeb-46b8-a545-ba67c349caa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:01.032934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11677f9a-cbeb-46b8-a545-ba67c349caa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:01.034257 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11677f9a-cbeb-46b8-a545-ba67c349caa0 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:01.046817 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 297/603] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:01.052439 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11677f9a-cbeb-46b8-a545-ba67c349caa0 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:01.072274 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9af47b-8744-4e8f-8b7e-393806f438d0 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:01.114361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34311612-8ccb-4eb4-a507-32d413bb60b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:01.115618 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34311612-8ccb-4eb4-a507-32d413bb60b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:01.116365 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34311612-8ccb-4eb4-a507-32d413bb60b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:01.116849 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34311612-8ccb-4eb4-a507-32d413bb60b9 None admin] PATH_INFO: `/v3/projects/c854d366f35145e8b2fadb9b014d0199/users/9180b1616c524905b86769a9eb8f7757/roles/9b8671e5f63c4b08982273f189eab5ec` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:01.134773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34311612-8ccb-4eb4-a507-32d413bb60b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=c854d366f35145e8b2fadb9b014d0199, user_id=9180b1616c524905b86769a9eb8f7757, role_id=9b8671e5f63c4b08982273f189eab5ec)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:01.142146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34311612-8ccb-4eb4-a507-32d413bb60b9 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:01.183549 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:01.189829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 307/604] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 28 12:02:00 2022] PUT /identity/v3/projects/c854d366f35145e8b2fadb9b014d0199/users/9180b1616c524905b86769a9eb8f7757/roles/9b8671e5f63c4b08982273f189eab5ec => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:02:01.204290 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11677f9a-cbeb-46b8-a545-ba67c349caa0 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:01.249170 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64b6d8-4c37-45f1-8dc6-02a2fdf005f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:01.250130 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64b6d8-4c37-45f1-8dc6-02a2fdf005f8 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:01.250577 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64b6d8-4c37-45f1-8dc6-02a2fdf005f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:01.251008 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64b6d8-4c37-45f1-8dc6-02a2fdf005f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:01.259771 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64b6d8-4c37-45f1-8dc6-02a2fdf005f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:01.261652 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64b6d8-4c37-45f1-8dc6-02a2fdf005f8 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:01.275198 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-8e64b6d8-4c37-45f1-8dc6-02a2fdf005f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:01.275198 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:01.275198 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:01.275198 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:01.275198 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:01.275198 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:01.275198 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:01.275198 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:01.275198 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:01.275198 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:01.275198 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:01.275198 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:01.275198 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:02:01.275198 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:02:01.275198 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:02:01.276449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:02:01.276449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:01.276449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:01.276449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:01.276449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:01.276449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:01.276449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:01.276449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:01.276449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:01.276449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:01.276449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:01.276449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:01.276449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:01.276449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:01.276449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:01.276449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:01.276449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:01.277621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:02:01.277621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:02:01.277621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:02:01.277621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:02:01.277621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:02:01.277621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:02:01.277621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:01.277621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:01.279880 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 298/605] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:01.285748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34311612-8ccb-4eb4-a507-32d413bb60b9 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:01.306492 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:01.374023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469313e7-eede-4189-9b45-b1e71c1d905d None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:01.374365 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469313e7-eede-4189-9b45-b1e71c1d905d None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:01.374578 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469313e7-eede-4189-9b45-b1e71c1d905d None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:01.375933 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 299/606] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:02:01.386291 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017edd10-3c2f-4ab7-8ed7-b42b21391ec6 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:01.386626 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017edd10-3c2f-4ab7-8ed7-b42b21391ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:01.386836 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017edd10-3c2f-4ab7-8ed7-b42b21391ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:01.423190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-017edd10-3c2f-4ab7-8ed7-b42b21391ec6 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:01.424442 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-017edd10-3c2f-4ab7-8ed7-b42b21391ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:01.468956 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34311612-8ccb-4eb4-a507-32d413bb60b9 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:01.512813 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcbae7-3d1d-4061-9058-eca23092521b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:01.513572 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcbae7-3d1d-4061-9058-eca23092521b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:01.513855 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcbae7-3d1d-4061-9058-eca23092521b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:01.514128 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcbae7-3d1d-4061-9058-eca23092521b None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:01.514835 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdcbae7-3d1d-4061-9058-eca23092521b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:01.515141 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdcbae7-3d1d-4061-9058-eca23092521b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:01.516833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdcbae7-3d1d-4061-9058-eca23092521b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:01.518687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 300/607] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:02:01.531564 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 308/608] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:02:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:01.537760 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017edd10-3c2f-4ab7-8ed7-b42b21391ec6 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:01.629358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:01.666288 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017edd10-3c2f-4ab7-8ed7-b42b21391ec6 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:01.721447 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4bc921-e6b8-48aa-ad63-c95623a941de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:01.722044 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bc921-e6b8-48aa-ad63-c95623a941de None admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:01.722347 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bc921-e6b8-48aa-ad63-c95623a941de None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:01.723163 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bc921-e6b8-48aa-ad63-c95623a941de None admin] PATH_INFO: `/v3/projects/c854d366f35145e8b2fadb9b014d0199/users/ca51ff621664452db7dd991714462e3b/roles/9b8671e5f63c4b08982273f189eab5ec` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:01.747479 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4bc921-e6b8-48aa-ad63-c95623a941de None admin] RBAC: Authorizing `identity:create_grant(project_id=c854d366f35145e8b2fadb9b014d0199, user_id=ca51ff621664452db7dd991714462e3b, role_id=9b8671e5f63c4b08982273f189eab5ec)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:01.749006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4bc921-e6b8-48aa-ad63-c95623a941de None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:01.768150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 301/609] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 28 12:02:01 2022] PUT /identity/v3/projects/c854d366f35145e8b2fadb9b014d0199/users/ca51ff621664452db7dd991714462e3b/roles/9b8671e5f63c4b08982273f189eab5ec => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:02:01.812096 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcbae7-3d1d-4061-9058-eca23092521b None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:01.914602 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:01.965940 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcbae7-3d1d-4061-9058-eca23092521b None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:02.004617 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342412e-debe-4f85-bdf9-8475c0a8b620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:02.005172 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342412e-debe-4f85-bdf9-8475c0a8b620 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:02.005451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342412e-debe-4f85-bdf9-8475c0a8b620 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:02.005721 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342412e-debe-4f85-bdf9-8475c0a8b620 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:02.017354 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342412e-debe-4f85-bdf9-8475c0a8b620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:02:02.023308 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-1342412e-debe-4f85-bdf9-8475c0a8b620 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:02:02.023308 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:02.023308 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:02.023308 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:02.023308 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:02.023308 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:02.023308 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:02.023308 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:02.023308 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:02.023308 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:02.023308 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:02.023308 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:02.023308 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:02:02.023308 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:02:02.023308 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:02:02.023308 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:02:02.024289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:02:02.024289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:02:02.024289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:02:02.024289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:02:02.024289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:02.024289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:02.024289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:02.024289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:02.024289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:02.024289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:02.024289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:02.024289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:02.024289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:02.024289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:02.024289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:02.024289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:02.025153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:02.025153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:02.025153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:02.025153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:02.025153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:02:02.025153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:02:02.025153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:02:02.025153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:02:02.025153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:02:02.025153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:02:02.025153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:02:02.025153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:02.025153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 309/610] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 28 12:02:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:02.030448 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4bc921-e6b8-48aa-ad63-c95623a941de None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:02.142689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4bc921-e6b8-48aa-ad63-c95623a941de None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:02.180155 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:02.193980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17aea5-ad4e-443c-b3c0-4f1cc24191ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:02.194646 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17aea5-ad4e-443c-b3c0-4f1cc24191ef None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:02.194928 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17aea5-ad4e-443c-b3c0-4f1cc24191ef None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:02.195206 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17aea5-ad4e-443c-b3c0-4f1cc24191ef None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:02.195960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17aea5-ad4e-443c-b3c0-4f1cc24191ef None admin] RBAC: Adding query filter params (name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:02.196332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17aea5-ad4e-443c-b3c0-4f1cc24191ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:02.197718 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17aea5-ad4e-443c-b3c0-4f1cc24191ef None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:02.211034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 302/611] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 28 12:02:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:02.216646 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342412e-debe-4f85-bdf9-8475c0a8b620 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:02.345531 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342412e-debe-4f85-bdf9-8475c0a8b620 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:02.381093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:02.391331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216498b5-78a6-46eb-97bc-072dda9f5076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:02.391985 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216498b5-78a6-46eb-97bc-072dda9f5076 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:02.392264 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216498b5-78a6-46eb-97bc-072dda9f5076 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:02.392534 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216498b5-78a6-46eb-97bc-072dda9f5076 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:02.412049 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216498b5-78a6-46eb-97bc-072dda9f5076 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:02.413547 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216498b5-78a6-46eb-97bc-072dda9f5076 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:02.434050 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-216498b5-78a6-46eb-97bc-072dda9f5076 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:02.434050 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:02.434050 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:02.434050 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:02.434050 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:02.434050 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:02.434050 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:02.434050 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:02.434050 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:02.434050 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:02.434050 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:02.434050 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:02.434050 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:02.434050 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:02.434050 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:02.434050 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:02.435080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:02.435080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:02.435080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:02.435080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:02.435080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:02.435080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:02.435080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:02.435080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:02.435080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:02.435080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:02.435080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:02.435080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:02.435080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:02.435080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:02.435080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:02.435080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:02.435080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:02.436027 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:02.436027 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:02.436027 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:02.436027 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 310/612] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:02.442496 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17aea5-ad4e-443c-b3c0-4f1cc24191ef None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:02.595188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17aea5-ad4e-443c-b3c0-4f1cc24191ef None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:02.645917 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2e604-5d42-438a-9f51-5663555ecf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:02.646449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2e604-5d42-438a-9f51-5663555ecf37 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:02.646729 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2e604-5d42-438a-9f51-5663555ecf37 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:02.647002 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2e604-5d42-438a-9f51-5663555ecf37 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:02.647676 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb2e604-5d42-438a-9f51-5663555ecf37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:02.647984 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb2e604-5d42-438a-9f51-5663555ecf37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:02.649349 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb2e604-5d42-438a-9f51-5663555ecf37 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:02.666536 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 303/613] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:02.672205 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216498b5-78a6-46eb-97bc-072dda9f5076 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:02.818252 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216498b5-78a6-46eb-97bc-072dda9f5076 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:02.869637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4065f-7e50-4af1-b7c4-77e0dbf8d19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:02.870279 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4065f-7e50-4af1-b7c4-77e0dbf8d19c None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:02.870556 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4065f-7e50-4af1-b7c4-77e0dbf8d19c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:02.870823 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4065f-7e50-4af1-b7c4-77e0dbf8d19c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:02.884906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4065f-7e50-4af1-b7c4-77e0dbf8d19c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:02.886408 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4065f-7e50-4af1-b7c4-77e0dbf8d19c None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:02.901163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-aac4065f-7e50-4af1-b7c4-77e0dbf8d19c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 28 12:02:02.901163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:02.901163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:02.901163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:02.901163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:02.901163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:02.901163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:02.901163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:02.901163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:02.901163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:02.901163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:02.901163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:02.901163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:02:02.901163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:02:02.901163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:02:02.901163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:02:02.902155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:02.902155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:02.902155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:02:02.902155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:02.902155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:02:02.902155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:02.902155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:02.902155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:02.902155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:02.902155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:02.902155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:02.902155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:02.902155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:02.902155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:02.902155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:02.902155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:02.902155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:02.902155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:02.903118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:02.903118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:02.903118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:02:02.903118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:02:02.903118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:02:02.903118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:02:02.903118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:02:02.903118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:02:02.903118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 28 12:02:02.903118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:02.903118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 311/614] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:02:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:02.908014 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2e604-5d42-438a-9f51-5663555ecf37 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:02.982973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:03.054183 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2e604-5d42-438a-9f51-5663555ecf37 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:03.099067 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e0906-d741-416d-af57-4ca7b387139b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:03.099710 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e0906-d741-416d-af57-4ca7b387139b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:03.099994 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e0906-d741-416d-af57-4ca7b387139b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:03.100267 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e0906-d741-416d-af57-4ca7b387139b None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:03.101012 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e0906-d741-416d-af57-4ca7b387139b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:03.101317 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e0906-d741-416d-af57-4ca7b387139b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:03.102741 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e0906-d741-416d-af57-4ca7b387139b None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:03.129963 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 304/615] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Sep 28 12:02:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:03.135686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e0906-d741-416d-af57-4ca7b387139b None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:03.136224 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3cd4f-6951-4d13-926d-20b36c1a300a None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:03.136690 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3cd4f-6951-4d13-926d-20b36c1a300a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:03.136784 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3cd4f-6951-4d13-926d-20b36c1a300a None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:03.139548 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 312/616] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:03.144465 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d0864-684d-4201-bdd0-2f2a565a855a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:03.144999 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d0864-684d-4201-bdd0-2f2a565a855a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:03.145486 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d0864-684d-4201-bdd0-2f2a565a855a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:03.184519 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-e39d0864-684d-4201-bdd0-2f2a565a855a None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:03.185737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e39d0864-684d-4201-bdd0-2f2a565a855a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:03.250563 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:03.254340 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e0906-d741-416d-af57-4ca7b387139b None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:03.264056 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:03.305013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e58af9-105a-4ee5-a2c6-b9c8e0729862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:03.305654 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e58af9-105a-4ee5-a2c6-b9c8e0729862 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:03.305934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e58af9-105a-4ee5-a2c6-b9c8e0729862 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:03.306206 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e58af9-105a-4ee5-a2c6-b9c8e0729862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:03.332265 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 313/617] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:02:03.333258 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e58af9-105a-4ee5-a2c6-b9c8e0729862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:03.334773 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e58af9-105a-4ee5-a2c6-b9c8e0729862 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:03.358858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-00e58af9-105a-4ee5-a2c6-b9c8e0729862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:03.358858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:03.358858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:03.358858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:03.358858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:03.358858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:03.358858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:03.358858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:03.358858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:03.358858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:03.358858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:03.358858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:03.358858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:03.358858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:03.358858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:03.358858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:03.359923 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:03.359923 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:03.359923 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:03.359923 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:03.359923 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:03.359923 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:03.359923 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:03.359923 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:03.359923 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:03.359923 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:03.359923 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:03.359923 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:03.359923 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:03.359923 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:03.359923 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:03.359923 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:03.359923 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:03.360837 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:03.360837 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:03.360837 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:03.360837 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 305/618] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:03.366218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d0864-684d-4201-bdd0-2f2a565a855a None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:03.489432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d0864-684d-4201-bdd0-2f2a565a855a None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:03.534354 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975e18c-215f-4321-af29-667e6494169f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:03.535536 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975e18c-215f-4321-af29-667e6494169f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:03.535816 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975e18c-215f-4321-af29-667e6494169f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:03.536079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975e18c-215f-4321-af29-667e6494169f None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:03.536719 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975e18c-215f-4321-af29-667e6494169f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:03.537018 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975e18c-215f-4321-af29-667e6494169f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:03.538380 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975e18c-215f-4321-af29-667e6494169f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:03.554739 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 314/619] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:03.556433 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e58af9-105a-4ee5-a2c6-b9c8e0729862 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:03.666433 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975e18c-215f-4321-af29-667e6494169f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:03.680063 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e58af9-105a-4ee5-a2c6-b9c8e0729862 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:03.722623 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:03.739539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed224620-9143-473d-8eec-ead08f29ccd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:03.741109 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed224620-9143-473d-8eec-ead08f29ccd2 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:03.741415 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed224620-9143-473d-8eec-ead08f29ccd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:03.741692 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed224620-9143-473d-8eec-ead08f29ccd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:03.752516 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed224620-9143-473d-8eec-ead08f29ccd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:03.754540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed224620-9143-473d-8eec-ead08f29ccd2 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:03.777419 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-ed224620-9143-473d-8eec-ead08f29ccd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:03.777419 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:03.777419 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:03.777419 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:03.777419 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:03.777419 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:03.777419 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:03.777419 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:03.777419 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:03.777419 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:03.777419 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:03.777419 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:03.777419 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:02:03.777419 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:02:03.777419 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:02:03.778401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:02:03.778401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:03.778401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:03.778401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:03.778401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:03.778401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:03.778401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:03.778401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:03.778401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:03.778401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:03.778401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:03.778401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:03.778401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:03.778401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:03.778401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:03.778401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:03.778401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:03.779312 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:02:03.779312 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:02:03.779312 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:02:03.779312 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:02:03.779312 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:02:03.779312 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:02:03.779312 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:03.779312 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:03.783598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 306/620] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:03.786619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed224620-9143-473d-8eec-ead08f29ccd2 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:03.807293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:03.840507 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975e18c-215f-4321-af29-667e6494169f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:03.881800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e2c1f-df93-451d-9955-dcd7fe2b1022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:03.882438 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e2c1f-df93-451d-9955-dcd7fe2b1022 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:03.882714 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e2c1f-df93-451d-9955-dcd7fe2b1022 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:03.882984 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e2c1f-df93-451d-9955-dcd7fe2b1022 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:03.896610 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e2c1f-df93-451d-9955-dcd7fe2b1022 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:02:03.903947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-986e2c1f-df93-451d-9955-dcd7fe2b1022 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:02:03.903947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:03.903947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:03.903947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:03.903947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:03.903947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:03.903947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:03.903947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:03.903947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:03.903947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:03.903947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:03.903947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:03.903947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:02:03.903947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:02:03.903947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:02:03.903947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:02:03.904928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:02:03.904928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:02:03.904928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:02:03.904928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:02:03.904928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:03.904928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:03.904928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:03.904928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:03.904928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:03.904928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:03.904928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:03.904928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:03.904928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:03.904928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:03.904928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:03.904928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:03.906234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:03.906234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:03.906234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:03.906234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:03.906234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:02:03.906234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:02:03.906234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:02:03.906234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:02:03.906234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:02:03.906234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:02:03.906234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:02:03.906234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:03.906234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 315/621] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 28 12:02:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:03.907163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef20c0-323d-4e4d-86e6-f547e7d631a9 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:03.907163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef20c0-323d-4e4d-86e6-f547e7d631a9 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:03.907163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef20c0-323d-4e4d-86e6-f547e7d631a9 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:03.908415 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 316/622] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:03.913305 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef20c0-323d-4e4d-86e6-f547e7d631a9 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:03.916232 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed224620-9143-473d-8eec-ead08f29ccd2 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:03.955645 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e95504-d9d7-4aea-95e8-cb72375fcbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:03.956597 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e95504-d9d7-4aea-95e8-cb72375fcbfc None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:03.957104 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e95504-d9d7-4aea-95e8-cb72375fcbfc None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:03.957552 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e95504-d9d7-4aea-95e8-cb72375fcbfc None admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:03.958440 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e95504-d9d7-4aea-95e8-cb72375fcbfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:03.958935 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e95504-d9d7-4aea-95e8-cb72375fcbfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:03.960712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e95504-d9d7-4aea-95e8-cb72375fcbfc None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:03.973781 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 307/623] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:02:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:03.975045 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb08ac-34d0-4706-a8db-2f21884171b2 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:03.975332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb08ac-34d0-4706-a8db-2f21884171b2 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:03.975640 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb08ac-34d0-4706-a8db-2f21884171b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:03.994018 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-5abb08ac-34d0-4706-a8db-2f21884171b2 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:03.995124 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-5abb08ac-34d0-4706-a8db-2f21884171b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:04.016066 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:04.031426 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef20c0-323d-4e4d-86e6-f547e7d631a9 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:04.061883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 308/624] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:02:04.063184 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c6e13-dbe0-4d04-996d-d9cdac209880 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:04.063495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c6e13-dbe0-4d04-996d-d9cdac209880 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:04.063772 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c6e13-dbe0-4d04-996d-d9cdac209880 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:04.067541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 309/625] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:04.067541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c6e13-dbe0-4d04-996d-d9cdac209880 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:04.078896 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668959af-4642-4219-aa29-1ea53b9e8e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:04.079634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668959af-4642-4219-aa29-1ea53b9e8e5b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:04.079990 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668959af-4642-4219-aa29-1ea53b9e8e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:04.080475 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:04.081413 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668959af-4642-4219-aa29-1ea53b9e8e5b None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:04.082300 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668959af-4642-4219-aa29-1ea53b9e8e5b None admin] RBAC: Adding query filter params (name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:04.082612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668959af-4642-4219-aa29-1ea53b9e8e5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:04.084024 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668959af-4642-4219-aa29-1ea53b9e8e5b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:04.099819 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 317/626] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 28 12:02:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:04.101581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7dc80-595a-42d2-85e9-952d3e5b6ebc None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:04.101868 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7dc80-595a-42d2-85e9-952d3e5b6ebc None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:04.102410 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7dc80-595a-42d2-85e9-952d3e5b6ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:04.123834 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-80f7dc80-595a-42d2-85e9-952d3e5b6ebc None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:04.125081 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-80f7dc80-595a-42d2-85e9-952d3e5b6ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:04.198792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c6e13-dbe0-4d04-996d-d9cdac209880 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:04.215565 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 318/627] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:02:04.217069 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7dc80-595a-42d2-85e9-952d3e5b6ebc None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:04.258851 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea544e7e-42ea-4d74-9b18-5c67ad83a3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:04.260189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea544e7e-42ea-4d74-9b18-5c67ad83a3f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:04.260653 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea544e7e-42ea-4d74-9b18-5c67ad83a3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:04.261108 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea544e7e-42ea-4d74-9b18-5c67ad83a3f5 None admin] PATH_INFO: `/v3/projects/c854d366f35145e8b2fadb9b014d0199/users/822e394e80fd41adb54d330adaf65a68/roles/9b8671e5f63c4b08982273f189eab5ec` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:04.290434 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea544e7e-42ea-4d74-9b18-5c67ad83a3f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c854d366f35145e8b2fadb9b014d0199, user_id=822e394e80fd41adb54d330adaf65a68, role_id=9b8671e5f63c4b08982273f189eab5ec)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:04.292304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea544e7e-42ea-4d74-9b18-5c67ad83a3f5 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:04.312267 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 310/628] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 28 12:02:04 2022] PUT /identity/v3/projects/c854d366f35145e8b2fadb9b014d0199/users/822e394e80fd41adb54d330adaf65a68/roles/9b8671e5f63c4b08982273f189eab5ec => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:02:04.344900 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:04.367234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7dc80-595a-42d2-85e9-952d3e5b6ebc None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:04.376983 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea544e7e-42ea-4d74-9b18-5c67ad83a3f5 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:04.410764 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5735e78-2ffc-4e3f-aaa2-06a5aeb4f9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:04.411826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5735e78-2ffc-4e3f-aaa2-06a5aeb4f9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:04.412338 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5735e78-2ffc-4e3f-aaa2-06a5aeb4f9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:04.412886 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5735e78-2ffc-4e3f-aaa2-06a5aeb4f9a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:04.425560 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5735e78-2ffc-4e3f-aaa2-06a5aeb4f9a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:04.427425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5735e78-2ffc-4e3f-aaa2-06a5aeb4f9a5 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:04.445761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-e5735e78-2ffc-4e3f-aaa2-06a5aeb4f9a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:04.445761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:04.445761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:04.445761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:04.445761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:04.445761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:04.445761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:04.445761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:04.445761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:04.445761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:04.445761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:04.445761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:04.445761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:04.445761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:04.445761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:04.445761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:04.446800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:04.446800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:04.446800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:04.446800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:04.446800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:04.446800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:04.446800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:04.446800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:04.446800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:04.446800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:04.446800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:04.446800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:04.446800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:04.446800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:04.446800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:04.446800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:04.446800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:04.447743 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:04.447743 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:04.447743 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:04.450086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 319/629] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:04.455262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5735e78-2ffc-4e3f-aaa2-06a5aeb4f9a5 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:04.494097 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:04.565823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea544e7e-42ea-4d74-9b18-5c67ad83a3f5 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:04.606976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06b0ec-edd5-4ccc-bb98-7fd76f32c11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:04.607650 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5735e78-2ffc-4e3f-aaa2-06a5aeb4f9a5 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:04.607784 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06b0ec-edd5-4ccc-bb98-7fd76f32c11c None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:04.607974 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06b0ec-edd5-4ccc-bb98-7fd76f32c11c None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:04.608196 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06b0ec-edd5-4ccc-bb98-7fd76f32c11c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:04.621173 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06b0ec-edd5-4ccc-bb98-7fd76f32c11c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:02:04.626019 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-dd06b0ec-edd5-4ccc-bb98-7fd76f32c11c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:02:04.626019 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:04.626019 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:04.626019 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:04.626019 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:04.626019 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:04.626019 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:04.626019 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:04.626019 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:04.626019 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:04.626019 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:04.626019 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:04.626019 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:02:04.626019 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:02:04.626019 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:02:04.626019 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:02:04.627052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:02:04.627052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:02:04.627052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:02:04.627052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:02:04.627052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:04.627052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:04.627052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:04.627052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:04.627052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:04.627052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:04.627052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:04.627052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:04.627052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:04.627052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:04.627052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:04.627052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:04.628476 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:04.628476 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:04.628476 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:04.628476 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:04.628476 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:02:04.628476 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:02:04.628476 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:02:04.628476 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:02:04.628476 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:02:04.628476 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:02:04.628476 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:02:04.628476 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:04.628476 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 311/630] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 28 12:02:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:04.629269 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1097589-37c0-4e31-83bb-905262858365 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:04.629269 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1097589-37c0-4e31-83bb-905262858365 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:04.629269 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1097589-37c0-4e31-83bb-905262858365 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:04.630724 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 312/631] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:04.631259 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1097589-37c0-4e31-83bb-905262858365 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:04.642102 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:04.648034 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8b4a6-efea-43b5-9f32-3f554e0b55de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:04.648866 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8b4a6-efea-43b5-9f32-3f554e0b55de None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:04.649332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8b4a6-efea-43b5-9f32-3f554e0b55de None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:04.649831 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8b4a6-efea-43b5-9f32-3f554e0b55de None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:04.650570 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8b4a6-efea-43b5-9f32-3f554e0b55de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:04.651121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8b4a6-efea-43b5-9f32-3f554e0b55de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:04.653034 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8b4a6-efea-43b5-9f32-3f554e0b55de None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:04.671896 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 320/632] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:04.671896 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8b4a6-efea-43b5-9f32-3f554e0b55de None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:04.759929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1097589-37c0-4e31-83bb-905262858365 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:04.779061 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8b4a6-efea-43b5-9f32-3f554e0b55de None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:04.779245 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:04.798054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dac7d9-1fea-4ca8-aab3-409a3b04d48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:04.798723 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dac7d9-1fea-4ca8-aab3-409a3b04d48d None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:04.798954 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dac7d9-1fea-4ca8-aab3-409a3b04d48d None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:04.799216 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dac7d9-1fea-4ca8-aab3-409a3b04d48d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:04.810197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dac7d9-1fea-4ca8-aab3-409a3b04d48d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:02:04.814967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-58dac7d9-1fea-4ca8-aab3-409a3b04d48d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:02:04.814967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:04.814967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:04.814967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:04.814967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:04.814967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:04.814967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:04.814967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:04.814967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:04.814967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:04.814967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:04.814967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:04.814967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:02:04.814967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:02:04.814967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:02:04.814967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:02:04.816053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:02:04.816053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:02:04.816053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:02:04.816053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:02:04.816053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:04.816053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:04.816053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:04.816053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:04.816053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:04.816053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:04.816053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:04.816053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:04.816053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:04.816053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:04.816053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:04.816053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:04.816980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:04.816980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:04.816980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:04.816980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:04.816980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:02:04.816980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:02:04.816980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:02:04.816980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:02:04.816980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:02:04.816980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:02:04.816980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:02:04.816980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:04.816980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 313/633] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 28 12:02:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:04.817722 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b0ceb-4d22-4ca4-82e8-6c088f9027a2 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:04.817722 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b0ceb-4d22-4ca4-82e8-6c088f9027a2 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:04.817722 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b0ceb-4d22-4ca4-82e8-6c088f9027a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:04.822681 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58fc31-338c-41db-ad0f-87eb20ac0c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:04.823298 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58fc31-338c-41db-ad0f-87eb20ac0c29 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:04.823625 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58fc31-338c-41db-ad0f-87eb20ac0c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:04.824091 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58fc31-338c-41db-ad0f-87eb20ac0c29 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:04.824758 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58fc31-338c-41db-ad0f-87eb20ac0c29 None admin] RBAC: Adding query filter params (name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:04.825064 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58fc31-338c-41db-ad0f-87eb20ac0c29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:04.826443 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58fc31-338c-41db-ad0f-87eb20ac0c29 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:04.840300 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 321/634] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 28 12:02:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:04.840502 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-628b0ceb-4d22-4ca4-82e8-6c088f9027a2 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:04.840591 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58fc31-338c-41db-ad0f-87eb20ac0c29 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:04.840680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-628b0ceb-4d22-4ca4-82e8-6c088f9027a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:04.902528 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:04.915221 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 314/635] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:02:04.925014 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b0ceb-4d22-4ca4-82e8-6c088f9027a2 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:04.958039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58fc31-338c-41db-ad0f-87eb20ac0c29 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:04.996680 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47baf53-2bb2-4fb4-ab80-cbea31e86eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:04.997379 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47baf53-2bb2-4fb4-ab80-cbea31e86eca None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:04.997619 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47baf53-2bb2-4fb4-ab80-cbea31e86eca None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:04.997889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47baf53-2bb2-4fb4-ab80-cbea31e86eca None admin] PATH_INFO: `/v3/users/nova` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:05.007192 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47baf53-2bb2-4fb4-ab80-cbea31e86eca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:05.008743 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47baf53-2bb2-4fb4-ab80-cbea31e86eca None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:05.021138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-b47baf53-2bb2-4fb4-ab80-cbea31e86eca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:02:05.021138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:05.021138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:05.021138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:05.021138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:05.021138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:05.021138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:05.021138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:05.021138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:05.021138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:05.021138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:05.021138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:05.021138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:02:05.021138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:02:05.021138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:02:05.021138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:02:05.022121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:05.022121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:05.022121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:02:05.022121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:05.022121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:02:05.022121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:05.022121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:05.022121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:05.022121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:05.022121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:05.022121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:05.022121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:05.022121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:05.022121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:05.022121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:05.022121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:05.022121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:05.022121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:05.023098 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:05.023098 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:05.023098 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:02:05.023098 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:02:05.023098 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:02:05.023098 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:02:05.023098 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:02:05.023098 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:02:05.023098 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:02:05.023098 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:05.031611 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 322/636] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Sep 28 12:02:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:05.031611 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47baf53-2bb2-4fb4-ab80-cbea31e86eca None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:05.049141 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b0ceb-4d22-4ca4-82e8-6c088f9027a2 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:05.059216 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:05.088631 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f779e09-d756-48db-9c64-a1cf56715584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:05.089567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f779e09-d756-48db-9c64-a1cf56715584 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:05.090094 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f779e09-d756-48db-9c64-a1cf56715584 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:05.090551 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f779e09-d756-48db-9c64-a1cf56715584 None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:05.091414 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f779e09-d756-48db-9c64-a1cf56715584 None admin] RBAC: Adding query filter params (name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:05.091922 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f779e09-d756-48db-9c64-a1cf56715584 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:05.093694 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f779e09-d756-48db-9c64-a1cf56715584 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:05.104199 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 315/637] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 28 12:02:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:05.105264 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f779e09-d756-48db-9c64-a1cf56715584 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:05.145666 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47baf53-2bb2-4fb4-ab80-cbea31e86eca None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:05.175052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:05.201807 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d4a51-0884-4abe-8db3-2ac420a04fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:05.202445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d4a51-0884-4abe-8db3-2ac420a04fce None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:05.202724 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d4a51-0884-4abe-8db3-2ac420a04fce None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:05.202995 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d4a51-0884-4abe-8db3-2ac420a04fce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:05.214654 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d4a51-0884-4abe-8db3-2ac420a04fce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:05.216147 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d4a51-0884-4abe-8db3-2ac420a04fce None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:05.233975 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-b16d4a51-0884-4abe-8db3-2ac420a04fce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:05.233975 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:05.233975 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:05.233975 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:05.233975 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:05.233975 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:05.233975 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:05.233975 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:05.233975 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:05.233975 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:05.233975 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:05.233975 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:05.233975 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:05.233975 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:05.233975 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:05.233975 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:05.235012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:05.235012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:05.235012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:05.235012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:05.235012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:05.235012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:05.235012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:05.235012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:05.235012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:05.235012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:05.235012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:05.235012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:05.235012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:05.235012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:05.235012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:05.235012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:05.235012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:05.241881 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:05.241881 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:05.241881 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:05.242185 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f779e09-d756-48db-9c64-a1cf56715584 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:05.242274 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 323/638] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:05.242274 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d4a51-0884-4abe-8db3-2ac420a04fce None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:05.281850 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769ddba-0883-483e-9848-bf56bb0c931b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:05.282620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769ddba-0883-483e-9848-bf56bb0c931b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:05.282904 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769ddba-0883-483e-9848-bf56bb0c931b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:05.283563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769ddba-0883-483e-9848-bf56bb0c931b None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:05.284608 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769ddba-0883-483e-9848-bf56bb0c931b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:05.285490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769ddba-0883-483e-9848-bf56bb0c931b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:05.287373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769ddba-0883-483e-9848-bf56bb0c931b None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:05.311758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 316/639] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Sep 28 12:02:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:05.313152 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769ddba-0883-483e-9848-bf56bb0c931b None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:05.342728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:05.344945 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d4a51-0884-4abe-8db3-2ac420a04fce None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:05.382976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc9ef4-8ccb-41cb-984a-88a30f3db085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:05.383627 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc9ef4-8ccb-41cb-984a-88a30f3db085 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:05.384179 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc9ef4-8ccb-41cb-984a-88a30f3db085 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:05.384179 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc9ef4-8ccb-41cb-984a-88a30f3db085 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:05.395090 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc9ef4-8ccb-41cb-984a-88a30f3db085 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:05.396546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc9ef4-8ccb-41cb-984a-88a30f3db085 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:05.410766 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-c6dc9ef4-8ccb-41cb-984a-88a30f3db085 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:05.410766 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:05.410766 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:05.410766 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:05.410766 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:05.410766 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:05.410766 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:05.410766 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:05.410766 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:05.410766 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:05.410766 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:05.410766 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:05.410766 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:05.410766 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:05.410766 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:05.410766 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:05.411947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:05.411947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:05.411947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:05.411947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:05.411947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:05.411947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:05.411947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:05.411947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:05.411947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:05.411947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:05.411947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:05.411947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:05.411947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:05.411947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:05.411947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:05.411947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:05.411947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:05.413240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:05.413240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:05.413240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:05.413240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 324/640] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:05.417024 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc9ef4-8ccb-41cb-984a-88a30f3db085 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:05.420455 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769ddba-0883-483e-9848-bf56bb0c931b None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:05.437214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:05.456856 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef480f16-0c8d-41ea-a8b3-14dfb73dd67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:05.457621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef480f16-0c8d-41ea-a8b3-14dfb73dd67c None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:05.458000 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef480f16-0c8d-41ea-a8b3-14dfb73dd67c None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:05.458399 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef480f16-0c8d-41ea-a8b3-14dfb73dd67c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:05.469184 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef480f16-0c8d-41ea-a8b3-14dfb73dd67c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:02:05.474027 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-ef480f16-0c8d-41ea-a8b3-14dfb73dd67c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:02:05.474027 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:05.474027 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:05.474027 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:05.474027 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:05.474027 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:05.474027 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:05.474027 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:05.474027 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:05.474027 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:05.474027 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:05.474027 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:05.474027 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:02:05.474027 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:02:05.474027 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:02:05.474027 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:02:05.475049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:02:05.475049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:02:05.475049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:02:05.475049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:02:05.475049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:05.475049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:05.475049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:05.475049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:05.475049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:05.475049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:05.475049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:05.475049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:05.475049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:05.475049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:05.475049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:05.475049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:05.475955 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:05.475955 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:05.475955 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:05.475955 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:05.475955 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:02:05.475955 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:02:05.475955 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:02:05.475955 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:02:05.475955 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:02:05.475955 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:02:05.475955 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:02:05.475955 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:05.475955 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 317/641] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 28 12:02:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:05.475955 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef480f16-0c8d-41ea-a8b3-14dfb73dd67c None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:05.530980 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc9ef4-8ccb-41cb-984a-88a30f3db085 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:05.565157 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:05.569631 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8327c-20c5-4936-8787-83170a04fc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:05.570247 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8327c-20c5-4936-8787-83170a04fc5a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:05.570506 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8327c-20c5-4936-8787-83170a04fc5a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:05.570777 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8327c-20c5-4936-8787-83170a04fc5a None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:05.571405 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8327c-20c5-4936-8787-83170a04fc5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:05.571740 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8327c-20c5-4936-8787-83170a04fc5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:05.573090 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8327c-20c5-4936-8787-83170a04fc5a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:05.580754 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef480f16-0c8d-41ea-a8b3-14dfb73dd67c None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:05.588112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 325/642] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:05.589341 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8327c-20c5-4936-8787-83170a04fc5a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:05.626662 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ef575-1eca-45c8-9c96-cf2f1304e868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:05.627767 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ef575-1eca-45c8-9c96-cf2f1304e868 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:05.629050 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ef575-1eca-45c8-9c96-cf2f1304e868 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:05.629525 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ef575-1eca-45c8-9c96-cf2f1304e868 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:05.676432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:05.704707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8327c-20c5-4936-8787-83170a04fc5a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:05.705506 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ef575-1eca-45c8-9c96-cf2f1304e868 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:05.707963 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ef575-1eca-45c8-9c96-cf2f1304e868 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:05.745625 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98d931-e97f-49b8-947b-37051acc3742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:05.746234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98d931-e97f-49b8-947b-37051acc3742 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:05.746514 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98d931-e97f-49b8-947b-37051acc3742 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:05.746784 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98d931-e97f-49b8-947b-37051acc3742 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:05.747421 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98d931-e97f-49b8-947b-37051acc3742 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:05.747747 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98d931-e97f-49b8-947b-37051acc3742 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:05.749100 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98d931-e97f-49b8-947b-37051acc3742 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:05.765590 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 326/643] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:05.765590 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98d931-e97f-49b8-947b-37051acc3742 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:05.811147 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:05.825990 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 318/644] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:02:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:02:05.825990 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ef575-1eca-45c8-9c96-cf2f1304e868 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:05.872909 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98d931-e97f-49b8-947b-37051acc3742 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:05.909329 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e44c09-0f0c-4d07-a1c4-cb3e06e8d85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:05.909904 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e44c09-0f0c-4d07-a1c4-cb3e06e8d85c None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:05.910179 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e44c09-0f0c-4d07-a1c4-cb3e06e8d85c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:05.910446 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e44c09-0f0c-4d07-a1c4-cb3e06e8d85c None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:05.911115 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e44c09-0f0c-4d07-a1c4-cb3e06e8d85c None admin] RBAC: Adding query filter params (name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:05.911416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e44c09-0f0c-4d07-a1c4-cb3e06e8d85c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:05.912787 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e44c09-0f0c-4d07-a1c4-cb3e06e8d85c None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:05.917703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:05.927002 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 327/645] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 28 12:02:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:05.928043 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e44c09-0f0c-4d07-a1c4-cb3e06e8d85c None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:05.937737 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ef575-1eca-45c8-9c96-cf2f1304e868 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:05.973063 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a380def-38b4-4b3d-984e-ebbc7588235c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:05.973691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a380def-38b4-4b3d-984e-ebbc7588235c None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:05.973973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a380def-38b4-4b3d-984e-ebbc7588235c None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:05.974242 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a380def-38b4-4b3d-984e-ebbc7588235c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:05.981220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a380def-38b4-4b3d-984e-ebbc7588235c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:05.982658 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a380def-38b4-4b3d-984e-ebbc7588235c None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:05.995532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-2a380def-38b4-4b3d-984e-ebbc7588235c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 28 12:02:05.995532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:05.995532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:05.995532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:05.995532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:05.995532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:05.995532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:05.995532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:05.995532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:05.995532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:05.995532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:05.995532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:05.995532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:02:05.995532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:02:05.995532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:02:05.995532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:02:05.996687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:05.996687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:05.996687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:02:05.996687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:05.996687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:02:05.996687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:05.996687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:05.996687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:05.996687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:05.996687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:05.996687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:05.996687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:05.996687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:05.996687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:05.996687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:05.996687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:05.996687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:05.996687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:05.997796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:05.997796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:05.997796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:02:05.997796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:02:05.997796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:02:05.997796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:02:05.997796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:02:05.997796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:02:05.997796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 28 12:02:05.997796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:05.997796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 319/646] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:02:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:05.997796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a380def-38b4-4b3d-984e-ebbc7588235c None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:06.042261 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e44c09-0f0c-4d07-a1c4-cb3e06e8d85c None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:06.048117 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:06.080362 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072a9f6-e007-4d71-bdcf-354cb512e8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:06.081254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072a9f6-e007-4d71-bdcf-354cb512e8a9 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:06.082248 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072a9f6-e007-4d71-bdcf-354cb512e8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:06.082519 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072a9f6-e007-4d71-bdcf-354cb512e8a9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:06.089761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072a9f6-e007-4d71-bdcf-354cb512e8a9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:06.091181 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072a9f6-e007-4d71-bdcf-354cb512e8a9 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:06.099948 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a380def-38b4-4b3d-984e-ebbc7588235c None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:06.102789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-a072a9f6-e007-4d71-bdcf-354cb512e8a9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 28 12:02:06.102789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:06.102789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:06.102789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:06.102789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:06.102789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:06.102789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:06.102789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:06.102789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:06.102789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:06.102789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:06.102789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:06.102789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:02:06.102789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:02:06.102789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:02:06.102789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:02:06.103778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:06.103778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:06.103778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:02:06.103778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:06.103778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:02:06.103778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:06.103778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:06.103778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:06.103778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:06.103778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:06.103778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:06.103778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:06.103778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:06.103778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:06.103778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:06.103778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:06.103778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:06.103778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:06.104718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:06.104718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:06.104718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:02:06.104718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:02:06.104718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:02:06.104718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:02:06.104718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:02:06.104718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:02:06.104718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 28 12:02:06.104718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:06.104718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 328/647] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:02:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:06.105352 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072a9f6-e007-4d71-bdcf-354cb512e8a9 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:06.141742 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b36d74-8292-4626-b73a-0e4cefd73dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:06.142371 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b36d74-8292-4626-b73a-0e4cefd73dda None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:06.142652 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b36d74-8292-4626-b73a-0e4cefd73dda None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:06.142927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b36d74-8292-4626-b73a-0e4cefd73dda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:06.154191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b36d74-8292-4626-b73a-0e4cefd73dda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:06.155665 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b36d74-8292-4626-b73a-0e4cefd73dda None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:06.169789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:06.170450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-61b36d74-8292-4626-b73a-0e4cefd73dda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:06.170450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:06.170450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:06.170450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:06.170450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:06.170450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:06.170450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:06.170450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:06.170450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:06.170450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:06.170450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:06.170450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:06.170450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:06.170450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:06.170450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:06.170450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:06.171541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:06.171541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:06.171541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:06.171541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:06.171541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:06.171541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:06.171541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:06.171541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:06.171541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:06.171541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:06.171541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:06.171541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:06.171541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:06.171541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:06.171541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:06.171541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:06.171541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:06.172785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:06.172785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:06.172785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:06.173581 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 320/648] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:06.174335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b36d74-8292-4626-b73a-0e4cefd73dda None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:06.219952 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072a9f6-e007-4d71-bdcf-354cb512e8a9 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:06.256335 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74719d11-e7f6-4042-a9d7-93cf7c87494a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:06.256967 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74719d11-e7f6-4042-a9d7-93cf7c87494a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:06.257248 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74719d11-e7f6-4042-a9d7-93cf7c87494a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:06.257522 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74719d11-e7f6-4042-a9d7-93cf7c87494a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:06.268752 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74719d11-e7f6-4042-a9d7-93cf7c87494a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:06.270715 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74719d11-e7f6-4042-a9d7-93cf7c87494a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:06.280735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:06.284270 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b36d74-8292-4626-b73a-0e4cefd73dda None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:06.285735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-74719d11-e7f6-4042-a9d7-93cf7c87494a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:06.285735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:06.285735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:06.285735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:06.285735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:06.285735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:06.285735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:06.285735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:06.285735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:06.285735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:06.285735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:06.285735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:06.285735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:06.285735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:06.285735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:06.285735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:06.286876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:06.286876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:06.286876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:06.286876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:06.286876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:06.286876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:06.286876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:06.286876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:06.286876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:06.286876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:06.286876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:06.286876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:06.286876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:06.286876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:06.286876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:06.286876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:06.286876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:06.287807 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:06.287807 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:06.287807 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:06.287807 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 329/649] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:06.288153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74719d11-e7f6-4042-a9d7-93cf7c87494a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:06.327468 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f64e7-5925-4dfa-b9f5-6910f7ba2801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:06.328236 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f64e7-5925-4dfa-b9f5-6910f7ba2801 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:06.328737 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f64e7-5925-4dfa-b9f5-6910f7ba2801 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:06.328980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f64e7-5925-4dfa-b9f5-6910f7ba2801 None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:06.330219 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f64e7-5925-4dfa-b9f5-6910f7ba2801 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:06.330665 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f64e7-5925-4dfa-b9f5-6910f7ba2801 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:06.333197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f64e7-5925-4dfa-b9f5-6910f7ba2801 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:06.352327 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 321/650] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Sep 28 12:02:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:06.357433 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f64e7-5925-4dfa-b9f5-6910f7ba2801 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:06.398525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74719d11-e7f6-4042-a9d7-93cf7c87494a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:06.411785 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:06.436276 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8dc828-4460-411a-9bec-a29dbf40030a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:06.436799 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dc828-4460-411a-9bec-a29dbf40030a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:06.437076 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dc828-4460-411a-9bec-a29dbf40030a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:06.437349 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dc828-4460-411a-9bec-a29dbf40030a None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:06.438083 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8dc828-4460-411a-9bec-a29dbf40030a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:06.438387 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8dc828-4460-411a-9bec-a29dbf40030a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:06.439856 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8dc828-4460-411a-9bec-a29dbf40030a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:06.462903 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 330/651] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Sep 28 12:02:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:06.462903 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8dc828-4460-411a-9bec-a29dbf40030a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:06.463192 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f64e7-5925-4dfa-b9f5-6910f7ba2801 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:06.497435 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1688a0-87d2-4374-ad37-412da74f073c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:06.498254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1688a0-87d2-4374-ad37-412da74f073c None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:06.498627 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1688a0-87d2-4374-ad37-412da74f073c None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:06.499004 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1688a0-87d2-4374-ad37-412da74f073c None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:06.499795 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1688a0-87d2-4374-ad37-412da74f073c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:06.500196 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1688a0-87d2-4374-ad37-412da74f073c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:06.501707 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1688a0-87d2-4374-ad37-412da74f073c None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:06.514830 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 322/652] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:06.515883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1688a0-87d2-4374-ad37-412da74f073c None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:06.537580 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:06.579745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8dc828-4460-411a-9bec-a29dbf40030a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:06.617075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed134ec4-e977-4ff2-a4e1-e97aff54947b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:06.617685 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed134ec4-e977-4ff2-a4e1-e97aff54947b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:06.617964 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed134ec4-e977-4ff2-a4e1-e97aff54947b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:06.618240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed134ec4-e977-4ff2-a4e1-e97aff54947b None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:06.618892 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed134ec4-e977-4ff2-a4e1-e97aff54947b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:06.619195 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed134ec4-e977-4ff2-a4e1-e97aff54947b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:06.620600 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed134ec4-e977-4ff2-a4e1-e97aff54947b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:06.621060 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1688a0-87d2-4374-ad37-412da74f073c None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:06.632991 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 331/653] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:06.633800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed134ec4-e977-4ff2-a4e1-e97aff54947b None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:06.655428 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf2b5b-f9ee-4c00-885c-8268a1e783b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:06.656062 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf2b5b-f9ee-4c00-885c-8268a1e783b9 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:06.656339 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf2b5b-f9ee-4c00-885c-8268a1e783b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:06.656608 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf2b5b-f9ee-4c00-885c-8268a1e783b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:06.665134 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:06.723128 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf2b5b-f9ee-4c00-885c-8268a1e783b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:06.724613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf2b5b-f9ee-4c00-885c-8268a1e783b9 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:06.737801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed134ec4-e977-4ff2-a4e1-e97aff54947b None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:06.743624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:06.772429 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a06b0-8374-41f5-9dbd-92353e17c75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:06.773029 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a06b0-8374-41f5-9dbd-92353e17c75a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:06.773307 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a06b0-8374-41f5-9dbd-92353e17c75a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:06.773579 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a06b0-8374-41f5-9dbd-92353e17c75a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:06.824761 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 323/654] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:02:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:02:06.825499 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf2b5b-f9ee-4c00-885c-8268a1e783b9 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:06.844696 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a06b0-8374-41f5-9dbd-92353e17c75a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:06.846132 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a06b0-8374-41f5-9dbd-92353e17c75a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:06.875654 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:06.923328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf2b5b-f9ee-4c00-885c-8268a1e783b9 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:06.940847 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:06.945422 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 332/655] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:02:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:02:06.946667 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace2ac5-646f-4394-8be0-ab7590a7ca83 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:06.946947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace2ac5-646f-4394-8be0-ab7590a7ca83 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:06.947214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace2ac5-646f-4394-8be0-ab7590a7ca83 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:06.948628 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 333/656] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:06.949156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace2ac5-646f-4394-8be0-ab7590a7ca83 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:06.962970 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24565a6-c9c6-4399-8be6-5e0733766f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:06.963562 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24565a6-c9c6-4399-8be6-5e0733766f5a None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:06.963841 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24565a6-c9c6-4399-8be6-5e0733766f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:06.964110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24565a6-c9c6-4399-8be6-5e0733766f5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:06.970751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24565a6-c9c6-4399-8be6-5e0733766f5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:06.972228 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24565a6-c9c6-4399-8be6-5e0733766f5a None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:06.983634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-d24565a6-c9c6-4399-8be6-5e0733766f5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:06.983634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:06.983634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:06.983634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:06.983634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:06.983634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:06.983634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:06.983634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:06.983634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:06.983634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:06.983634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:06.983634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:06.983634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:02:06.983634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:02:06.983634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:02:06.984764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:02:06.984764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:06.984764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:06.984764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:06.984764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:06.984764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:06.984764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:06.984764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:06.984764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:06.984764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:06.984764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:06.984764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:06.984764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:06.984764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:06.984764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:06.984764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:06.984764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:06.985680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:02:06.985680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:02:06.985680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:02:06.985680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:02:06.985680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:02:06.985680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:02:06.985680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:06.985680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:06.985680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 324/657] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:06.985680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24565a6-c9c6-4399-8be6-5e0733766f5a None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:07.053382 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace2ac5-646f-4394-8be0-ab7590a7ca83 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:07.081832 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:07.085296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24565a6-c9c6-4399-8be6-5e0733766f5a None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:07.088119 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac63ab-0a7c-4505-af28-fe58b5e09cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:07.088119 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac63ab-0a7c-4505-af28-fe58b5e09cda None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:07.088371 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac63ab-0a7c-4505-af28-fe58b5e09cda None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:07.088589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac63ab-0a7c-4505-af28-fe58b5e09cda None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:07.095535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac63ab-0a7c-4505-af28-fe58b5e09cda None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:07.096949 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac63ab-0a7c-4505-af28-fe58b5e09cda None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:07.109056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-07ac63ab-0a7c-4505-af28-fe58b5e09cda None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 28 12:02:07.109056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:07.109056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:07.109056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:07.109056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:07.109056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:07.109056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:07.109056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:07.109056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:07.109056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:07.109056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:07.109056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:07.109056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:02:07.109056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:02:07.109056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:02:07.109056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:02:07.110067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:07.110067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:07.110067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:02:07.110067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:07.110067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:02:07.110067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:07.110067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:07.110067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:07.110067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:07.110067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:07.110067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:07.110067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:07.110067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:07.110067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:07.110067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:07.110067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:07.110067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:07.110067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:07.111034 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:07.111034 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:07.111034 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:02:07.111034 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:02:07.111034 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:02:07.111034 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:02:07.111034 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:02:07.111034 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:02:07.111034 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 28 12:02:07.111034 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:07.111034 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 334/658] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 28 12:02:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:07.111034 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac63ab-0a7c-4505-af28-fe58b5e09cda None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:07.121192 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25620b4-4e7d-42b1-8965-7c0cd6bea01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:07.121829 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25620b4-4e7d-42b1-8965-7c0cd6bea01b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:07.122109 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25620b4-4e7d-42b1-8965-7c0cd6bea01b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:07.122381 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25620b4-4e7d-42b1-8965-7c0cd6bea01b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:07.132403 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25620b4-4e7d-42b1-8965-7c0cd6bea01b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:07.133856 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25620b4-4e7d-42b1-8965-7c0cd6bea01b None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:07.149828 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-f25620b4-4e7d-42b1-8965-7c0cd6bea01b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:07.149828 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:07.149828 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:07.149828 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:07.149828 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:07.149828 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:07.149828 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:07.149828 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:07.149828 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:07.149828 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:07.149828 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:07.149828 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:07.149828 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:07.149828 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:07.149828 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:07.149828 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:07.150866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:07.150866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:07.150866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:07.150866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:07.150866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:07.150866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:07.150866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:07.150866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:07.150866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:07.150866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:07.150866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:07.150866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:07.150866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:07.150866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:07.150866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:07.150866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:07.150866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:07.151801 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:07.151801 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:07.151801 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:07.151801 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 325/659] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:07.152089 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a0679-9118-4813-8137-be9d5467a3f4 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:07.152367 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a0679-9118-4813-8137-be9d5467a3f4 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:07.152639 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a0679-9118-4813-8137-be9d5467a3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:07.170366 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-cb8a0679-9118-4813-8137-be9d5467a3f4 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:07.171590 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-cb8a0679-9118-4813-8137-be9d5467a3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:07.195137 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:07.215093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac63ab-0a7c-4505-af28-fe58b5e09cda None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:07.237813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 326/660] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:02:07.239190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a0679-9118-4813-8137-be9d5467a3f4 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:07.258778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908243b-f078-40e7-9f77-0e0927dc03c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:07.259416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908243b-f078-40e7-9f77-0e0927dc03c6 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:07.259721 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908243b-f078-40e7-9f77-0e0927dc03c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:07.259991 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908243b-f078-40e7-9f77-0e0927dc03c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:07.271888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908243b-f078-40e7-9f77-0e0927dc03c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:07.273676 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908243b-f078-40e7-9f77-0e0927dc03c6 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:07.290215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-c908243b-f078-40e7-9f77-0e0927dc03c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:07.290215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:07.290215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:07.290215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:07.290215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:07.290215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:07.290215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:07.290215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:07.290215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:07.290215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:07.290215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:07.290215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:07.290215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:07.290215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:07.290215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:07.290215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:07.291176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:07.291176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:07.291176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:07.291176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:07.291176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:07.291176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:07.291176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:07.291176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:07.291176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:07.291176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:07.291176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:07.291176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:07.291176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:07.291176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:07.291176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:07.291176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:07.291176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:07.292128 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:07.292128 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:07.292128 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:07.292128 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 335/661] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:07.292780 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908243b-f078-40e7-9f77-0e0927dc03c6 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:07.347732 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:07.349752 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a0679-9118-4813-8137-be9d5467a3f4 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:07.386744 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a9c47-d686-4126-b189-ed395657f00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:07.387353 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a9c47-d686-4126-b189-ed395657f00a None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:07.387661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a9c47-d686-4126-b189-ed395657f00a None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:07.387937 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a9c47-d686-4126-b189-ed395657f00a None admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:07.388622 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a9c47-d686-4126-b189-ed395657f00a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:07.388925 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a9c47-d686-4126-b189-ed395657f00a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:07.390342 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a9c47-d686-4126-b189-ed395657f00a None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:07.402385 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 327/662] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:02:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:07.403199 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a9c47-d686-4126-b189-ed395657f00a None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:07.418738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908243b-f078-40e7-9f77-0e0927dc03c6 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:07.426954 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:07.454864 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d442528-7c3e-4b98-88a2-ad00581d3353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:07.455498 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d442528-7c3e-4b98-88a2-ad00581d3353 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:07.455780 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d442528-7c3e-4b98-88a2-ad00581d3353 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:07.456049 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d442528-7c3e-4b98-88a2-ad00581d3353 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:07.457348 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d442528-7c3e-4b98-88a2-ad00581d3353 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:07.457659 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d442528-7c3e-4b98-88a2-ad00581d3353 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:07.459112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d442528-7c3e-4b98-88a2-ad00581d3353 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:07.481982 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 336/663] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Sep 28 12:02:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:07.481982 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d442528-7c3e-4b98-88a2-ad00581d3353 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:07.514440 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a9c47-d686-4126-b189-ed395657f00a None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:07.547593 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fa23c-bc01-49b9-b32c-b1cfa77ede62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:07.548196 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fa23c-bc01-49b9-b32c-b1cfa77ede62 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:07.548474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fa23c-bc01-49b9-b32c-b1cfa77ede62 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:07.548744 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fa23c-bc01-49b9-b32c-b1cfa77ede62 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:07.549382 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286fa23c-bc01-49b9-b32c-b1cfa77ede62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:07.549679 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286fa23c-bc01-49b9-b32c-b1cfa77ede62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:07.551598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286fa23c-bc01-49b9-b32c-b1cfa77ede62 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:07.563424 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 328/664] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:07.564235 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fa23c-bc01-49b9-b32c-b1cfa77ede62 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:07.584257 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:07.587033 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d442528-7c3e-4b98-88a2-ad00581d3353 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:07.622883 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e5ec0-c5c7-4729-8bf1-31d0d6372ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:07.623582 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e5ec0-c5c7-4729-8bf1-31d0d6372ced None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:07.623867 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e5ec0-c5c7-4729-8bf1-31d0d6372ced None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:07.624143 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e5ec0-c5c7-4729-8bf1-31d0d6372ced None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:07.624788 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e5ec0-c5c7-4729-8bf1-31d0d6372ced None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:07.625088 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e5ec0-c5c7-4729-8bf1-31d0d6372ced None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:07.626437 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e5ec0-c5c7-4729-8bf1-31d0d6372ced None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:07.638101 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 337/665] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:07.639209 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e5ec0-c5c7-4729-8bf1-31d0d6372ced None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:07.646688 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:07.665799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fa23c-bc01-49b9-b32c-b1cfa77ede62 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:07.700856 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3941c-4819-43de-8397-ae17fa49ec89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:07.701465 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3941c-4819-43de-8397-ae17fa49ec89 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:07.701744 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3941c-4819-43de-8397-ae17fa49ec89 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:07.702016 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3941c-4819-43de-8397-ae17fa49ec89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:07.702765 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3941c-4819-43de-8397-ae17fa49ec89 None admin] RBAC: Adding query filter params (role.id=9b8671e5f63c4b08982273f189eab5ec, scope.project.id=c854d366f35145e8b2fadb9b014d0199, user.id=0e81804e04514ae882a1fd93789db025) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:07.703095 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3941c-4819-43de-8397-ae17fa49ec89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:07.704572 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3941c-4819-43de-8397-ae17fa49ec89 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:07.710403 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 329/666] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:02:07 2022] GET /identity/v3/role_assignments?user.id=0e81804e04514ae882a1fd93789db025&scope.project.id=c854d366f35145e8b2fadb9b014d0199&role.id=9b8671e5f63c4b08982273f189eab5ec => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:07.711179 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3941c-4819-43de-8397-ae17fa49ec89 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:07.753528 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e5ec0-c5c7-4729-8bf1-31d0d6372ced None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:07.794036 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f20673-fe15-4f1e-b2e6-fb04b0baa875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:07.794809 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f20673-fe15-4f1e-b2e6-fb04b0baa875 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:07.794922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f20673-fe15-4f1e-b2e6-fb04b0baa875 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:07.795203 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f20673-fe15-4f1e-b2e6-fb04b0baa875 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:07.828046 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:07.840229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3941c-4819-43de-8397-ae17fa49ec89 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:07.873331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f20673-fe15-4f1e-b2e6-fb04b0baa875 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:07.874797 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f20673-fe15-4f1e-b2e6-fb04b0baa875 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:07.879399 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67edb7c-5e98-42ca-a989-b8f51cf0ff37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:07.880080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67edb7c-5e98-42ca-a989-b8f51cf0ff37 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:07.880355 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67edb7c-5e98-42ca-a989-b8f51cf0ff37 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:07.880623 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67edb7c-5e98-42ca-a989-b8f51cf0ff37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:07.893198 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67edb7c-5e98-42ca-a989-b8f51cf0ff37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:02:07.900064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-c67edb7c-5e98-42ca-a989-b8f51cf0ff37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:02:07.900064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:07.900064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:07.900064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:07.900064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:07.900064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:07.900064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:07.900064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:07.900064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:07.900064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:07.900064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:07.900064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:07.900064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:02:07.900064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:02:07.900064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:02:07.900064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:02:07.901304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:02:07.901304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:02:07.901304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:02:07.901304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:02:07.901304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:07.901304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:07.901304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:07.901304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:07.901304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:07.901304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:07.901304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:07.901304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:07.901304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:07.901304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:07.901304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:07.901304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:07.902176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:07.902176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:07.902176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:07.902176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:07.902176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:02:07.902176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:02:07.902176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:02:07.902176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:02:07.902176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:02:07.902176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:02:07.902176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:02:07.902176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:07.902176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 330/667] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 28 12:02:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:07.902176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67edb7c-5e98-42ca-a989-b8f51cf0ff37 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:07.907529 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:08.002469 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 338/668] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:02:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:02:08.004810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f20673-fe15-4f1e-b2e6-fb04b0baa875 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:08.030175 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67edb7c-5e98-42ca-a989-b8f51cf0ff37 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:08.068045 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae36b9f-36ff-43a8-9525-94e8781a9fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:08.068821 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae36b9f-36ff-43a8-9525-94e8781a9fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:08.069202 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae36b9f-36ff-43a8-9525-94e8781a9fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:08.069615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae36b9f-36ff-43a8-9525-94e8781a9fb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:08.073487 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:08.077040 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae36b9f-36ff-43a8-9525-94e8781a9fb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:08.078603 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae36b9f-36ff-43a8-9525-94e8781a9fb4 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:08.090735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-0ae36b9f-36ff-43a8-9525-94e8781a9fb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:08.090735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:08.090735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:08.090735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:08.090735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:08.090735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:08.090735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:08.090735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:08.090735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:08.090735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:08.090735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:08.090735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:08.090735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:02:08.090735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:02:08.090735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:02:08.091890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:02:08.091890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:08.091890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:08.091890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:08.091890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:08.091890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:08.091890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:08.091890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:08.091890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:08.091890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:08.091890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:08.091890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:08.091890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:08.091890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:08.091890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:08.091890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:08.091890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:08.093006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:02:08.093006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:02:08.093006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:02:08.093006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:02:08.093006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:02:08.093006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:02:08.093006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:08.093006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:08.094069 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 331/669] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:08.094749 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae36b9f-36ff-43a8-9525-94e8781a9fb4 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:08.126472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f20673-fe15-4f1e-b2e6-fb04b0baa875 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:08.158462 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:08.174040 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfdeeae-94ce-4318-84f5-4984c044377f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:08.175337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdeeae-94ce-4318-84f5-4984c044377f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:08.176184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdeeae-94ce-4318-84f5-4984c044377f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:08.176632 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdeeae-94ce-4318-84f5-4984c044377f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:08.184866 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfdeeae-94ce-4318-84f5-4984c044377f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:08.186600 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfdeeae-94ce-4318-84f5-4984c044377f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:08.197953 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae36b9f-36ff-43a8-9525-94e8781a9fb4 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:08.201228 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-4dfdeeae-94ce-4318-84f5-4984c044377f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:08.201228 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:08.201228 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:08.201228 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:08.201228 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:08.201228 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:08.201228 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:08.201228 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:08.201228 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:08.201228 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:08.201228 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:08.201228 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:08.201228 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:02:08.201228 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:02:08.201228 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:02:08.202282 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:02:08.202282 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:08.202282 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:08.202282 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:08.202282 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:08.202282 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:08.202282 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:08.202282 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:08.202282 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:08.202282 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:08.202282 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:08.202282 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:08.202282 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:08.202282 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:08.202282 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:08.202282 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:08.202282 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:08.203375 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:02:08.203375 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:02:08.203375 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:02:08.203375 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:02:08.203375 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:02:08.203375 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:02:08.203375 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:08.203375 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:08.205539 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 339/670] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:08.206460 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfdeeae-94ce-4318-84f5-4984c044377f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:08.235375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec078821-0a97-4a11-9328-3ae49ff54c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:08.236015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec078821-0a97-4a11-9328-3ae49ff54c12 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:08.236298 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec078821-0a97-4a11-9328-3ae49ff54c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:08.236570 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec078821-0a97-4a11-9328-3ae49ff54c12 None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:08.237241 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec078821-0a97-4a11-9328-3ae49ff54c12 None admin] RBAC: Adding query filter params (name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:08.237531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec078821-0a97-4a11-9328-3ae49ff54c12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:08.239569 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec078821-0a97-4a11-9328-3ae49ff54c12 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:08.248037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 332/671] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 28 12:02:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:08.248834 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec078821-0a97-4a11-9328-3ae49ff54c12 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:08.336885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfdeeae-94ce-4318-84f5-4984c044377f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:08.353402 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec078821-0a97-4a11-9328-3ae49ff54c12 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:08.360598 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:08.377231 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726ac3d-4777-48c3-bf11-1caf64a2ed43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:08.378037 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726ac3d-4777-48c3-bf11-1caf64a2ed43 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:08.378428 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726ac3d-4777-48c3-bf11-1caf64a2ed43 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:08.379311 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726ac3d-4777-48c3-bf11-1caf64a2ed43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:08.380941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:08.390472 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1372015-0bf4-4031-b1b6-45568ebe32e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:08.390636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726ac3d-4777-48c3-bf11-1caf64a2ed43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:08.391077 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1372015-0bf4-4031-b1b6-45568ebe32e7 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:08.391361 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1372015-0bf4-4031-b1b6-45568ebe32e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:08.391664 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1372015-0bf4-4031-b1b6-45568ebe32e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:08.392285 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726ac3d-4777-48c3-bf11-1caf64a2ed43 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:08.392384 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1372015-0bf4-4031-b1b6-45568ebe32e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:08.392684 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1372015-0bf4-4031-b1b6-45568ebe32e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:08.394121 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1372015-0bf4-4031-b1b6-45568ebe32e7 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:08.406588 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 333/672] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:02:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:08.407221 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1372015-0bf4-4031-b1b6-45568ebe32e7 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:08.412745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-7726ac3d-4777-48c3-bf11-1caf64a2ed43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:08.412745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:08.412745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:08.412745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:08.412745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:08.412745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:08.412745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:08.412745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:08.412745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:08.412745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:08.412745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:08.412745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:08.412745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:08.412745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:08.412745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:08.412745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:08.413701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:08.413701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:08.413701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:08.413701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:08.413701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:08.413701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:08.413701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:08.413701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:08.413701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:08.413701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:08.413701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:08.413701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:08.413701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:08.413701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:08.413701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:08.413701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:08.413701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:08.414611 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:08.414611 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:08.414611 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:08.414611 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 340/673] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:08.415263 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726ac3d-4777-48c3-bf11-1caf64a2ed43 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:08.517029 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1372015-0bf4-4031-b1b6-45568ebe32e7 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:08.526974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726ac3d-4777-48c3-bf11-1caf64a2ed43 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:08.552355 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476ad24-7e65-48bf-acf5-16ea459de97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:08.552976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476ad24-7e65-48bf-acf5-16ea459de97b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:08.553261 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476ad24-7e65-48bf-acf5-16ea459de97b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:08.553535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476ad24-7e65-48bf-acf5-16ea459de97b None admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:08.554226 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476ad24-7e65-48bf-acf5-16ea459de97b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:08.554534 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476ad24-7e65-48bf-acf5-16ea459de97b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:08.556015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476ad24-7e65-48bf-acf5-16ea459de97b None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:08.567897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307c034-8772-4281-9aff-729d37abad07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:08.568537 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307c034-8772-4281-9aff-729d37abad07 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:08.568816 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307c034-8772-4281-9aff-729d37abad07 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:08.573978 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307c034-8772-4281-9aff-729d37abad07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:08.574164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 334/674] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:02:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:08.574164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476ad24-7e65-48bf-acf5-16ea459de97b None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:08.584077 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307c034-8772-4281-9aff-729d37abad07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:08.585673 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307c034-8772-4281-9aff-729d37abad07 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:08.602201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-b307c034-8772-4281-9aff-729d37abad07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:08.602201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:08.602201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:08.602201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:08.602201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:08.602201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:08.602201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:08.602201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:08.602201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:08.602201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:08.602201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:08.602201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:08.602201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:08.602201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:08.602201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:08.602201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:08.603383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:08.603383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:08.603383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:08.603383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:08.603383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:08.603383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:08.603383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:08.603383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:08.603383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:08.603383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:08.603383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:08.603383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:08.603383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:08.603383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:08.603383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:08.603383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:08.603383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:08.604363 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:08.604363 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:08.604363 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:08.604363 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 341/675] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:08.604981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307c034-8772-4281-9aff-729d37abad07 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:08.624265 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:08.633155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:08.684028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476ad24-7e65-48bf-acf5-16ea459de97b None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:08.717801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307c034-8772-4281-9aff-729d37abad07 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:08.725755 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d825df5-803e-419c-b155-3f933e870da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:08.726372 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d825df5-803e-419c-b155-3f933e870da3 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:08.726651 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d825df5-803e-419c-b155-3f933e870da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:08.726919 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d825df5-803e-419c-b155-3f933e870da3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:08.731021 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d825df5-803e-419c-b155-3f933e870da3 None admin] RBAC: Adding query filter params (role.id=9b8671e5f63c4b08982273f189eab5ec, scope.project.id=c854d366f35145e8b2fadb9b014d0199, user.id=f09354b404d94e9db2e21292a61a06f2) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:08.731021 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d825df5-803e-419c-b155-3f933e870da3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:08.731021 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d825df5-803e-419c-b155-3f933e870da3 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:08.747462 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 335/676] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:02:08 2022] GET /identity/v3/role_assignments?user.id=f09354b404d94e9db2e21292a61a06f2&scope.project.id=c854d366f35145e8b2fadb9b014d0199&role.id=9b8671e5f63c4b08982273f189eab5ec => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:08.747462 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d825df5-803e-419c-b155-3f933e870da3 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:08.754430 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d096a-03f4-4ed9-89c1-2204e6ae32da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:08.755165 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d096a-03f4-4ed9-89c1-2204e6ae32da None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:08.755553 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d096a-03f4-4ed9-89c1-2204e6ae32da None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:08.755893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d096a-03f4-4ed9-89c1-2204e6ae32da None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:08.756624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d096a-03f4-4ed9-89c1-2204e6ae32da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:08.756999 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d096a-03f4-4ed9-89c1-2204e6ae32da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:08.758491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d096a-03f4-4ed9-89c1-2204e6ae32da None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:08.777994 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 342/677] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:08.779038 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d096a-03f4-4ed9-89c1-2204e6ae32da None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:08.876321 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d825df5-803e-419c-b155-3f933e870da3 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:08.890159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:08.895247 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:08.916927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d096a-03f4-4ed9-89c1-2204e6ae32da None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:08.921417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c6aff-8997-4a21-9323-9d4a4fcbcc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:08.922334 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c6aff-8997-4a21-9323-9d4a4fcbcc6a None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:08.922834 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c6aff-8997-4a21-9323-9d4a4fcbcc6a None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:08.923308 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c6aff-8997-4a21-9323-9d4a4fcbcc6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:08.924262 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c6aff-8997-4a21-9323-9d4a4fcbcc6a None admin] RBAC: Adding query filter params (role.id=9b8671e5f63c4b08982273f189eab5ec, scope.project.id=c854d366f35145e8b2fadb9b014d0199, user.id=9180b1616c524905b86769a9eb8f7757) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:08.924788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c6aff-8997-4a21-9323-9d4a4fcbcc6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:08.926599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c6aff-8997-4a21-9323-9d4a4fcbcc6a None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:08.937171 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 336/678] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:02:08 2022] GET /identity/v3/role_assignments?user.id=9180b1616c524905b86769a9eb8f7757&scope.project.id=c854d366f35145e8b2fadb9b014d0199&role.id=9b8671e5f63c4b08982273f189eab5ec => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:08.938070 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c6aff-8997-4a21-9323-9d4a4fcbcc6a None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:08.969038 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50beb89-37fe-4a3a-98e5-d80ca40c8a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:08.970079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50beb89-37fe-4a3a-98e5-d80ca40c8a18 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:08.970562 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50beb89-37fe-4a3a-98e5-d80ca40c8a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:08.971047 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50beb89-37fe-4a3a-98e5-d80ca40c8a18 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:08.971874 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50beb89-37fe-4a3a-98e5-d80ca40c8a18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:08.972279 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50beb89-37fe-4a3a-98e5-d80ca40c8a18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:08.973766 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50beb89-37fe-4a3a-98e5-d80ca40c8a18 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:08.991516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 343/679] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:08.998210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50beb89-37fe-4a3a-98e5-d80ca40c8a18 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:09.080307 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c6aff-8997-4a21-9323-9d4a4fcbcc6a None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:09.135762 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d9cbc-2564-4604-9a09-884a5f73d443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:09.136471 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d9cbc-2564-4604-9a09-884a5f73d443 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:09.136870 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d9cbc-2564-4604-9a09-884a5f73d443 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:09.137245 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d9cbc-2564-4604-9a09-884a5f73d443 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:09.146106 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d9cbc-2564-4604-9a09-884a5f73d443 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:09.148250 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d9cbc-2564-4604-9a09-884a5f73d443 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:09.156786 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50beb89-37fe-4a3a-98e5-d80ca40c8a18 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:09.162826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-7c8d9cbc-2564-4604-9a09-884a5f73d443 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:09.162826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:09.162826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:09.162826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:09.162826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:09.162826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:09.162826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:09.162826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:09.162826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:09.162826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:09.162826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:09.162826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:09.162826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:02:09.162826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:02:09.162826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:02:09.163785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:02:09.163785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:09.163785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:09.163785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:09.163785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:09.163785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:09.163785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:09.163785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:09.163785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:09.163785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:09.163785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:09.163785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:09.163785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:09.163785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:09.163785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:09.163785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:09.163785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:09.164708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:02:09.164708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:02:09.164708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:02:09.164708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:02:09.164708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:02:09.164708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:02:09.164708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:09.164708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:09.165172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 337/680] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:09.171491 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d9cbc-2564-4604-9a09-884a5f73d443 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:09.200454 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b665c2-273f-4fbb-9c20-f61037544ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:09.201101 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b665c2-273f-4fbb-9c20-f61037544ecf None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:09.201378 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b665c2-273f-4fbb-9c20-f61037544ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:09.201695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b665c2-273f-4fbb-9c20-f61037544ecf None admin] PATH_INFO: `/v3/users/swift` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:09.216594 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b665c2-273f-4fbb-9c20-f61037544ecf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:09.218097 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b665c2-273f-4fbb-9c20-f61037544ecf None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:09.220061 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:09.233738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-88b665c2-273f-4fbb-9c20-f61037544ecf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 28 12:02:09.233738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:09.233738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:09.233738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:09.233738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:09.233738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:09.233738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:09.233738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:09.233738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:09.233738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:09.233738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:09.233738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:09.233738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:02:09.233738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:02:09.233738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:02:09.233738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:02:09.235015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:09.235015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:09.235015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:02:09.235015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:09.235015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:02:09.235015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:09.235015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:09.235015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:09.235015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:09.235015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:09.235015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:09.235015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:09.235015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:09.235015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:09.235015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:09.235015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:09.235015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:09.235015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:09.236236 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:09.236236 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:09.236236 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:02:09.236236 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:02:09.236236 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:02:09.236236 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:02:09.236236 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:02:09.236236 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:02:09.236236 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 28 12:02:09.236236 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:09.239309 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 344/681] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:02:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:09.248571 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b665c2-273f-4fbb-9c20-f61037544ecf None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:09.254180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:09.324930 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d9cbc-2564-4604-9a09-884a5f73d443 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:09.372702 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedef08c-8c8e-47a2-9d23-93d4ba694b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:09.373487 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedef08c-8c8e-47a2-9d23-93d4ba694b8e None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:09.373859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedef08c-8c8e-47a2-9d23-93d4ba694b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:09.374227 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedef08c-8c8e-47a2-9d23-93d4ba694b8e None admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:09.375023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedef08c-8c8e-47a2-9d23-93d4ba694b8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:09.375446 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedef08c-8c8e-47a2-9d23-93d4ba694b8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:09.376235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b665c2-273f-4fbb-9c20-f61037544ecf None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:09.377255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedef08c-8c8e-47a2-9d23-93d4ba694b8e None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:09.395548 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 338/682] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:02:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:09.398172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedef08c-8c8e-47a2-9d23-93d4ba694b8e None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:09.429185 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce77e5e-9311-412f-a217-7a39812fa9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:09.429843 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce77e5e-9311-412f-a217-7a39812fa9c8 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:09.430668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce77e5e-9311-412f-a217-7a39812fa9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:09.430968 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce77e5e-9311-412f-a217-7a39812fa9c8 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:09.431730 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce77e5e-9311-412f-a217-7a39812fa9c8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:09.432040 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce77e5e-9311-412f-a217-7a39812fa9c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:09.433738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce77e5e-9311-412f-a217-7a39812fa9c8 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:09.459901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 345/683] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Sep 28 12:02:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:09.465707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce77e5e-9311-412f-a217-7a39812fa9c8 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:09.525234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:09.533021 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedef08c-8c8e-47a2-9d23-93d4ba694b8e None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:09.539174 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:09.574069 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75f628-22bf-4bea-8936-9df198542bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:09.575044 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75f628-22bf-4bea-8936-9df198542bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:09.576006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75f628-22bf-4bea-8936-9df198542bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:09.576535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75f628-22bf-4bea-8936-9df198542bd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:09.577518 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75f628-22bf-4bea-8936-9df198542bd6 None admin] RBAC: Adding query filter params (role.id=9b8671e5f63c4b08982273f189eab5ec, scope.project.id=c854d366f35145e8b2fadb9b014d0199, user.id=ca51ff621664452db7dd991714462e3b) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:09.578046 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75f628-22bf-4bea-8936-9df198542bd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:09.580043 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75f628-22bf-4bea-8936-9df198542bd6 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:09.583009 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce77e5e-9311-412f-a217-7a39812fa9c8 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:09.591573 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 339/684] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:02:09 2022] GET /identity/v3/role_assignments?user.id=ca51ff621664452db7dd991714462e3b&scope.project.id=c854d366f35145e8b2fadb9b014d0199&role.id=9b8671e5f63c4b08982273f189eab5ec => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:09.621974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24df77-e1a4-44bc-9a96-a8d7894f8e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:09.622594 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24df77-e1a4-44bc-9a96-a8d7894f8e1e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:09.622873 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24df77-e1a4-44bc-9a96-a8d7894f8e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:09.623146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24df77-e1a4-44bc-9a96-a8d7894f8e1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:09.709679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24df77-e1a4-44bc-9a96-a8d7894f8e1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:09.710656 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24df77-e1a4-44bc-9a96-a8d7894f8e1e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:09.779078 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:09.821593 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 346/685] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:02:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:02:09.827197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75f628-22bf-4bea-8936-9df198542bd6 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:09.947946 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75f628-22bf-4bea-8936-9df198542bd6 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:09.987596 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116960ae-cc4f-4098-8d65-a3d7ca49dfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:09.988173 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116960ae-cc4f-4098-8d65-a3d7ca49dfbe None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:09.988453 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116960ae-cc4f-4098-8d65-a3d7ca49dfbe None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:09.988718 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116960ae-cc4f-4098-8d65-a3d7ca49dfbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:10.001973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116960ae-cc4f-4098-8d65-a3d7ca49dfbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:10.003541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116960ae-cc4f-4098-8d65-a3d7ca49dfbe None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:10.020013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-116960ae-cc4f-4098-8d65-a3d7ca49dfbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:10.020013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:10.020013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:10.020013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:10.020013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:10.020013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:10.020013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:10.020013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:10.020013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:10.020013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:10.020013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:10.020013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:10.020013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:10.020013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:10.020013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:10.020013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:10.021052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:10.021052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:10.021052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:10.021052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:10.021052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:10.021052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:10.021052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:10.021052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:10.021052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:10.021052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:10.021052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:10.021052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:10.021052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:10.021052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:10.021052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:10.021052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:10.021052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:10.021974 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:10.021974 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:10.021974 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:10.023299 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 340/686] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:10.029238 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24df77-e1a4-44bc-9a96-a8d7894f8e1e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:10.062919 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f8291-777d-44de-870d-06af9c8c7bd3 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:10.062919 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f8291-777d-44de-870d-06af9c8c7bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:10.062919 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f8291-777d-44de-870d-06af9c8c7bd3 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:10.063523 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 341/687] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:02:10.068656 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e65862-438d-4be1-85ed-07a27c98ca2a None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:10.069134 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e65862-438d-4be1-85ed-07a27c98ca2a None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:10.069552 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e65862-438d-4be1-85ed-07a27c98ca2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:10.088822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-89e65862-438d-4be1-85ed-07a27c98ca2a None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:10.090285 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-89e65862-438d-4be1-85ed-07a27c98ca2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:10.102475 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:10.179753 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 342/688] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:02:10.189519 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24df77-e1a4-44bc-9a96-a8d7894f8e1e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:10.239596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f6bf7-c86d-4107-81b3-6053415a7d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:10.240446 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f6bf7-c86d-4107-81b3-6053415a7d16 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:10.241134 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f6bf7-c86d-4107-81b3-6053415a7d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:10.241550 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f6bf7-c86d-4107-81b3-6053415a7d16 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:10.242364 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f6bf7-c86d-4107-81b3-6053415a7d16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:10.242814 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f6bf7-c86d-4107-81b3-6053415a7d16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:10.244388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f6bf7-c86d-4107-81b3-6053415a7d16 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:10.262056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 347/689] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:10.267832 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e65862-438d-4be1-85ed-07a27c98ca2a None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:10.388333 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e65862-438d-4be1-85ed-07a27c98ca2a None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:10.432361 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e4b5e-6e19-4487-98a0-426c26dce10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:10.433243 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e4b5e-6e19-4487-98a0-426c26dce10c None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:10.433670 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e4b5e-6e19-4487-98a0-426c26dce10c None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:10.434088 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e4b5e-6e19-4487-98a0-426c26dce10c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:10.441892 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e4b5e-6e19-4487-98a0-426c26dce10c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:10.443509 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e4b5e-6e19-4487-98a0-426c26dce10c None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:10.446230 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:10.455486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-762e4b5e-6e19-4487-98a0-426c26dce10c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:10.455486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:10.455486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:10.455486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:10.455486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:10.455486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:10.455486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:10.455486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:10.455486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:10.455486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:10.455486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:10.455486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:10.455486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:02:10.455486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:02:10.455486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:02:10.456407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:02:10.456407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:10.456407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:10.456407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:10.456407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:10.456407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:10.456407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:10.456407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:10.456407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:10.456407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:10.456407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:10.456407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:10.456407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:10.456407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:10.456407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:10.456407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:10.456407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:10.458532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:02:10.458532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:02:10.458532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:02:10.458532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:02:10.458532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:02:10.458532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:02:10.458532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:10.458532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:10.463158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f6bf7-c86d-4107-81b3-6053415a7d16 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:10.463633 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 343/690] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:10.490227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:10.564910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e4b5e-6e19-4487-98a0-426c26dce10c None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:10.570953 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f6bf7-c86d-4107-81b3-6053415a7d16 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:10.609497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859abb5-db37-4d66-992e-f75b1d359321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:10.610158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859abb5-db37-4d66-992e-f75b1d359321 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:10.610446 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859abb5-db37-4d66-992e-f75b1d359321 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:10.610714 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859abb5-db37-4d66-992e-f75b1d359321 None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:10.611411 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859abb5-db37-4d66-992e-f75b1d359321 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:10.611760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859abb5-db37-4d66-992e-f75b1d359321 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:10.613504 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859abb5-db37-4d66-992e-f75b1d359321 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:10.626748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 348/691] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:02:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:10.633567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859abb5-db37-4d66-992e-f75b1d359321 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:10.731820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:10.752088 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859abb5-db37-4d66-992e-f75b1d359321 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:10.789019 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6f9a1-a23b-4f52-961b-e72c3d8e7e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:10.790000 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6f9a1-a23b-4f52-961b-e72c3d8e7e45 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:10.790377 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6f9a1-a23b-4f52-961b-e72c3d8e7e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:10.790746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6f9a1-a23b-4f52-961b-e72c3d8e7e45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:10.791614 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6f9a1-a23b-4f52-961b-e72c3d8e7e45 None admin] RBAC: Adding query filter params (role.id=9b8671e5f63c4b08982273f189eab5ec, scope.project.id=c854d366f35145e8b2fadb9b014d0199, user.id=822e394e80fd41adb54d330adaf65a68) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:10.792020 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6f9a1-a23b-4f52-961b-e72c3d8e7e45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:10.794505 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6f9a1-a23b-4f52-961b-e72c3d8e7e45 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:10.801984 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 349/692] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:02:10 2022] GET /identity/v3/role_assignments?user.id=822e394e80fd41adb54d330adaf65a68&scope.project.id=c854d366f35145e8b2fadb9b014d0199&role.id=9b8671e5f63c4b08982273f189eab5ec => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:10.870709 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e4b5e-6e19-4487-98a0-426c26dce10c None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:10.924861 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768619cf-a0f8-414a-b760-3171d48b1f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:10.925614 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768619cf-a0f8-414a-b760-3171d48b1f0a None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:10.925898 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768619cf-a0f8-414a-b760-3171d48b1f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:10.926177 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768619cf-a0f8-414a-b760-3171d48b1f0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:10.948639 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768619cf-a0f8-414a-b760-3171d48b1f0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:02:10.954254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-768619cf-a0f8-414a-b760-3171d48b1f0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:02:10.954254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:10.954254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:10.954254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:10.954254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:10.954254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:10.954254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:10.954254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:10.954254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:10.954254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:10.954254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:10.954254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:10.954254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:02:10.954254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:02:10.954254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:02:10.954254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:02:10.955381 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:02:10.955381 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:02:10.955381 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:02:10.955381 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:02:10.955381 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:10.955381 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:10.955381 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:10.955381 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:10.955381 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:10.955381 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:10.955381 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:10.955381 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:10.955381 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:10.955381 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:10.955381 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:10.955381 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:10.957197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:10.957197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:10.957197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:10.957197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:10.957197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:02:10.957197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:02:10.957197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:02:10.957197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:02:10.957197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:02:10.957197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:02:10.957197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:02:10.957197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:10.957197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 344/693] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:02:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:10.961882 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6f9a1-a23b-4f52-961b-e72c3d8e7e45 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:11.098783 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6f9a1-a23b-4f52-961b-e72c3d8e7e45 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:11.135096 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543851c6-3d47-45b6-9504-b444d6db068f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:11.135744 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543851c6-3d47-45b6-9504-b444d6db068f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:11.136022 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543851c6-3d47-45b6-9504-b444d6db068f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:11.136359 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543851c6-3d47-45b6-9504-b444d6db068f None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:11.137051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543851c6-3d47-45b6-9504-b444d6db068f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:11.137389 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543851c6-3d47-45b6-9504-b444d6db068f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:11.138756 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543851c6-3d47-45b6-9504-b444d6db068f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:11.148357 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 350/694] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:02:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:11.153577 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768619cf-a0f8-414a-b760-3171d48b1f0a None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:11.230307 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:11.276897 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768619cf-a0f8-414a-b760-3171d48b1f0a None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:11.312976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15934674-bf06-454a-bfc8-3e83cd12d9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:11.313604 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15934674-bf06-454a-bfc8-3e83cd12d9d8 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:11.313881 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15934674-bf06-454a-bfc8-3e83cd12d9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:11.314146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15934674-bf06-454a-bfc8-3e83cd12d9d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:11.326988 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15934674-bf06-454a-bfc8-3e83cd12d9d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:11.328471 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15934674-bf06-454a-bfc8-3e83cd12d9d8 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:11.343965 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-15934674-bf06-454a-bfc8-3e83cd12d9d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:11.343965 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:11.343965 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:11.343965 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:11.343965 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:11.343965 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:11.343965 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:11.343965 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:11.343965 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:11.343965 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:11.343965 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:11.343965 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:11.343965 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:11.343965 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:11.343965 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:11.343965 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:11.344980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:11.344980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:11.344980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:11.344980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:11.344980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:11.344980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:11.344980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:11.344980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:11.344980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:11.344980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:11.344980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:11.344980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:11.344980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:11.344980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:11.344980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:11.344980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:11.344980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:11.346491 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:11.346491 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:11.346491 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:11.346491 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 345/695] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:11.351200 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543851c6-3d47-45b6-9504-b444d6db068f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:11.364568 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:11.465859 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543851c6-3d47-45b6-9504-b444d6db068f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:11.484714 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb5034-264c-4be7-ba00-826635de728a None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:11.485330 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb5034-264c-4be7-ba00-826635de728a None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:11.485330 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb5034-264c-4be7-ba00-826635de728a None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:11.486547 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 346/696] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:02:11.494069 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349032d8-6525-44bb-af0b-b4a8d02a31a5 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:11.494599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349032d8-6525-44bb-af0b-b4a8d02a31a5 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:11.495081 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349032d8-6525-44bb-af0b-b4a8d02a31a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:11.509628 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f925dd2-d216-42e2-a7f4-55b1c6cdc73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:11.510245 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f925dd2-d216-42e2-a7f4-55b1c6cdc73d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:11.510527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f925dd2-d216-42e2-a7f4-55b1c6cdc73d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:11.510800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f925dd2-d216-42e2-a7f4-55b1c6cdc73d None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:11.513005 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f925dd2-d216-42e2-a7f4-55b1c6cdc73d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:11.513005 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f925dd2-d216-42e2-a7f4-55b1c6cdc73d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:11.513290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f925dd2-d216-42e2-a7f4-55b1c6cdc73d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:11.519219 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-349032d8-6525-44bb-af0b-b4a8d02a31a5 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:11.520815 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-349032d8-6525-44bb-af0b-b4a8d02a31a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:11.527374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 351/697] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:11.532359 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f925dd2-d216-42e2-a7f4-55b1c6cdc73d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:11.617372 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:11.637066 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 347/698] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:02:11.676697 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f925dd2-d216-42e2-a7f4-55b1c6cdc73d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:11.722941 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c450f3-d5b2-496f-8236-c597e0c8add9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:11.723608 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c450f3-d5b2-496f-8236-c597e0c8add9 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:11.723882 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c450f3-d5b2-496f-8236-c597e0c8add9 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:11.724149 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c450f3-d5b2-496f-8236-c597e0c8add9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:11.734629 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c450f3-d5b2-496f-8236-c597e0c8add9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:11.736095 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c450f3-d5b2-496f-8236-c597e0c8add9 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:11.757616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-70c450f3-d5b2-496f-8236-c597e0c8add9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:02:11.757616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:11.757616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:11.757616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:11.757616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:11.757616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:11.757616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:11.757616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:11.757616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:11.757616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:11.757616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:11.757616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:11.757616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:02:11.757616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:02:11.757616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:02:11.757616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:02:11.758679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:11.758679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:11.758679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:02:11.758679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:11.758679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:02:11.758679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:11.758679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:11.758679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:11.758679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:11.758679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:11.758679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:11.758679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:11.758679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:11.758679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:11.758679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:11.758679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:11.758679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:11.758679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:11.759718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:11.759718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:11.759718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:02:11.759718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:02:11.759718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:02:11.759718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:02:11.759718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:02:11.759718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:02:11.759718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:02:11.759718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:11.759718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 352/699] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Sep 28 12:02:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:11.764506 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349032d8-6525-44bb-af0b-b4a8d02a31a5 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:11.834643 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:11.896429 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349032d8-6525-44bb-af0b-b4a8d02a31a5 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:11.931631 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952088d-4a2f-42fe-ba8e-e313b3e0628b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:11.932301 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952088d-4a2f-42fe-ba8e-e313b3e0628b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:11.932584 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952088d-4a2f-42fe-ba8e-e313b3e0628b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:11.932856 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952088d-4a2f-42fe-ba8e-e313b3e0628b None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:11.933587 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952088d-4a2f-42fe-ba8e-e313b3e0628b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:11.933892 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952088d-4a2f-42fe-ba8e-e313b3e0628b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:11.935330 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952088d-4a2f-42fe-ba8e-e313b3e0628b None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:11.954246 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 348/700] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Sep 28 12:02:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:11.960662 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c450f3-d5b2-496f-8236-c597e0c8add9 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:12.062526 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952088d-4a2f-42fe-ba8e-e313b3e0628b None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:12.068128 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c450f3-d5b2-496f-8236-c597e0c8add9 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:12.103360 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf19ce-1681-4ba5-8903-324e81966972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:12.104340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf19ce-1681-4ba5-8903-324e81966972 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:12.104889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf19ce-1681-4ba5-8903-324e81966972 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:12.105364 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf19ce-1681-4ba5-8903-324e81966972 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:12.129633 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:12.205139 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf19ce-1681-4ba5-8903-324e81966972 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:12.213181 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf19ce-1681-4ba5-8903-324e81966972 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:12.296358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:12.301794 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952088d-4a2f-42fe-ba8e-e313b3e0628b None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:12.346745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 353/701] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:02:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:02:12.347827 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd502f16-3a64-4193-88f4-bc7ff9e47e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:12.348763 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd502f16-3a64-4193-88f4-bc7ff9e47e8e None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:12.348932 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc746a-5eae-456e-b92b-6c7eb0779ecb None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:12.349347 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd502f16-3a64-4193-88f4-bc7ff9e47e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:12.349459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc746a-5eae-456e-b92b-6c7eb0779ecb None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:12.349638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc746a-5eae-456e-b92b-6c7eb0779ecb None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:12.350115 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd502f16-3a64-4193-88f4-bc7ff9e47e8e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:12.350902 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd502f16-3a64-4193-88f4-bc7ff9e47e8e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:12.355887 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 354/702] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:12.355887 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060edc6f-32c9-41fd-80cb-b3d67b6d857f None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:12.355887 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060edc6f-32c9-41fd-80cb-b3d67b6d857f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:12.355887 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060edc6f-32c9-41fd-80cb-b3d67b6d857f None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:12.355887 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 355/703] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:12.355887 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060edc6f-32c9-41fd-80cb-b3d67b6d857f None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:12.358129 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd502f16-3a64-4193-88f4-bc7ff9e47e8e None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:12.374087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-dd502f16-3a64-4193-88f4-bc7ff9e47e8e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 28 12:02:12.374087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:12.374087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:02:12.374087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:02:12.374087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:02:12.374087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:02:12.374087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:02:12.374087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:12.374087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 28 12:02:12.374087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:12.374087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:02:12.374087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:12.374087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:12.374087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:12.374087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:12.374087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:12.374087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:12.375310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:12.375310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:12.375310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:12.375310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:12.375310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:12.375310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:12.375310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:02:12.375310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:02:12.375310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:02:12.375310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:02:12.375310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:12.375310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:12.375310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:12.375310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:12.375310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:12.375310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:12.376516 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:12.376516 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:12.376516 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:12.376516 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:12.376516 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:12.376516 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:12.376516 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:12.376516 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:12.376516 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:12.376516 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:12.376516 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:02:12.376516 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:12.376516 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 28 12:02:12.376516 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:12.376516 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 349/704] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Sep 28 12:02:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:12.377329 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860d5b6-401c-44c9-aba4-3ae57e71059b None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:12.377329 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860d5b6-401c-44c9-aba4-3ae57e71059b None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:12.377457 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860d5b6-401c-44c9-aba4-3ae57e71059b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:12.393385 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:12.396186 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-4860d5b6-401c-44c9-aba4-3ae57e71059b None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:12.397405 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-4860d5b6-401c-44c9-aba4-3ae57e71059b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:12.471006 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060edc6f-32c9-41fd-80cb-b3d67b6d857f None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:12.479772 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 350/705] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:02:12.481490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a7897-ae9d-4a15-aca0-c27618c59910 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:12.481778 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a7897-ae9d-4a15-aca0-c27618c59910 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:12.482058 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a7897-ae9d-4a15-aca0-c27618c59910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:12.501558 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-261a7897-ae9d-4a15-aca0-c27618c59910 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:12.503064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-261a7897-ae9d-4a15-aca0-c27618c59910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:12.510931 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25019da0-f930-46bb-8306-47ec1a814715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:12.511884 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25019da0-f930-46bb-8306-47ec1a814715 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:12.512428 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25019da0-f930-46bb-8306-47ec1a814715 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:12.512924 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25019da0-f930-46bb-8306-47ec1a814715 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:12.523649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25019da0-f930-46bb-8306-47ec1a814715 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:12.525361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25019da0-f930-46bb-8306-47ec1a814715 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:12.541116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-25019da0-f930-46bb-8306-47ec1a814715 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:12.541116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:12.541116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:12.541116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:12.541116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:12.541116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:12.541116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:12.541116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:12.541116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:12.541116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:12.541116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:12.541116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:12.541116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:12.541116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:12.541116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:12.541116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:12.542093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:12.542093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:12.542093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:12.542093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:12.542093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:12.542093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:12.542093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:12.542093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:12.542093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:12.542093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:12.542093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:12.542093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:12.542093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:12.542093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:12.542093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:12.542093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:12.542093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:12.542998 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:12.542998 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:12.542998 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:12.549379 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 356/706] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:12.551063 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25019da0-f930-46bb-8306-47ec1a814715 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:12.583839 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 351/707] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:02:12.584731 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a7897-ae9d-4a15-aca0-c27618c59910 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:12.627836 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:12.654467 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25019da0-f930-46bb-8306-47ec1a814715 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:12.679812 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:12.692046 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec08780-c80f-4a9c-813f-c79f68387dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:12.692949 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec08780-c80f-4a9c-813f-c79f68387dce None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:12.693451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec08780-c80f-4a9c-813f-c79f68387dce None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:12.693916 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec08780-c80f-4a9c-813f-c79f68387dce None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:12.694737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec08780-c80f-4a9c-813f-c79f68387dce None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:12.695233 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec08780-c80f-4a9c-813f-c79f68387dce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:12.697170 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec08780-c80f-4a9c-813f-c79f68387dce None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:12.702306 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 357/708] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Sep 28 12:02:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:12.709570 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec08780-c80f-4a9c-813f-c79f68387dce None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:12.770114 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a7897-ae9d-4a15-aca0-c27618c59910 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:12.813979 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3058f64-daf6-49a9-b3eb-6aa01ecce9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:12.814930 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3058f64-daf6-49a9-b3eb-6aa01ecce9d3 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:12.815400 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3058f64-daf6-49a9-b3eb-6aa01ecce9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:12.816388 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3058f64-daf6-49a9-b3eb-6aa01ecce9d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:12.817631 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3058f64-daf6-49a9-b3eb-6aa01ecce9d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:12.818123 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3058f64-daf6-49a9-b3eb-6aa01ecce9d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:12.820269 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3058f64-daf6-49a9-b3eb-6aa01ecce9d3 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:12.836617 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 352/709] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:12.841112 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3058f64-daf6-49a9-b3eb-6aa01ecce9d3 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:12.846972 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec08780-c80f-4a9c-813f-c79f68387dce None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:12.887792 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23b667-c273-4265-b4d5-94144f63fefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:12.888399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23b667-c273-4265-b4d5-94144f63fefa None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:12.888677 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23b667-c273-4265-b4d5-94144f63fefa None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:12.888989 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23b667-c273-4265-b4d5-94144f63fefa None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:12.889630 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23b667-c273-4265-b4d5-94144f63fefa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:12.890189 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23b667-c273-4265-b4d5-94144f63fefa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:12.892483 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23b667-c273-4265-b4d5-94144f63fefa None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:12.900820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 358/710] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Sep 28 12:02:12 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:12.901864 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23b667-c273-4265-b4d5-94144f63fefa None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:12.928982 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:12.976978 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:12.997897 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3058f64-daf6-49a9-b3eb-6aa01ecce9d3 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:13.051913 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6544d-e024-4fb7-8b93-f458a47e465b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:13.053380 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6544d-e024-4fb7-8b93-f458a47e465b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:13.053874 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6544d-e024-4fb7-8b93-f458a47e465b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:13.054141 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23b667-c273-4265-b4d5-94144f63fefa None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:13.054639 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6544d-e024-4fb7-8b93-f458a47e465b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:13.067185 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6544d-e024-4fb7-8b93-f458a47e465b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:13.069308 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6544d-e024-4fb7-8b93-f458a47e465b None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:13.086822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-ffe6544d-e024-4fb7-8b93-f458a47e465b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:13.086822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:13.086822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:13.086822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:13.086822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:13.086822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:13.086822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:13.086822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:13.086822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:13.086822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:13.086822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:13.086822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:13.086822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:13.086822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:13.086822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:13.086822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:13.087971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:13.087971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:13.087971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:13.087971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:13.087971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:13.087971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:13.087971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:13.087971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:13.087971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:13.087971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:13.087971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:13.087971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:13.087971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:13.087971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:13.087971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:13.087971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:13.087971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:13.089109 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:13.089109 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:13.089109 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:13.095595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 353/711] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:13.096724 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6544d-e024-4fb7-8b93-f458a47e465b None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:13.098753 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a7197-f2f8-4f68-b2b0-b05566d99c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:13.099395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a7197-f2f8-4f68-b2b0-b05566d99c1f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:13.099703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a7197-f2f8-4f68-b2b0-b05566d99c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:13.099978 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a7197-f2f8-4f68-b2b0-b05566d99c1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:13.108425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a7197-f2f8-4f68-b2b0-b05566d99c1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:13.110300 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a7197-f2f8-4f68-b2b0-b05566d99c1f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:13.124434 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-b71a7197-f2f8-4f68-b2b0-b05566d99c1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:13.124434 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:13.124434 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:13.124434 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:13.124434 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:13.124434 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:13.124434 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:13.124434 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:13.124434 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:13.124434 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:13.124434 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:13.124434 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:13.124434 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:02:13.124434 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:02:13.124434 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:02:13.125535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:02:13.125535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:13.125535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:13.125535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:13.125535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:13.125535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:13.125535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:13.125535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:13.125535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:13.125535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:13.125535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:13.125535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:13.125535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:13.125535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:13.125535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:13.125535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:13.125535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:13.126457 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:02:13.126457 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:02:13.126457 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:02:13.126457 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:02:13.126457 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:02:13.126457 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:02:13.126457 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:13.126457 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:13.129084 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 359/712] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:13.129904 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a7197-f2f8-4f68-b2b0-b05566d99c1f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:13.219384 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6544d-e024-4fb7-8b93-f458a47e465b None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:13.221996 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:13.267932 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a7197-f2f8-4f68-b2b0-b05566d99c1f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:13.268672 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a5bf0-d262-47db-b8cb-9a84956967a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:13.269875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a5bf0-d262-47db-b8cb-9a84956967a0 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:13.270145 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a5bf0-d262-47db-b8cb-9a84956967a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:13.270417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a5bf0-d262-47db-b8cb-9a84956967a0 None admin] PATH_INFO: `/v3/services/network` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:13.271006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a5bf0-d262-47db-b8cb-9a84956967a0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:13.272446 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a5bf0-d262-47db-b8cb-9a84956967a0 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:13.275995 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:13.283404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-813a5bf0-d262-47db-b8cb-9a84956967a0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 28 12:02:13.283404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:13.283404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:02:13.283404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:02:13.283404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:02:13.283404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:02:13.283404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:02:13.283404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:13.283404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 28 12:02:13.283404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:13.283404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:02:13.283404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:13.283404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:13.283404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:13.283404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:13.283404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:13.283404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:13.284484 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:13.284484 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:13.284484 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:13.284484 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:13.284484 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:13.284484 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:13.284484 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:02:13.284484 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:02:13.284484 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:02:13.284484 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:02:13.284484 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:13.284484 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:13.284484 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:13.284484 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:13.284484 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:13.284484 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:13.285387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:13.285387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:13.285387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:13.285387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:13.285387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:13.285387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:13.285387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:13.285387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:13.285387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:13.285387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:13.285387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:02:13.285387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:13.285387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 28 12:02:13.285387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:13.285387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 354/713] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:13 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:13.286254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a5bf0-d262-47db-b8cb-9a84956967a0 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:13.313406 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78ce8c-9d72-487c-9205-e832b9eac958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:13.314260 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78ce8c-9d72-487c-9205-e832b9eac958 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:13.314537 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78ce8c-9d72-487c-9205-e832b9eac958 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:13.314811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78ce8c-9d72-487c-9205-e832b9eac958 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:13.315601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78ce8c-9d72-487c-9205-e832b9eac958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:13.316504 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78ce8c-9d72-487c-9205-e832b9eac958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:13.317927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78ce8c-9d72-487c-9205-e832b9eac958 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:13.333331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 360/714] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:13.334373 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78ce8c-9d72-487c-9205-e832b9eac958 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:13.398993 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a5bf0-d262-47db-b8cb-9a84956967a0 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:13.438914 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e5c9c-c395-4bc9-a9b2-5ae992d117c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:13.439583 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e5c9c-c395-4bc9-a9b2-5ae992d117c6 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:13.439868 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e5c9c-c395-4bc9-a9b2-5ae992d117c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:13.440140 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e5c9c-c395-4bc9-a9b2-5ae992d117c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:13.440922 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e5c9c-c395-4bc9-a9b2-5ae992d117c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:13.441231 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e5c9c-c395-4bc9-a9b2-5ae992d117c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:13.442745 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e5c9c-c395-4bc9-a9b2-5ae992d117c6 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:13.456058 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 355/715] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:02:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:13.457393 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e5c9c-c395-4bc9-a9b2-5ae992d117c6 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:13.464198 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78ce8c-9d72-487c-9205-e832b9eac958 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:13.495494 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:13.506023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac640fba-e2e0-4602-94a6-1e2ea52262ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:13.507116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac640fba-e2e0-4602-94a6-1e2ea52262ff None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:13.507572 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac640fba-e2e0-4602-94a6-1e2ea52262ff None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:13.508113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac640fba-e2e0-4602-94a6-1e2ea52262ff None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:13.508992 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac640fba-e2e0-4602-94a6-1e2ea52262ff None admin] RBAC: Adding query filter params (name=network) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:13.509438 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac640fba-e2e0-4602-94a6-1e2ea52262ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:13.510931 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac640fba-e2e0-4602-94a6-1e2ea52262ff None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:13.517033 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 361/716] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 28 12:02:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:13.518313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:13.520224 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac640fba-e2e0-4602-94a6-1e2ea52262ff None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:13.564149 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e5c9c-c395-4bc9-a9b2-5ae992d117c6 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:13.600782 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bd7b5-b12d-4cba-8a8f-a42a7c7d990a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:13.601359 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bd7b5-b12d-4cba-8a8f-a42a7c7d990a None admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:13.601637 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bd7b5-b12d-4cba-8a8f-a42a7c7d990a None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:13.601909 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bd7b5-b12d-4cba-8a8f-a42a7c7d990a None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:13.602552 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11bd7b5-b12d-4cba-8a8f-a42a7c7d990a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:13.604042 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11bd7b5-b12d-4cba-8a8f-a42a7c7d990a None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:13.631829 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 356/717] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 28 12:02:13 2022] POST /identity/v3/users => generated 254 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:02:13.632923 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bd7b5-b12d-4cba-8a8f-a42a7c7d990a None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:13.650004 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac640fba-e2e0-4602-94a6-1e2ea52262ff None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:13.725502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa95812-6ee6-45a4-9082-ae33da3e6266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:13.726225 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa95812-6ee6-45a4-9082-ae33da3e6266 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:13.726504 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa95812-6ee6-45a4-9082-ae33da3e6266 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:13.726768 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa95812-6ee6-45a4-9082-ae33da3e6266 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:13.727527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa95812-6ee6-45a4-9082-ae33da3e6266 None admin] RBAC: Adding query filter params (role.id=66456d39fc0c496c8f290a436b726216, scope.project.id=c854d366f35145e8b2fadb9b014d0199, user.id=0e81804e04514ae882a1fd93789db025) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:13.727835 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa95812-6ee6-45a4-9082-ae33da3e6266 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:13.731587 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa95812-6ee6-45a4-9082-ae33da3e6266 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:13.742305 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 362/718] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:02:13 2022] GET /identity/v3/role_assignments?user.id=0e81804e04514ae882a1fd93789db025&scope.project.id=c854d366f35145e8b2fadb9b014d0199&role.id=66456d39fc0c496c8f290a436b726216 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:13.763228 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bd7b5-b12d-4cba-8a8f-a42a7c7d990a None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:13.769786 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e7b97-7ed2-4b93-97dc-d9e3836b7065 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:13.770185 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e7b97-7ed2-4b93-97dc-d9e3836b7065 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:13.770401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e7b97-7ed2-4b93-97dc-d9e3836b7065 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:13.771934 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 363/719] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:02:13.778582 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e0fc2-f8e7-4435-bd34-92f9519999d5 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:13.778896 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e0fc2-f8e7-4435-bd34-92f9519999d5 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:13.779232 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e0fc2-f8e7-4435-bd34-92f9519999d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:13.787838 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:13.812671 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecec60-fee2-4aea-8bf2-92e4ffa6e17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:13.813326 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecec60-fee2-4aea-8bf2-92e4ffa6e17b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:13.813606 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecec60-fee2-4aea-8bf2-92e4ffa6e17b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:13.813882 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecec60-fee2-4aea-8bf2-92e4ffa6e17b None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:13.814617 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ecec60-fee2-4aea-8bf2-92e4ffa6e17b None admin] RBAC: Adding query filter params (type=network) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:13.814858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ecec60-fee2-4aea-8bf2-92e4ffa6e17b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:13.816982 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ecec60-fee2-4aea-8bf2-92e4ffa6e17b None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:13.821995 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-cd5e0fc2-f8e7-4435-bd34-92f9519999d5 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:13.823321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-cd5e0fc2-f8e7-4435-bd34-92f9519999d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:13.836917 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 357/720] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 28 12:02:13 2022] GET /identity/v3/services?type=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:13.908985 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:13.934135 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 364/721] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:02:14.219791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecec60-fee2-4aea-8bf2-92e4ffa6e17b None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:14.335118 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecec60-fee2-4aea-8bf2-92e4ffa6e17b None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:14.371353 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292ef42-a8fb-4c70-85a5-1b5ccda404a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:14.372052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292ef42-a8fb-4c70-85a5-1b5ccda404a2 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:14.372329 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292ef42-a8fb-4c70-85a5-1b5ccda404a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:14.372601 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292ef42-a8fb-4c70-85a5-1b5ccda404a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:14.383866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292ef42-a8fb-4c70-85a5-1b5ccda404a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:02:14.389208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-2292ef42-a8fb-4c70-85a5-1b5ccda404a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:02:14.389208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:14.389208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:14.389208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:14.389208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:14.389208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:14.389208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:14.389208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:14.389208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:14.389208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:14.389208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:14.389208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:14.389208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:02:14.389208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:02:14.389208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:02:14.389208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:02:14.390229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:02:14.390229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:02:14.390229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:02:14.390229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:02:14.390229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:14.390229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:14.390229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:14.390229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:14.390229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:14.390229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:14.390229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:14.390229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:14.390229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:14.390229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:14.390229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:14.390229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:14.391088 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:14.391088 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:14.391088 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:14.391088 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:14.391088 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:02:14.391088 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:02:14.391088 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:02:14.391088 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:02:14.391088 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:02:14.391088 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:02:14.391088 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:02:14.391088 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:14.391088 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 358/722] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:02:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:14.396861 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e0fc2-f8e7-4435-bd34-92f9519999d5 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:14.529940 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e0fc2-f8e7-4435-bd34-92f9519999d5 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:14.570664 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51b451-5759-480f-a682-63d27658add0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:14.571284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51b451-5759-480f-a682-63d27658add0 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:14.571617 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51b451-5759-480f-a682-63d27658add0 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:14.571894 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51b451-5759-480f-a682-63d27658add0 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:14.572562 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e51b451-5759-480f-a682-63d27658add0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:14.572863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e51b451-5759-480f-a682-63d27658add0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:14.574226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e51b451-5759-480f-a682-63d27658add0 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:14.587934 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 365/723] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:02:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:14.593895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292ef42-a8fb-4c70-85a5-1b5ccda404a2 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:14.656311 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:14.717265 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292ef42-a8fb-4c70-85a5-1b5ccda404a2 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:14.759303 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3366c-0763-4259-b719-98f764161272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:14.759980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3366c-0763-4259-b719-98f764161272 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:14.760258 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3366c-0763-4259-b719-98f764161272 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:14.760530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3366c-0763-4259-b719-98f764161272 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:14.771967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3366c-0763-4259-b719-98f764161272 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:14.773497 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3366c-0763-4259-b719-98f764161272 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:14.788975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-9cd3366c-0763-4259-b719-98f764161272 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:14.788975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:14.788975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:14.788975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:14.788975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:14.788975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:14.788975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:14.788975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:14.788975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:14.788975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:14.788975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:14.788975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:14.788975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:14.788975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:14.788975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:14.788975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:14.789968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:14.789968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:14.789968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:14.789968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:14.789968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:14.789968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:14.789968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:14.789968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:14.789968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:14.789968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:14.789968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:14.789968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:14.789968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:14.789968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:14.789968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:14.789968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:14.789968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:14.790985 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:14.790985 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:14.790985 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:14.790985 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 359/724] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:14.795658 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51b451-5759-480f-a682-63d27658add0 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:14.870362 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:14.938736 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51b451-5759-480f-a682-63d27658add0 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:14.978326 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58330e3-c518-4466-a70d-74be3fa105f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:14.978934 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58330e3-c518-4466-a70d-74be3fa105f4 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:14.979213 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58330e3-c518-4466-a70d-74be3fa105f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:14.979505 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58330e3-c518-4466-a70d-74be3fa105f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:14.980150 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58330e3-c518-4466-a70d-74be3fa105f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:14.980453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58330e3-c518-4466-a70d-74be3fa105f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:14.981875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58330e3-c518-4466-a70d-74be3fa105f4 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:14.994857 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 366/725] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:14.999941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3366c-0763-4259-b719-98f764161272 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:15.117276 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:15.127451 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3366c-0763-4259-b719-98f764161272 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:15.174893 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305031b-32f6-4a59-a04c-fd9b96424f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:15.176175 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305031b-32f6-4a59-a04c-fd9b96424f33 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:15.176458 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305031b-32f6-4a59-a04c-fd9b96424f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:15.176730 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305031b-32f6-4a59-a04c-fd9b96424f33 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:15.185093 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305031b-32f6-4a59-a04c-fd9b96424f33 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:15.186555 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305031b-32f6-4a59-a04c-fd9b96424f33 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:15.210332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-c305031b-32f6-4a59-a04c-fd9b96424f33 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 28 12:02:15.210332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:15.210332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:15.210332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:15.210332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:15.210332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:15.210332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:15.210332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:15.210332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:15.210332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:15.210332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:15.210332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:15.210332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:02:15.210332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:02:15.210332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:02:15.210332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:02:15.212630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:15.212630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:15.212630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:02:15.212630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:15.212630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:02:15.212630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:15.212630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:15.212630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:15.212630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:15.212630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:15.212630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:15.212630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:15.212630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:15.212630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:15.212630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:15.212630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:15.212630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:15.212630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:15.214911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:15.214911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:15.214911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:02:15.214911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:02:15.214911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:02:15.214911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:02:15.214911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:02:15.214911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:02:15.214911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 28 12:02:15.214911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:15.214911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 360/726] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:02:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:15.219485 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58330e3-c518-4466-a70d-74be3fa105f4 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:15.362406 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58330e3-c518-4466-a70d-74be3fa105f4 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:15.377593 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:15.416186 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abb57b-32fe-42d8-a6f4-15de6b440cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:15.416813 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abb57b-32fe-42d8-a6f4-15de6b440cdf None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:15.417095 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abb57b-32fe-42d8-a6f4-15de6b440cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:15.417370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abb57b-32fe-42d8-a6f4-15de6b440cdf None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:15.418118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45abb57b-32fe-42d8-a6f4-15de6b440cdf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:15.418426 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45abb57b-32fe-42d8-a6f4-15de6b440cdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:15.419889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45abb57b-32fe-42d8-a6f4-15de6b440cdf None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:15.438261 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 367/727] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Sep 28 12:02:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:15.444328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305031b-32f6-4a59-a04c-fd9b96424f33 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:15.558017 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305031b-32f6-4a59-a04c-fd9b96424f33 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:15.575090 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd4df4-2e43-4439-a792-47363a6a150a None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:15.575714 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd4df4-2e43-4439-a792-47363a6a150a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:15.575714 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd4df4-2e43-4439-a792-47363a6a150a None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:15.577227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 368/728] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:15.585188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da146fa3-95ac-4ffc-9d8b-242ff329d090 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:15.585188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da146fa3-95ac-4ffc-9d8b-242ff329d090 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:15.585188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da146fa3-95ac-4ffc-9d8b-242ff329d090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:15.600571 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f07f3-1b0c-4f1b-85f6-bc547f83fba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:15.601180 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f07f3-1b0c-4f1b-85f6-bc547f83fba5 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:15.601459 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f07f3-1b0c-4f1b-85f6-bc547f83fba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:15.603820 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f07f3-1b0c-4f1b-85f6-bc547f83fba5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:15.612566 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-da146fa3-95ac-4ffc-9d8b-242ff329d090 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:15.614310 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-da146fa3-95ac-4ffc-9d8b-242ff329d090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:15.652015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:15.691994 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 369/729] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:02:15.735479 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f07f3-1b0c-4f1b-85f6-bc547f83fba5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:15.736883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f07f3-1b0c-4f1b-85f6-bc547f83fba5 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:15.843624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 361/730] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:02:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:02:15.852682 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da146fa3-95ac-4ffc-9d8b-242ff329d090 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:15.974367 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:15.982670 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da146fa3-95ac-4ffc-9d8b-242ff329d090 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:16.031545 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a2e06-b968-4577-8409-42b842f174f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:16.032199 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a2e06-b968-4577-8409-42b842f174f4 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:16.032477 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a2e06-b968-4577-8409-42b842f174f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:16.032772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a2e06-b968-4577-8409-42b842f174f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:16.036840 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f07f3-1b0c-4f1b-85f6-bc547f83fba5 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:16.064097 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a2e06-b968-4577-8409-42b842f174f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:16.068055 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a2e06-b968-4577-8409-42b842f174f4 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:16.091510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-636a2e06-b968-4577-8409-42b842f174f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:16.091510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:16.091510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:16.091510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:16.091510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:16.091510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:16.091510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:16.091510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:16.091510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:16.091510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:16.091510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:16.091510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:16.091510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:16.091510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:16.091510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:16.091510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:16.092543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:16.092543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:16.092543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:16.092543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:16.092543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:16.092543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:16.092543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:16.092543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:16.092543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:16.092543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:16.092543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:16.092543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:16.092543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:16.092543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:16.092543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:16.092543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:16.092543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:16.093450 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:16.093450 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:16.093450 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:16.093450 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 370/731] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:16.099865 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a2e06-b968-4577-8409-42b842f174f4 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:16.105917 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:16.222644 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a2e06-b968-4577-8409-42b842f174f4 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:16.242128 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f07f3-1b0c-4f1b-85f6-bc547f83fba5 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:16.265956 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda2b5b-e65f-4c85-8e9c-f613791b7c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:16.266884 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda2b5b-e65f-4c85-8e9c-f613791b7c55 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:16.267346 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda2b5b-e65f-4c85-8e9c-f613791b7c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:16.267816 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda2b5b-e65f-4c85-8e9c-f613791b7c55 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:16.268630 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda2b5b-e65f-4c85-8e9c-f613791b7c55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:16.269196 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda2b5b-e65f-4c85-8e9c-f613791b7c55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:16.271654 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda2b5b-e65f-4c85-8e9c-f613791b7c55 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:16.296829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 371/732] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:16.302595 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda2b5b-e65f-4c85-8e9c-f613791b7c55 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:16.318476 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5233ba-d130-4660-9475-3ff0e2a81507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:16.319147 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5233ba-d130-4660-9475-3ff0e2a81507 None admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:16.319429 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5233ba-d130-4660-9475-3ff0e2a81507 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:16.319722 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5233ba-d130-4660-9475-3ff0e2a81507 None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:16.320391 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5233ba-d130-4660-9475-3ff0e2a81507 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:16.321784 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5233ba-d130-4660-9475-3ff0e2a81507 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:16.323576 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:16.353765 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 362/733] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 28 12:02:16 2022] POST /identity/v3/services => generated 251 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:02:16.355473 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301a20b-5fc7-4e47-b9cb-5df53943da87 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:16.355927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301a20b-5fc7-4e47-b9cb-5df53943da87 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:16.356389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301a20b-5fc7-4e47-b9cb-5df53943da87 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:16.357983 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 363/734] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:16.364734 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d11dec-4e19-441b-be57-d96a55093288 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:16.365336 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d11dec-4e19-441b-be57-d96a55093288 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:16.365793 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d11dec-4e19-441b-be57-d96a55093288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:16.387728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-81d11dec-4e19-441b-be57-d96a55093288 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:16.389380 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-81d11dec-4e19-441b-be57-d96a55093288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:16.511352 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda2b5b-e65f-4c85-8e9c-f613791b7c55 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:16.519213 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 364/735] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:02:16.519213 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513050e-880e-4905-86ea-0f63388a6659 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:16.519213 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513050e-880e-4905-86ea-0f63388a6659 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:16.519213 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513050e-880e-4905-86ea-0f63388a6659 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:16.523198 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 365/736] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:16.529487 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fa269-80f4-4291-b5e6-8608e941839b None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:16.529487 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fa269-80f4-4291-b5e6-8608e941839b None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:16.529487 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fa269-80f4-4291-b5e6-8608e941839b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:16.563788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-c82fa269-80f4-4291-b5e6-8608e941839b None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:16.568208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-c82fa269-80f4-4291-b5e6-8608e941839b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:16.583204 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7cfc4-8bcf-4509-bd30-371408aab527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:16.584484 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7cfc4-8bcf-4509-bd30-371408aab527 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:16.584942 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7cfc4-8bcf-4509-bd30-371408aab527 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:16.585389 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7cfc4-8bcf-4509-bd30-371408aab527 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:16.592955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7cfc4-8bcf-4509-bd30-371408aab527 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:16.595104 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7cfc4-8bcf-4509-bd30-371408aab527 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:16.608072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-f0f7cfc4-8bcf-4509-bd30-371408aab527 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:16.608072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:16.608072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:16.608072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:16.608072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:16.608072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:16.608072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:16.608072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:16.608072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:16.608072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:16.608072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:16.608072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:16.608072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:02:16.608072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:02:16.608072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:02:16.609086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:02:16.609086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:16.609086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:16.609086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:16.609086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:16.609086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:16.609086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:16.609086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:16.609086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:16.609086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:16.609086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:16.609086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:16.609086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:16.609086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:16.609086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:16.609086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:16.609086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:16.610010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:02:16.610010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:02:16.610010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:02:16.610010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:02:16.610010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:02:16.610010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:02:16.610010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:16.610010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:16.612230 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 372/737] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:16.617813 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7cfc4-8bcf-4509-bd30-371408aab527 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:16.626807 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:16.683207 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 366/738] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:02:16.701427 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:16.749601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7cfc4-8bcf-4509-bd30-371408aab527 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:16.797093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e1c3c-413c-41b2-9b2a-8dca804c7fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:16.797706 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e1c3c-413c-41b2-9b2a-8dca804c7fea None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:16.797985 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e1c3c-413c-41b2-9b2a-8dca804c7fea None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:16.798256 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e1c3c-413c-41b2-9b2a-8dca804c7fea None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:16.798950 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e1c3c-413c-41b2-9b2a-8dca804c7fea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:16.799257 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e1c3c-413c-41b2-9b2a-8dca804c7fea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:16.801258 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e1c3c-413c-41b2-9b2a-8dca804c7fea None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:16.815053 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 373/739] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:02:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:16.824548 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82fa269-80f4-4291-b5e6-8608e941839b None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:16.837544 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e1c3c-413c-41b2-9b2a-8dca804c7fea None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:16.951777 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82fa269-80f4-4291-b5e6-8608e941839b None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:17.015905 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e1c3c-413c-41b2-9b2a-8dca804c7fea None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:17.022063 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1faeb-fd97-4590-af1d-8059a71bb861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:17.022784 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1faeb-fd97-4590-af1d-8059a71bb861 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:17.023163 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1faeb-fd97-4590-af1d-8059a71bb861 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:17.023573 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1faeb-fd97-4590-af1d-8059a71bb861 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:17.024821 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1faeb-fd97-4590-af1d-8059a71bb861 None admin] RBAC: Adding query filter params (role.id=66456d39fc0c496c8f290a436b726216, scope.project.id=c854d366f35145e8b2fadb9b014d0199, user.id=822e394e80fd41adb54d330adaf65a68) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:17.025228 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1faeb-fd97-4590-af1d-8059a71bb861 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:17.027136 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1faeb-fd97-4590-af1d-8059a71bb861 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:17.035832 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 367/740] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:02:16 2022] GET /identity/v3/role_assignments?user.id=822e394e80fd41adb54d330adaf65a68&scope.project.id=c854d366f35145e8b2fadb9b014d0199&role.id=66456d39fc0c496c8f290a436b726216 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:17.037226 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3d2d4-0fdb-4443-9826-220c3460a329 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:17.037605 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3d2d4-0fdb-4443-9826-220c3460a329 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:17.038421 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3d2d4-0fdb-4443-9826-220c3460a329 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:17.040431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 368/741] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:17.041306 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3d2d4-0fdb-4443-9826-220c3460a329 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:17.049606 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:17.061292 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d444e8-66ee-4cc2-b5ba-f815bde00d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:17.062206 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d444e8-66ee-4cc2-b5ba-f815bde00d04 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:17.062658 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d444e8-66ee-4cc2-b5ba-f815bde00d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:17.063072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d444e8-66ee-4cc2-b5ba-f815bde00d04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:17.077329 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d444e8-66ee-4cc2-b5ba-f815bde00d04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:02:17.083331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-88d444e8-66ee-4cc2-b5ba-f815bde00d04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:02:17.083331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:17.083331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:17.083331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:17.083331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:17.083331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:17.083331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:17.083331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:17.083331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:17.083331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:17.083331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:17.083331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:17.083331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:02:17.083331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:02:17.083331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:02:17.083331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:02:17.084401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:02:17.084401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:02:17.084401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:02:17.084401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:02:17.084401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:17.084401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:17.084401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:17.084401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:17.084401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:17.084401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:17.084401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:17.084401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:17.084401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:17.084401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:17.084401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:17.084401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:17.085234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:17.085234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:17.085234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:17.085234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:17.085234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:02:17.085234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:02:17.085234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:02:17.085234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:02:17.085234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:02:17.085234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:02:17.085234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:02:17.085234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:17.090787 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 374/742] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:02:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:17.092479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742155dd-727e-4339-ac4e-10fc224d21de None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:17.092589 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:17.093061 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742155dd-727e-4339-ac4e-10fc224d21de None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:17.093527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742155dd-727e-4339-ac4e-10fc224d21de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:17.117848 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-742155dd-727e-4339-ac4e-10fc224d21de None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:17.119158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-742155dd-727e-4339-ac4e-10fc224d21de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:17.181483 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3d2d4-0fdb-4443-9826-220c3460a329 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:17.203791 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 375/743] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:02:17.204927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742155dd-727e-4339-ac4e-10fc224d21de None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:17.221023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927fac4-f67e-4ffa-8335-0400abeb148c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:17.221996 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927fac4-f67e-4ffa-8335-0400abeb148c None admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:17.222442 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927fac4-f67e-4ffa-8335-0400abeb148c None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:17.222877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927fac4-f67e-4ffa-8335-0400abeb148c None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:17.223734 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927fac4-f67e-4ffa-8335-0400abeb148c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:17.225269 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927fac4-f67e-4ffa-8335-0400abeb148c None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:17.241798 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 369/744] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 28 12:02:17 2022] POST /identity/v3/services => generated 240 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:02:17.402128 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742155dd-727e-4339-ac4e-10fc224d21de None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:17.434429 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:17.472600 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155d602-d264-4d1d-880e-b288d1a8a7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:17.473211 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155d602-d264-4d1d-880e-b288d1a8a7c6 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:17.473486 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155d602-d264-4d1d-880e-b288d1a8a7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:17.473763 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155d602-d264-4d1d-880e-b288d1a8a7c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:17.474429 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155d602-d264-4d1d-880e-b288d1a8a7c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:17.474734 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155d602-d264-4d1d-880e-b288d1a8a7c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:17.476876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155d602-d264-4d1d-880e-b288d1a8a7c6 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:17.489068 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 376/745] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:02:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:17.494888 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927fac4-f67e-4ffa-8335-0400abeb148c None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:17.582933 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155d602-d264-4d1d-880e-b288d1a8a7c6 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:17.604717 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:17.616824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927fac4-f67e-4ffa-8335-0400abeb148c None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:17.660609 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050fb36d-6498-4a3f-be7a-0211019faad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:17.661231 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fb36d-6498-4a3f-be7a-0211019faad0 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:17.661459 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fb36d-6498-4a3f-be7a-0211019faad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:17.661701 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fb36d-6498-4a3f-be7a-0211019faad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:17.674940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050fb36d-6498-4a3f-be7a-0211019faad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:17.677873 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050fb36d-6498-4a3f-be7a-0211019faad0 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:17.697489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-050fb36d-6498-4a3f-be7a-0211019faad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:17.697489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:17.697489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:17.697489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:17.697489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:17.697489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:17.697489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:17.697489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:17.697489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:17.697489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:17.697489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:17.697489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:17.697489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:17.697489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:17.697489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:17.697489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:17.698489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:17.698489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:17.698489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:17.698489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:17.698489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:17.698489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:17.698489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:17.698489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:17.698489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:17.698489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:17.698489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:17.698489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:17.698489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:17.698489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:17.698489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:17.698489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:17.698489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:17.699400 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:17.699400 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:17.699400 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:17.699400 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 370/746] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:17.705673 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050fb36d-6498-4a3f-be7a-0211019faad0 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:17.725539 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155d602-d264-4d1d-880e-b288d1a8a7c6 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:17.799283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1e158-8d30-4dc8-b0a3-a0a56c48f1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:17.800308 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1e158-8d30-4dc8-b0a3-a0a56c48f1ad None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:17.800930 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1e158-8d30-4dc8-b0a3-a0a56c48f1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:17.801436 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1e158-8d30-4dc8-b0a3-a0a56c48f1ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:17.823562 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1e158-8d30-4dc8-b0a3-a0a56c48f1ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:02:17.832922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-d4d1e158-8d30-4dc8-b0a3-a0a56c48f1ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:02:17.832922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:17.832922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:17.832922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:17.832922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:17.832922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:17.832922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:17.832922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:17.832922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:17.832922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:17.832922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:17.832922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:17.832922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:02:17.832922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:02:17.832922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:02:17.832922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:02:17.833889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:02:17.833889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:02:17.833889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:02:17.833889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:02:17.833889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:17.833889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:17.833889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:17.833889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:17.833889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:17.833889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:17.833889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:17.833889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:17.833889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:17.833889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:17.833889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:17.833889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:17.834735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:17.834735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:17.834735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:17.834735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:17.834735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:02:17.834735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:02:17.834735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:02:17.834735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:02:17.834735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:02:17.834735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:02:17.834735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:02:17.834735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:17.838017 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 377/747] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 28 12:02:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:17.843809 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1e158-8d30-4dc8-b0a3-a0a56c48f1ad None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:17.899304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050fb36d-6498-4a3f-be7a-0211019faad0 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:17.903794 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:17.975729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1e158-8d30-4dc8-b0a3-a0a56c48f1ad None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:17.977060 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff6205-0644-4e31-91b8-a950898c374f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:17.977678 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff6205-0644-4e31-91b8-a950898c374f None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:17.978091 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff6205-0644-4e31-91b8-a950898c374f None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:17.978323 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff6205-0644-4e31-91b8-a950898c374f None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:17.978982 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff6205-0644-4e31-91b8-a950898c374f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:17.979284 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff6205-0644-4e31-91b8-a950898c374f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:17.980816 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff6205-0644-4e31-91b8-a950898c374f None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:18.010588 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 371/748] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:18.015040 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90864b13-fa4e-4ec8-ae5c-dfe75f5ba916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:18.015941 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90864b13-fa4e-4ec8-ae5c-dfe75f5ba916 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:18.016417 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90864b13-fa4e-4ec8-ae5c-dfe75f5ba916 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:18.016614 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff6205-0644-4e31-91b8-a950898c374f None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:18.017085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90864b13-fa4e-4ec8-ae5c-dfe75f5ba916 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:18.017946 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90864b13-fa4e-4ec8-ae5c-dfe75f5ba916 None admin] RBAC: Adding query filter params (name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:18.018439 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90864b13-fa4e-4ec8-ae5c-dfe75f5ba916 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:18.020666 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90864b13-fa4e-4ec8-ae5c-dfe75f5ba916 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:18.029477 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:18.031950 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 378/749] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 28 12:02:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:18.042853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90864b13-fa4e-4ec8-ae5c-dfe75f5ba916 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:18.219141 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff6205-0644-4e31-91b8-a950898c374f None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:18.287545 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b55cd-bf70-461c-8c57-a7c49f7cbd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:18.288184 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b55cd-bf70-461c-8c57-a7c49f7cbd8b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:18.288464 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b55cd-bf70-461c-8c57-a7c49f7cbd8b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:18.288731 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b55cd-bf70-461c-8c57-a7c49f7cbd8b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:18.302178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b55cd-bf70-461c-8c57-a7c49f7cbd8b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:18.303658 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b55cd-bf70-461c-8c57-a7c49f7cbd8b None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:18.322733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-742b55cd-bf70-461c-8c57-a7c49f7cbd8b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:02:18.322733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:18.322733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:18.322733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:18.322733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:18.322733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:18.322733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:18.322733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:18.322733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:18.322733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:18.322733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:18.322733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:18.322733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:02:18.322733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:02:18.322733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:02:18.322733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:02:18.323758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:18.323758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:18.323758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:02:18.323758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:18.323758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:02:18.323758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:18.323758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:18.323758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:18.323758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:18.323758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:18.323758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:18.323758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:18.323758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:18.323758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:18.323758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:18.323758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:18.323758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:18.323758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:18.324722 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:18.324722 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:18.324722 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:02:18.324722 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:02:18.324722 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:02:18.324722 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:02:18.324722 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:02:18.324722 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:02:18.324722 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:02:18.324722 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:18.325757 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 372/750] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Sep 28 12:02:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:18.330621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b55cd-bf70-461c-8c57-a7c49f7cbd8b None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:18.404614 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90864b13-fa4e-4ec8-ae5c-dfe75f5ba916 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:18.420054 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:18.445588 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:18.476396 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a38674-adb5-47b1-92b6-3f86b83d9fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:18.477042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a38674-adb5-47b1-92b6-3f86b83d9fad None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:18.477319 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a38674-adb5-47b1-92b6-3f86b83d9fad None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:18.477590 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a38674-adb5-47b1-92b6-3f86b83d9fad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:18.496708 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a38674-adb5-47b1-92b6-3f86b83d9fad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:18.498372 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a38674-adb5-47b1-92b6-3f86b83d9fad None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:18.520283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-19a38674-adb5-47b1-92b6-3f86b83d9fad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:18.520283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:18.520283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:18.520283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:18.520283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:18.520283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:18.520283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:18.520283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:18.520283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:18.520283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:18.520283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:18.520283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:18.520283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:18.520283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:18.520283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:18.520283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:18.521271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:18.521271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:18.521271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:18.521271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:18.521271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:18.521271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:18.521271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:18.521271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:18.521271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:18.521271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:18.521271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:18.521271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:18.521271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:18.521271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:18.521271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:18.521271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:18.521271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:18.522165 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:18.522165 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:18.522165 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:18.523567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b55cd-bf70-461c-8c57-a7c49f7cbd8b None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:18.525946 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 379/751] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 480 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:18.526765 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a38674-adb5-47b1-92b6-3f86b83d9fad None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:18.578503 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a641a88-d38a-4661-b3f0-162568dbdad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:18.579031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a641a88-d38a-4661-b3f0-162568dbdad7 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:18.579308 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a641a88-d38a-4661-b3f0-162568dbdad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:18.579609 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a641a88-d38a-4661-b3f0-162568dbdad7 None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:18.580342 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a641a88-d38a-4661-b3f0-162568dbdad7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:18.580645 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a641a88-d38a-4661-b3f0-162568dbdad7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:18.582626 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a641a88-d38a-4661-b3f0-162568dbdad7 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:18.601727 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 373/752] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Sep 28 12:02:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:18.608007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a641a88-d38a-4661-b3f0-162568dbdad7 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:18.730720 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a38674-adb5-47b1-92b6-3f86b83d9fad None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:18.773470 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a641a88-d38a-4661-b3f0-162568dbdad7 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:18.786500 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575c26e-bbbc-47f4-bc81-020b662cc4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:18.787125 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575c26e-bbbc-47f4-bc81-020b662cc4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:18.787403 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575c26e-bbbc-47f4-bc81-020b662cc4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:18.787704 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575c26e-bbbc-47f4-bc81-020b662cc4d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:18.788351 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575c26e-bbbc-47f4-bc81-020b662cc4d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:18.788655 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575c26e-bbbc-47f4-bc81-020b662cc4d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:18.790018 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575c26e-bbbc-47f4-bc81-020b662cc4d6 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:18.802840 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 380/753] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:18.808597 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575c26e-bbbc-47f4-bc81-020b662cc4d6 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:18.821667 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:18.823332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:18.845390 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac3c09-f0e0-458f-acd1-58ac81120bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:18.846046 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac3c09-f0e0-458f-acd1-58ac81120bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:18.846332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac3c09-f0e0-458f-acd1-58ac81120bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:18.846608 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac3c09-f0e0-458f-acd1-58ac81120bc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:18.869480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac3c09-f0e0-458f-acd1-58ac81120bc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:18.870991 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac3c09-f0e0-458f-acd1-58ac81120bc1 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:18.897373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-6fac3c09-f0e0-458f-acd1-58ac81120bc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:18.897373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:18.897373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:18.897373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:18.897373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:18.897373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:18.897373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:18.897373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:18.897373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:18.897373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:18.897373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:18.897373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:18.897373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:18.897373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:18.897373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:18.897373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:18.898373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:18.898373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:18.898373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:18.898373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:18.898373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:18.898373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:18.898373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:18.898373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:18.898373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:18.898373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:18.898373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:18.898373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:18.898373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:18.898373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:18.898373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:18.898373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:18.898373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:18.899287 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:18.899287 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:18.899287 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:18.907901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 374/754] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:18.909017 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac3c09-f0e0-458f-acd1-58ac81120bc1 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:18.917628 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575c26e-bbbc-47f4-bc81-020b662cc4d6 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:18.953481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed620119-1cb8-497b-b199-9d19bc60b646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:18.954218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed620119-1cb8-497b-b199-9d19bc60b646 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:18.954498 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed620119-1cb8-497b-b199-9d19bc60b646 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:18.954767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed620119-1cb8-497b-b199-9d19bc60b646 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:18.963212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed620119-1cb8-497b-b199-9d19bc60b646 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:18.964674 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed620119-1cb8-497b-b199-9d19bc60b646 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:18.976451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-ed620119-1cb8-497b-b199-9d19bc60b646 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 12:02:18.976451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:18.976451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:18.976451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:18.976451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:18.976451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:18.976451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:18.976451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:18.976451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:18.976451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:18.976451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:18.976451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:18.976451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:02:18.976451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:02:18.976451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:02:18.976451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:02:18.977416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:18.977416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:18.977416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:02:18.977416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:18.977416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:02:18.977416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:18.977416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:18.977416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:18.977416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:18.977416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:18.977416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:18.977416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:18.977416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:18.977416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:18.977416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:18.977416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:18.977416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:18.977416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:18.978365 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:18.978365 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:18.978365 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:02:18.978365 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:02:18.978365 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:02:18.978365 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:02:18.978365 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:02:18.978365 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:02:18.978365 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 12:02:18.978365 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:18.978365 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 381/755] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 28 12:02:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:18.983387 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed620119-1cb8-497b-b199-9d19bc60b646 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:19.063507 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:19.093919 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed620119-1cb8-497b-b199-9d19bc60b646 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:19.130514 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ed0bd-09f3-471f-ab5b-5ca3935962f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:19.131164 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ed0bd-09f3-471f-ab5b-5ca3935962f4 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:19.131463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ed0bd-09f3-471f-ab5b-5ca3935962f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:19.131731 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ed0bd-09f3-471f-ab5b-5ca3935962f4 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:19.132472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ed0bd-09f3-471f-ab5b-5ca3935962f4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:19.132775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ed0bd-09f3-471f-ab5b-5ca3935962f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:19.134271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ed0bd-09f3-471f-ab5b-5ca3935962f4 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:19.149535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac3c09-f0e0-458f-acd1-58ac81120bc1 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:19.156076 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 382/756] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Sep 28 12:02:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:19.157329 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441513ed-a6d5-484a-b41f-9c744fe27446 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:19.157609 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441513ed-a6d5-484a-b41f-9c744fe27446 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:19.157878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441513ed-a6d5-484a-b41f-9c744fe27446 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:19.160761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 383/757] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:19.167626 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441513ed-a6d5-484a-b41f-9c744fe27446 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:19.194752 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdd12c-6ddd-480b-a804-12de7b1db540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:19.195369 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdd12c-6ddd-480b-a804-12de7b1db540 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:19.195678 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdd12c-6ddd-480b-a804-12de7b1db540 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:19.195952 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdd12c-6ddd-480b-a804-12de7b1db540 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:19.196600 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fdd12c-6ddd-480b-a804-12de7b1db540 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:19.196904 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fdd12c-6ddd-480b-a804-12de7b1db540 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:19.198369 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fdd12c-6ddd-480b-a804-12de7b1db540 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:19.211881 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 375/758] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:19.213328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c0a9a-f6e7-43fb-9d42-12ef7e315892 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:19.213616 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c0a9a-f6e7-43fb-9d42-12ef7e315892 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:19.213887 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c0a9a-f6e7-43fb-9d42-12ef7e315892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:19.233833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-4a4c0a9a-f6e7-43fb-9d42-12ef7e315892 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:19.235211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-4a4c0a9a-f6e7-43fb-9d42-12ef7e315892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:19.266546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:19.279732 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441513ed-a6d5-484a-b41f-9c744fe27446 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:19.310417 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:19.319131 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 376/759] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:02:19.320285 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c0a9a-f6e7-43fb-9d42-12ef7e315892 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:19.328402 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0562f-566c-4350-8f67-fa3a180a0432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:19.329359 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0562f-566c-4350-8f67-fa3a180a0432 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:19.329742 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0562f-566c-4350-8f67-fa3a180a0432 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:19.330143 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0562f-566c-4350-8f67-fa3a180a0432 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:19.432990 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0562f-566c-4350-8f67-fa3a180a0432 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:19.434363 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0562f-566c-4350-8f67-fa3a180a0432 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:19.436169 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c0a9a-f6e7-43fb-9d42-12ef7e315892 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:19.473521 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18c0de-3e63-4e88-9e78-15b14ace7b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:19.474509 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18c0de-3e63-4e88-9e78-15b14ace7b74 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:19.474989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18c0de-3e63-4e88-9e78-15b14ace7b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:19.475516 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18c0de-3e63-4e88-9e78-15b14ace7b74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:19.483056 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18c0de-3e63-4e88-9e78-15b14ace7b74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:19.484882 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18c0de-3e63-4e88-9e78-15b14ace7b74 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:19.498735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-9b18c0de-3e63-4e88-9e78-15b14ace7b74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:19.498735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:19.498735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:19.498735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:19.498735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:19.498735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:19.498735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:19.498735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:19.498735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:19.498735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:19.498735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:19.498735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:19.498735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:02:19.498735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:02:19.498735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:02:19.499683 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:02:19.499683 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:19.499683 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:19.499683 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:19.499683 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:19.499683 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:19.499683 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:19.499683 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:19.499683 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:19.499683 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:19.499683 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:19.499683 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:19.499683 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:19.499683 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:19.499683 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:19.499683 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:19.499683 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:19.500581 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:02:19.500581 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:02:19.500581 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:02:19.500581 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:02:19.500581 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:02:19.500581 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:02:19.500581 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:19.500581 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:19.502576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 377/760] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:19.509909 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18c0de-3e63-4e88-9e78-15b14ace7b74 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:19.570218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 384/761] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:02:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:02:19.575833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:19.578239 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0562f-566c-4350-8f67-fa3a180a0432 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:19.626869 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:19.728493 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18c0de-3e63-4e88-9e78-15b14ace7b74 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:19.733897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0562f-566c-4350-8f67-fa3a180a0432 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:19.767862 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98df17-2507-4758-9c3c-dde8df40b874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:19.768467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98df17-2507-4758-9c3c-dde8df40b874 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:19.768782 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98df17-2507-4758-9c3c-dde8df40b874 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:19.769062 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98df17-2507-4758-9c3c-dde8df40b874 None admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:19.769786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98df17-2507-4758-9c3c-dde8df40b874 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:19.770097 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98df17-2507-4758-9c3c-dde8df40b874 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:19.771689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98df17-2507-4758-9c3c-dde8df40b874 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:19.775907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b9b83-ee20-4aa5-91db-684c0f283a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:19.776544 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b9b83-ee20-4aa5-91db-684c0f283a63 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:19.776824 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b9b83-ee20-4aa5-91db-684c0f283a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:19.777096 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b9b83-ee20-4aa5-91db-684c0f283a63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:19.784162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 378/762] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:02:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:19.785426 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101de82f-9384-4810-9ee3-162766ef0fc0 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:19.785713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101de82f-9384-4810-9ee3-162766ef0fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:19.785989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101de82f-9384-4810-9ee3-162766ef0fc0 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:19.791225 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 379/763] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:19.791225 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101de82f-9384-4810-9ee3-162766ef0fc0 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:19.794730 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b9b83-ee20-4aa5-91db-684c0f283a63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:19.796238 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b9b83-ee20-4aa5-91db-684c0f283a63 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:19.813085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-601b9b83-ee20-4aa5-91db-684c0f283a63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:19.813085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:19.813085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:19.813085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:19.813085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:19.813085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:19.813085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:19.813085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:19.813085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:19.813085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:19.813085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:19.813085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:19.813085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:19.813085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:19.813085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:19.813085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:19.814086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:19.814086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:19.814086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:19.814086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:19.814086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:19.814086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:19.814086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:19.814086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:19.814086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:19.814086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:19.814086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:19.814086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:19.814086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:19.814086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:19.814086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:19.814086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:19.814086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:19.815028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:19.815028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:19.815028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:19.815028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 385/764] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:19.815028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b9b83-ee20-4aa5-91db-684c0f283a63 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:19.881958 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:19.899893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:19.900786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101de82f-9384-4810-9ee3-162766ef0fc0 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:19.919107 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b9b83-ee20-4aa5-91db-684c0f283a63 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:19.933751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583fa48-c448-4133-8317-0c041b7b0ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:19.934381 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583fa48-c448-4133-8317-0c041b7b0ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:19.934660 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583fa48-c448-4133-8317-0c041b7b0ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:19.934930 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583fa48-c448-4133-8317-0c041b7b0ca3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:19.935536 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583fa48-c448-4133-8317-0c041b7b0ca3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:19.936907 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583fa48-c448-4133-8317-0c041b7b0ca3 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:19.945929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-a583fa48-c448-4133-8317-0c041b7b0ca3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 28 12:02:19.945929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:19.945929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:02:19.945929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:02:19.945929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:02:19.945929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:02:19.945929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:02:19.945929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:19.945929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 28 12:02:19.945929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:19.945929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:02:19.945929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:19.945929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:19.945929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:19.945929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:19.945929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:19.945929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:19.947106 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:19.947106 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:19.947106 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:19.947106 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:19.947106 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:19.947106 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:19.947106 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:02:19.947106 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:02:19.947106 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:02:19.947106 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:02:19.947106 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:19.947106 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:19.947106 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:19.947106 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:19.947106 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:19.947106 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:19.948007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:19.948007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:19.948007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:19.948007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:19.948007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:19.948007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:19.948007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:19.948007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:19.948007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:19.948007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:19.948007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:02:19.948007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:19.948007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 28 12:02:19.948007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:19.948007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 380/765] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Sep 28 12:02:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:19.948824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d489285-dcf9-408c-8d90-a4a7843f45cc None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:19.948824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d489285-dcf9-408c-8d90-a4a7843f45cc None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:19.949463 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d489285-dcf9-408c-8d90-a4a7843f45cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:19.954264 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc6f4b-587b-4972-84ed-c5ace21f3e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:19.954918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc6f4b-587b-4972-84ed-c5ace21f3e3d None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:19.955203 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc6f4b-587b-4972-84ed-c5ace21f3e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:19.955509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc6f4b-587b-4972-84ed-c5ace21f3e3d None admin] PATH_INFO: `/v3/projects/c854d366f35145e8b2fadb9b014d0199/users/0e81804e04514ae882a1fd93789db025/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:19.957505 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc6f4b-587b-4972-84ed-c5ace21f3e3d None admin] RBAC: Authorizing `identity:create_grant(project_id=c854d366f35145e8b2fadb9b014d0199, user_id=0e81804e04514ae882a1fd93789db025, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:19.958920 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc6f4b-587b-4972-84ed-c5ace21f3e3d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:19.966524 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-2d489285-dcf9-408c-8d90-a4a7843f45cc None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:19.967680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-2d489285-dcf9-408c-8d90-a4a7843f45cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:19.973309 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 386/766] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 28 12:02:19 2022] PUT /identity/v3/projects/c854d366f35145e8b2fadb9b014d0199/users/0e81804e04514ae882a1fd93789db025/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:02:19.974100 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc6f4b-587b-4972-84ed-c5ace21f3e3d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:20.056190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 381/767] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:02:20.057530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fafbb-cfc9-4479-bc32-5043fbc35235 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:20.057816 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fafbb-cfc9-4479-bc32-5043fbc35235 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:20.058090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fafbb-cfc9-4479-bc32-5043fbc35235 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:20.063615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 382/768] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:20.063615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fafbb-cfc9-4479-bc32-5043fbc35235 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:20.093396 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc6f4b-587b-4972-84ed-c5ace21f3e3d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:20.134996 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0785dd-f917-4456-b69b-70316ee5094f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:20.136196 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0785dd-f917-4456-b69b-70316ee5094f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:20.136523 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0785dd-f917-4456-b69b-70316ee5094f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:20.136893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0785dd-f917-4456-b69b-70316ee5094f None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:20.137564 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0785dd-f917-4456-b69b-70316ee5094f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:20.137867 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0785dd-f917-4456-b69b-70316ee5094f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:20.139539 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0785dd-f917-4456-b69b-70316ee5094f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:20.150960 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:20.160342 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 387/769] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:20.162027 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850cc94-ed31-48d1-97fb-ae0eaaa2fb4f None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:20.163296 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850cc94-ed31-48d1-97fb-ae0eaaa2fb4f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:20.163960 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850cc94-ed31-48d1-97fb-ae0eaaa2fb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:20.165906 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:20.186734 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-8850cc94-ed31-48d1-97fb-ae0eaaa2fb4f None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:20.188145 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8850cc94-ed31-48d1-97fb-ae0eaaa2fb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:20.197423 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fafbb-cfc9-4479-bc32-5043fbc35235 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:20.235478 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42ef94-c81e-4814-a4b1-55462410c9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:20.236061 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42ef94-c81e-4814-a4b1-55462410c9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:20.236341 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42ef94-c81e-4814-a4b1-55462410c9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:20.236616 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42ef94-c81e-4814-a4b1-55462410c9a3 None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:20.237249 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42ef94-c81e-4814-a4b1-55462410c9a3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:20.238098 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42ef94-c81e-4814-a4b1-55462410c9a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:20.239651 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42ef94-c81e-4814-a4b1-55462410c9a3 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:20.247518 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 383/770] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Sep 28 12:02:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:20.249385 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42ef94-c81e-4814-a4b1-55462410c9a3 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:20.273587 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 388/771] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:02:20.274771 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850cc94-ed31-48d1-97fb-ae0eaaa2fb4f None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:20.400041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42ef94-c81e-4814-a4b1-55462410c9a3 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:20.408291 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850cc94-ed31-48d1-97fb-ae0eaaa2fb4f None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:20.441497 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a846c5-4215-4503-ae3b-f2c423295e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:20.442394 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:20.442943 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a846c5-4215-4503-ae3b-f2c423295e49 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:20.443229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a846c5-4215-4503-ae3b-f2c423295e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:20.443527 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a846c5-4215-4503-ae3b-f2c423295e49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:20.449285 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24987c-90a8-403a-aa64-28bd6fa814d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:20.449896 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24987c-90a8-403a-aa64-28bd6fa814d9 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:20.450176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24987c-90a8-403a-aa64-28bd6fa814d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:20.450450 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24987c-90a8-403a-aa64-28bd6fa814d9 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:20.451136 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24987c-90a8-403a-aa64-28bd6fa814d9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:20.451457 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24987c-90a8-403a-aa64-28bd6fa814d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:20.451732 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a846c5-4215-4503-ae3b-f2c423295e49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:20.453117 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24987c-90a8-403a-aa64-28bd6fa814d9 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:20.453236 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a846c5-4215-4503-ae3b-f2c423295e49 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:20.459780 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 389/772] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Sep 28 12:02:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:20.460622 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24987c-90a8-403a-aa64-28bd6fa814d9 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:20.467190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-e5a846c5-4215-4503-ae3b-f2c423295e49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:20.467190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:20.467190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:20.467190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:20.467190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:20.467190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:20.467190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:20.467190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:20.467190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:20.467190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:20.467190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:20.467190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:20.467190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:02:20.467190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:02:20.467190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:02:20.468150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:02:20.468150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:20.468150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:20.468150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:20.468150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:20.468150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:20.468150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:20.468150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:20.468150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:20.468150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:20.468150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:20.468150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:20.468150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:20.468150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:20.468150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:20.468150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:20.468150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:20.469567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:02:20.469567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:02:20.469567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:02:20.469567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:02:20.469567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:02:20.469567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:02:20.469567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:20.469567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:20.469567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 384/773] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:20.474240 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a846c5-4215-4503-ae3b-f2c423295e49 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:20.477235 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:20.569785 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24987c-90a8-403a-aa64-28bd6fa814d9 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:20.600665 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a846c5-4215-4503-ae3b-f2c423295e49 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:20.612418 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e10699-56bd-47c2-a038-b351e872bd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:20.613085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e10699-56bd-47c2-a038-b351e872bd07 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:20.613366 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e10699-56bd-47c2-a038-b351e872bd07 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:20.613644 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e10699-56bd-47c2-a038-b351e872bd07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:20.624258 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e10699-56bd-47c2-a038-b351e872bd07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:02:20.630518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-89e10699-56bd-47c2-a038-b351e872bd07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:02:20.630518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:20.630518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:20.630518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:20.630518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:20.630518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:20.630518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:20.630518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:20.630518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:20.630518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:20.630518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:20.630518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:20.630518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:02:20.630518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:02:20.630518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:02:20.630518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:02:20.631668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:02:20.631668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:02:20.631668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:02:20.631668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:02:20.631668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:20.631668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:20.631668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:20.631668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:20.631668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:20.631668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:20.631668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:20.631668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:20.631668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:20.631668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:20.631668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:20.631668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:20.632825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:20.632825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:20.632825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:20.632825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:20.632825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:02:20.632825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:02:20.632825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:02:20.632825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:02:20.632825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:02:20.632825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:02:20.632825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:02:20.632825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:20.642262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 390/774] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:02:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:20.643314 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e10699-56bd-47c2-a038-b351e872bd07 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:20.646576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88517aab-f0b6-4d09-b2ba-04058467612e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:20.647188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88517aab-f0b6-4d09-b2ba-04058467612e None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:20.647495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88517aab-f0b6-4d09-b2ba-04058467612e None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:20.647770 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88517aab-f0b6-4d09-b2ba-04058467612e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:20.648478 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88517aab-f0b6-4d09-b2ba-04058467612e None admin] RBAC: Adding query filter params (interface=public, service_id=409daf3a29b24c5d9003b2a55959bcb4, region_id=RegionOne) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:20.648789 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88517aab-f0b6-4d09-b2ba-04058467612e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:20.650168 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88517aab-f0b6-4d09-b2ba-04058467612e None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:20.659357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 385/775] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Sep 28 12:02:20 2022] GET /identity/v3/endpoints?service_id=409daf3a29b24c5d9003b2a55959bcb4&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:20.659357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88517aab-f0b6-4d09-b2ba-04058467612e None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:20.725059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:20.750826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:20.783258 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e10699-56bd-47c2-a038-b351e872bd07 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:20.797431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88517aab-f0b6-4d09-b2ba-04058467612e None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:20.821965 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dad2bc-f0ed-448d-913b-44544a9cf462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:20.822493 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dad2bc-f0ed-448d-913b-44544a9cf462 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:20.822771 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dad2bc-f0ed-448d-913b-44544a9cf462 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:20.823034 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dad2bc-f0ed-448d-913b-44544a9cf462 None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:20.823773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dad2bc-f0ed-448d-913b-44544a9cf462 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:20.824080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dad2bc-f0ed-448d-913b-44544a9cf462 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:20.825510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dad2bc-f0ed-448d-913b-44544a9cf462 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:20.834934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d4f44-98da-4f8c-ae91-21efc8ab817b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:20.835593 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d4f44-98da-4f8c-ae91-21efc8ab817b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:20.835869 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d4f44-98da-4f8c-ae91-21efc8ab817b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:20.836133 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d4f44-98da-4f8c-ae91-21efc8ab817b None admin] PATH_INFO: `/v3/services/network` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:20.836709 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d4f44-98da-4f8c-ae91-21efc8ab817b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:20.838053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d4f44-98da-4f8c-ae91-21efc8ab817b None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:20.838595 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 391/776] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:02:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:20.839270 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dad2bc-f0ed-448d-913b-44544a9cf462 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:20.852229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-f16d4f44-98da-4f8c-ae91-21efc8ab817b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 28 12:02:20.852229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:20.852229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:02:20.852229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:02:20.852229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:02:20.852229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:02:20.852229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:02:20.852229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:20.852229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 28 12:02:20.852229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:20.852229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:02:20.852229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:20.852229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:20.852229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:20.852229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:20.852229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:20.852229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:20.853320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:20.853320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:20.853320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:20.853320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:20.853320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:20.853320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:20.853320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:02:20.853320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:02:20.853320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:02:20.853320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:02:20.853320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:20.853320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:20.853320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:20.853320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:20.853320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:20.853320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:20.854188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:20.854188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:20.854188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:20.854188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:20.854188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:20.854188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:20.854188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:20.854188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:20.854188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:20.854188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:20.854188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:02:20.854188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:20.854188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 28 12:02:20.854188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:20.854188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 386/777] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:20 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:20.855548 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d4f44-98da-4f8c-ae91-21efc8ab817b None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:20.951671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dad2bc-f0ed-448d-913b-44544a9cf462 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:20.967904 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d4f44-98da-4f8c-ae91-21efc8ab817b None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:20.969078 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:20.991475 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb0053-f386-4f99-baa5-a4a55d4ffae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:20.992101 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb0053-f386-4f99-baa5-a4a55d4ffae6 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:20.992403 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb0053-f386-4f99-baa5-a4a55d4ffae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:20.992640 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb0053-f386-4f99-baa5-a4a55d4ffae6 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:20.993289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb0053-f386-4f99-baa5-a4a55d4ffae6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:20.993585 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb0053-f386-4f99-baa5-a4a55d4ffae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:20.994937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb0053-f386-4f99-baa5-a4a55d4ffae6 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:20.999066 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:21.008511 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 392/778] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:02:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:21.008511 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb0053-f386-4f99-baa5-a4a55d4ffae6 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:21.010442 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7264d6f-795f-4e3a-84ba-c81f3ae8aa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:21.011056 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7264d6f-795f-4e3a-84ba-c81f3ae8aa89 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:21.011330 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7264d6f-795f-4e3a-84ba-c81f3ae8aa89 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:21.011628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7264d6f-795f-4e3a-84ba-c81f3ae8aa89 None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:21.012233 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7264d6f-795f-4e3a-84ba-c81f3ae8aa89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:21.013595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7264d6f-795f-4e3a-84ba-c81f3ae8aa89 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:21.019247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 387/779] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Sep 28 12:02:20 2022] GET /identity/v3/services => generated 772 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:21.028472 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7264d6f-795f-4e3a-84ba-c81f3ae8aa89 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:21.140719 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb0053-f386-4f99-baa5-a4a55d4ffae6 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:21.163391 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7264d6f-795f-4e3a-84ba-c81f3ae8aa89 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:21.189497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ed1a8-1e78-4643-abd8-923359ba1537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:21.190109 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ed1a8-1e78-4643-abd8-923359ba1537 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:21.190391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ed1a8-1e78-4643-abd8-923359ba1537 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:21.190695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ed1a8-1e78-4643-abd8-923359ba1537 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:21.191988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ed1a8-1e78-4643-abd8-923359ba1537 None admin] RBAC: Adding query filter params (role.id=9b8671e5f63c4b08982273f189eab5ec, scope.project.id=c854d366f35145e8b2fadb9b014d0199, user.id=c0e57ea982d349c1a86b544e9a6e7758) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:21.192300 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ed1a8-1e78-4643-abd8-923359ba1537 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:21.193838 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ed1a8-1e78-4643-abd8-923359ba1537 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:21.202795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 393/780] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:02:21 2022] GET /identity/v3/role_assignments?user.id=c0e57ea982d349c1a86b544e9a6e7758&scope.project.id=c854d366f35145e8b2fadb9b014d0199&role.id=9b8671e5f63c4b08982273f189eab5ec => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:21.204874 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ed1a8-1e78-4643-abd8-923359ba1537 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:21.214177 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac57463-fa95-4706-b957-8c47a79c2132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:21.215334 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac57463-fa95-4706-b957-8c47a79c2132 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:21.215963 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac57463-fa95-4706-b957-8c47a79c2132 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:21.216442 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac57463-fa95-4706-b957-8c47a79c2132 None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:21.217415 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac57463-fa95-4706-b957-8c47a79c2132 None admin] RBAC: Adding query filter params (name=network) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:21.218014 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac57463-fa95-4706-b957-8c47a79c2132 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:21.219899 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac57463-fa95-4706-b957-8c47a79c2132 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:21.226118 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 388/781] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 28 12:02:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:21.232715 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac57463-fa95-4706-b957-8c47a79c2132 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:21.261015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:21.343960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:21.354901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ed1a8-1e78-4643-abd8-923359ba1537 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:21.370132 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac57463-fa95-4706-b957-8c47a79c2132 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:21.411379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ed2e0-f271-4fcf-8844-5c734d9b72a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:21.412099 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ed2e0-f271-4fcf-8844-5c734d9b72a0 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:21.412525 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ed2e0-f271-4fcf-8844-5c734d9b72a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:21.412793 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ed2e0-f271-4fcf-8844-5c734d9b72a0 None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:21.413418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ed2e0-f271-4fcf-8844-5c734d9b72a0 None admin] RBAC: Adding query filter params (type=network) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:21.413721 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ed2e0-f271-4fcf-8844-5c734d9b72a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:21.415074 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ed2e0-f271-4fcf-8844-5c734d9b72a0 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:21.421396 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 389/782] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 28 12:02:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:21.427806 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ed2e0-f271-4fcf-8844-5c734d9b72a0 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:21.444150 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51230e9-3cac-47af-ac4b-e13b198a15d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:21.444816 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51230e9-3cac-47af-ac4b-e13b198a15d5 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:21.445343 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51230e9-3cac-47af-ac4b-e13b198a15d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:21.445343 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51230e9-3cac-47af-ac4b-e13b198a15d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:21.488906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51230e9-3cac-47af-ac4b-e13b198a15d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:21.490279 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51230e9-3cac-47af-ac4b-e13b198a15d5 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:21.532557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-b51230e9-3cac-47af-ac4b-e13b198a15d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:21.532557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:21.532557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:21.532557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:21.532557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:21.532557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:21.532557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:21.532557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:21.532557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:21.532557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:21.532557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:21.532557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:21.532557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:21.532557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:21.532557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:21.532557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:21.533612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:21.533612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:21.533612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:21.533612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:21.533612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:21.533612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:21.533612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:21.533612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:21.533612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:21.533612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:21.533612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:21.533612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:21.533612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:21.533612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:21.533612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:21.533612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:21.533612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:21.534550 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:21.534550 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:21.534550 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:21.538730 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 394/783] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:21.539629 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51230e9-3cac-47af-ac4b-e13b198a15d5 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:21.541375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ed2e0-f271-4fcf-8844-5c734d9b72a0 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:21.568452 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:21.583307 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ac678-4808-4933-8b05-dcbc6e71c862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:21.584303 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ac678-4808-4933-8b05-dcbc6e71c862 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:21.584786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ac678-4808-4933-8b05-dcbc6e71c862 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:21.585284 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ac678-4808-4933-8b05-dcbc6e71c862 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:21.586200 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ac678-4808-4933-8b05-dcbc6e71c862 None admin] RBAC: Adding query filter params (interface=public, service_id=b386438f28db43b782b202f7c24cf4d1, region_id=RegionOne) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:21.586709 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ac678-4808-4933-8b05-dcbc6e71c862 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:21.588316 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ac678-4808-4933-8b05-dcbc6e71c862 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:21.595161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 390/784] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Sep 28 12:02:21 2022] GET /identity/v3/endpoints?service_id=b386438f28db43b782b202f7c24cf4d1&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:21.600943 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ac678-4808-4933-8b05-dcbc6e71c862 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:21.765911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ac678-4808-4933-8b05-dcbc6e71c862 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:21.778925 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:21.793867 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51230e9-3cac-47af-ac4b-e13b198a15d5 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:21.834423 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58698ab-3a1a-44a2-b3a9-d9f44fc13e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:21.836419 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58698ab-3a1a-44a2-b3a9-d9f44fc13e01 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:21.837061 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58698ab-3a1a-44a2-b3a9-d9f44fc13e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:21.838593 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58698ab-3a1a-44a2-b3a9-d9f44fc13e01 None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:21.839412 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58698ab-3a1a-44a2-b3a9-d9f44fc13e01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:21.841691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58698ab-3a1a-44a2-b3a9-d9f44fc13e01 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:21.851663 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821d45b-21b0-4de6-8a2e-ef20f835d0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:21.852675 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821d45b-21b0-4de6-8a2e-ef20f835d0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:21.853198 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821d45b-21b0-4de6-8a2e-ef20f835d0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:21.853667 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821d45b-21b0-4de6-8a2e-ef20f835d0e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:21.854529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821d45b-21b0-4de6-8a2e-ef20f835d0e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:21.854753 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 391/785] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Sep 28 12:02:21 2022] GET /identity/v3/services => generated 772 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:21.855260 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821d45b-21b0-4de6-8a2e-ef20f835d0e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:21.856974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821d45b-21b0-4de6-8a2e-ef20f835d0e1 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:21.871681 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 395/786] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:21.876842 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58698ab-3a1a-44a2-b3a9-d9f44fc13e01 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:21.968971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:22.047696 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58698ab-3a1a-44a2-b3a9-d9f44fc13e01 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:22.096638 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846e703-a2fe-46f9-9591-651a6dcbd20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:22.097892 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846e703-a2fe-46f9-9591-651a6dcbd20d None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:22.098165 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846e703-a2fe-46f9-9591-651a6dcbd20d None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:22.098429 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846e703-a2fe-46f9-9591-651a6dcbd20d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:22.106825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846e703-a2fe-46f9-9591-651a6dcbd20d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:22.108294 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846e703-a2fe-46f9-9591-651a6dcbd20d None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:22.120417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-c846e703-a2fe-46f9-9591-651a6dcbd20d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 28 12:02:22.120417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:22.120417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:22.120417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:22.120417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:22.120417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:22.120417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:22.120417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:22.120417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:22.120417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:22.120417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:22.120417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:22.120417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:02:22.120417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:02:22.120417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:02:22.120417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:02:22.121397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:22.121397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:22.121397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:02:22.121397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:22.121397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:02:22.121397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:22.121397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:22.121397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:22.121397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:22.121397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:22.121397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:22.121397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:22.121397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:22.121397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:22.121397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:22.121397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:22.121397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:22.121397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:22.122973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:22.122973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:22.122973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:02:22.122973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:02:22.122973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:02:22.122973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:02:22.122973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:02:22.122973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:02:22.122973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 28 12:02:22.122973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:22.122973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 392/787] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:02:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:22.127519 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821d45b-21b0-4de6-8a2e-ef20f835d0e1 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:22.241820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821d45b-21b0-4de6-8a2e-ef20f835d0e1 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:22.279965 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6f2ad-32ba-4f62-85f5-7af772d49d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:22.280569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6f2ad-32ba-4f62-85f5-7af772d49d73 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:22.280845 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6f2ad-32ba-4f62-85f5-7af772d49d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:22.281111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6f2ad-32ba-4f62-85f5-7af772d49d73 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:22.281842 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6f2ad-32ba-4f62-85f5-7af772d49d73 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:22.282143 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6f2ad-32ba-4f62-85f5-7af772d49d73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:22.283582 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6f2ad-32ba-4f62-85f5-7af772d49d73 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:22.302880 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a17db8-93f0-4d26-81fe-0d3f4923fc71 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:22.303150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a17db8-93f0-4d26-81fe-0d3f4923fc71 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:22.303411 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a17db8-93f0-4d26-81fe-0d3f4923fc71 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:22.303988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 396/788] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Sep 28 12:02:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:22.304951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 393/789] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:22.309541 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6f2ad-32ba-4f62-85f5-7af772d49d73 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:22.316401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc5473-7023-476b-9f1e-36ead60adc4a None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:22.316951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc5473-7023-476b-9f1e-36ead60adc4a None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:22.317224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc5473-7023-476b-9f1e-36ead60adc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:22.332598 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:22.344865 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-b3bc5473-7023-476b-9f1e-36ead60adc4a None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:22.346698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b3bc5473-7023-476b-9f1e-36ead60adc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:22.454610 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 394/790] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:02:22.477161 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6f2ad-32ba-4f62-85f5-7af772d49d73 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:22.513333 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5714f45-865c-4d1f-ac2f-aa091ee6cf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:22.513881 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5714f45-865c-4d1f-ac2f-aa091ee6cf7e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:22.514153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5714f45-865c-4d1f-ac2f-aa091ee6cf7e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:22.514423 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5714f45-865c-4d1f-ac2f-aa091ee6cf7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:22.524964 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5714f45-865c-4d1f-ac2f-aa091ee6cf7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:22.526409 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5714f45-865c-4d1f-ac2f-aa091ee6cf7e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:22.541261 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-a5714f45-865c-4d1f-ac2f-aa091ee6cf7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:22.541261 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:22.541261 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:22.541261 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:22.541261 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:22.541261 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:22.541261 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:22.541261 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:22.541261 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:22.541261 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:22.541261 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:22.541261 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:22.541261 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:22.541261 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:22.541261 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:22.541261 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:22.542227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:22.542227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:22.542227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:22.542227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:22.542227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:22.542227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:22.542227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:22.542227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:22.542227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:22.542227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:22.542227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:22.542227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:22.542227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:22.542227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:22.542227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:22.542227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:22.542227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:22.543114 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:22.543114 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:22.543114 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:22.543114 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 397/791] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:22.548170 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc5473-7023-476b-9f1e-36ead60adc4a None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:22.603193 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:22.670824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc5473-7023-476b-9f1e-36ead60adc4a None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:22.716766 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85d8ae-ac52-4dbe-8ca4-bc41d5df00fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:22.717395 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85d8ae-ac52-4dbe-8ca4-bc41d5df00fd None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:22.717672 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85d8ae-ac52-4dbe-8ca4-bc41d5df00fd None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:22.717945 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85d8ae-ac52-4dbe-8ca4-bc41d5df00fd None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:22.718594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85d8ae-ac52-4dbe-8ca4-bc41d5df00fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:22.718925 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85d8ae-ac52-4dbe-8ca4-bc41d5df00fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:22.720319 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85d8ae-ac52-4dbe-8ca4-bc41d5df00fd None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:22.743976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 395/792] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:22.749796 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5714f45-865c-4d1f-ac2f-aa091ee6cf7e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:22.810087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85d8ae-ac52-4dbe-8ca4-bc41d5df00fd None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:22.824637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:22.882946 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5714f45-865c-4d1f-ac2f-aa091ee6cf7e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:22.922769 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73836a-7193-43d3-bc4a-3f8d4a354dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:22.923402 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73836a-7193-43d3-bc4a-3f8d4a354dfa None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:22.924653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73836a-7193-43d3-bc4a-3f8d4a354dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:22.925894 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73836a-7193-43d3-bc4a-3f8d4a354dfa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:22.942546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73836a-7193-43d3-bc4a-3f8d4a354dfa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:22.944715 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73836a-7193-43d3-bc4a-3f8d4a354dfa None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:22.965607 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-2a73836a-7193-43d3-bc4a-3f8d4a354dfa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:22.965607 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:22.965607 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:22.965607 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:22.965607 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:22.965607 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:22.965607 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:22.965607 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:22.965607 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:22.965607 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:22.965607 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:22.965607 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:22.965607 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:02:22.965607 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:02:22.965607 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:02:22.966524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:02:22.966524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:22.966524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:22.966524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:22.966524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:22.966524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:22.966524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:22.966524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:22.966524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:22.966524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:22.966524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:22.966524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:22.966524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:22.966524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:22.966524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:22.966524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:22.966524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:22.967420 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:02:22.967420 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:02:22.967420 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:02:22.967420 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:02:22.967420 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:02:22.967420 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:02:22.967420 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:22.967420 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:22.968833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 398/793] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:22.973613 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73836a-7193-43d3-bc4a-3f8d4a354dfa None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:22.980316 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85d8ae-ac52-4dbe-8ca4-bc41d5df00fd None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:22.982027 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:23.044584 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd2d44-0c17-4cd0-bac9-22dbcdd5d44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:23.045274 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd2d44-0c17-4cd0-bac9-22dbcdd5d44d None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:23.045568 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd2d44-0c17-4cd0-bac9-22dbcdd5d44d None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:23.045820 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd2d44-0c17-4cd0-bac9-22dbcdd5d44d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:23.066405 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd2d44-0c17-4cd0-bac9-22dbcdd5d44d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:02:23.071619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-c6fd2d44-0c17-4cd0-bac9-22dbcdd5d44d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:02:23.071619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:23.071619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:23.071619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:23.071619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:23.071619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:23.071619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:23.071619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:23.071619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:23.071619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:23.071619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:23.071619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:23.071619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:02:23.071619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:02:23.071619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:02:23.071619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:02:23.072563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:02:23.072563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:02:23.072563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:02:23.072563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:02:23.072563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:23.072563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:23.072563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:23.072563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:23.072563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:23.072563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:23.072563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:23.072563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:23.072563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:23.072563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:23.072563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:23.072563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:23.073425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:23.073425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:23.073425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:23.073425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:23.073425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:02:23.073425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:02:23.073425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:02:23.073425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:02:23.073425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:02:23.073425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:02:23.073425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:02:23.073425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:23.074081 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 396/794] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:02:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:23.080793 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd2d44-0c17-4cd0-bac9-22dbcdd5d44d None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:23.161976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73836a-7193-43d3-bc4a-3f8d4a354dfa None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:23.192148 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:23.215781 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043be17-0153-4d4f-9256-7519d80f2e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:23.216390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043be17-0153-4d4f-9256-7519d80f2e63 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:23.216663 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043be17-0153-4d4f-9256-7519d80f2e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:23.216929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043be17-0153-4d4f-9256-7519d80f2e63 None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:23.217621 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043be17-0153-4d4f-9256-7519d80f2e63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:23.217921 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043be17-0153-4d4f-9256-7519d80f2e63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:23.219345 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043be17-0153-4d4f-9256-7519d80f2e63 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:23.251370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 399/795] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:02:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:23.256463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043be17-0153-4d4f-9256-7519d80f2e63 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:23.288091 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd2d44-0c17-4cd0-bac9-22dbcdd5d44d None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:23.361097 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162ee7e-e51f-4e56-a1cb-4f5192955f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:23.361618 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162ee7e-e51f-4e56-a1cb-4f5192955f18 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:23.363466 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162ee7e-e51f-4e56-a1cb-4f5192955f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:23.363747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162ee7e-e51f-4e56-a1cb-4f5192955f18 None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:23.364464 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162ee7e-e51f-4e56-a1cb-4f5192955f18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:23.364767 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162ee7e-e51f-4e56-a1cb-4f5192955f18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:23.370764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162ee7e-e51f-4e56-a1cb-4f5192955f18 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:23.393961 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 397/796] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:02:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:23.395397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162ee7e-e51f-4e56-a1cb-4f5192955f18 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:23.438563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:23.441743 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043be17-0153-4d4f-9256-7519d80f2e63 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:23.510552 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a1fe4-8bde-4243-a2fb-8d5d78203ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:23.511277 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a1fe4-8bde-4243-a2fb-8d5d78203ddd None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:23.511583 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a1fe4-8bde-4243-a2fb-8d5d78203ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:23.511858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a1fe4-8bde-4243-a2fb-8d5d78203ddd None admin] PATH_INFO: `/v3/projects/c854d366f35145e8b2fadb9b014d0199/users/822e394e80fd41adb54d330adaf65a68/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:23.515928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a1fe4-8bde-4243-a2fb-8d5d78203ddd None admin] RBAC: Authorizing `identity:create_grant(project_id=c854d366f35145e8b2fadb9b014d0199, user_id=822e394e80fd41adb54d330adaf65a68, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:23.517384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a1fe4-8bde-4243-a2fb-8d5d78203ddd None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:23.553821 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 400/797] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 28 12:02:23 2022] PUT /identity/v3/projects/c854d366f35145e8b2fadb9b014d0199/users/822e394e80fd41adb54d330adaf65a68/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:02:23.560307 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162ee7e-e51f-4e56-a1cb-4f5192955f18 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:23.601121 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93ffab-4a9b-488f-81fb-f09784f2b4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:23.602103 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93ffab-4a9b-488f-81fb-f09784f2b4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:23.602614 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93ffab-4a9b-488f-81fb-f09784f2b4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:23.603095 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93ffab-4a9b-488f-81fb-f09784f2b4f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:23.617131 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b93ffab-4a9b-488f-81fb-f09784f2b4f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:23.619095 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b93ffab-4a9b-488f-81fb-f09784f2b4f1 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:23.637467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-1b93ffab-4a9b-488f-81fb-f09784f2b4f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:23.637467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:23.637467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:23.637467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:23.637467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:23.637467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:23.637467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:23.637467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:23.637467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:23.637467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:23.637467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:23.637467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:23.637467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:23.637467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:23.637467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:23.637467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:23.638531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:23.638531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:23.638531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:23.638531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:23.638531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:23.638531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:23.638531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:23.638531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:23.638531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:23.638531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:23.638531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:23.638531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:23.638531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:23.638531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:23.638531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:23.638531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:23.638531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:23.639423 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:23.639423 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:23.639423 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:23.641851 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 398/798] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:23.647375 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a1fe4-8bde-4243-a2fb-8d5d78203ddd None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:23.707636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:23.791713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07738090-9cff-4271-bb4b-801c53cad51c None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:23.792335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07738090-9cff-4271-bb4b-801c53cad51c None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:23.792772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a1fe4-8bde-4243-a2fb-8d5d78203ddd None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:23.793114 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07738090-9cff-4271-bb4b-801c53cad51c None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:23.794781 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 399/799] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:02:23.800342 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea3840-7171-4a7f-94a0-60d556bac40d None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:23.800621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea3840-7171-4a7f-94a0-60d556bac40d None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:23.800894 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea3840-7171-4a7f-94a0-60d556bac40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:23.827040 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-70ea3840-7171-4a7f-94a0-60d556bac40d None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:23.828272 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-70ea3840-7171-4a7f-94a0-60d556bac40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:23.835902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe65748-b1a4-407f-9278-ad8e4cb9f2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:23.836515 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe65748-b1a4-407f-9278-ad8e4cb9f2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:23.836796 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe65748-b1a4-407f-9278-ad8e4cb9f2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:23.837065 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe65748-b1a4-407f-9278-ad8e4cb9f2f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:23.837719 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe65748-b1a4-407f-9278-ad8e4cb9f2f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:23.838023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe65748-b1a4-407f-9278-ad8e4cb9f2f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:23.839384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe65748-b1a4-407f-9278-ad8e4cb9f2f3 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:23.852817 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 401/800] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:23.861086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe65748-b1a4-407f-9278-ad8e4cb9f2f3 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:23.953329 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 400/801] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:02:23.963747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f25b0e-238e-4e0a-912f-8923dffb129a None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:23.964276 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f25b0e-238e-4e0a-912f-8923dffb129a None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:23.964740 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f25b0e-238e-4e0a-912f-8923dffb129a None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:23.966490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 401/802] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:23 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:23.979269 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b0111-afd4-4cb0-b62f-59b83187c593 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:23.979821 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b0111-afd4-4cb0-b62f-59b83187c593 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:23.980298 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b0111-afd4-4cb0-b62f-59b83187c593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:23.981075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe65748-b1a4-407f-9278-ad8e4cb9f2f3 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:23.982702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:23.996534 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:24.012955 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-0b4b0111-afd4-4cb0-b62f-59b83187c593 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:24.014431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-0b4b0111-afd4-4cb0-b62f-59b83187c593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:24.027970 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc63aa7-56ce-4021-a922-35e7a1544273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:24.028657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc63aa7-56ce-4021-a922-35e7a1544273 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:24.028938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc63aa7-56ce-4021-a922-35e7a1544273 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:24.029208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc63aa7-56ce-4021-a922-35e7a1544273 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:24.042921 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc63aa7-56ce-4021-a922-35e7a1544273 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:24.044494 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc63aa7-56ce-4021-a922-35e7a1544273 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:24.057653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-abc63aa7-56ce-4021-a922-35e7a1544273 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:02:24.057653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:24.057653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:24.057653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:24.057653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:24.057653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:24.057653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:24.057653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:24.057653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:24.057653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:24.057653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:24.057653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:24.057653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:02:24.057653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:02:24.057653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:02:24.057653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:02:24.058639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:24.058639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:24.058639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:02:24.058639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:24.058639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:02:24.058639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:24.058639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:24.058639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:24.058639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:24.058639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:24.058639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:24.058639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:24.058639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:24.058639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:24.058639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:24.058639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:24.058639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:24.058639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:24.059636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:24.059636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:24.059636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:02:24.059636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:02:24.059636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:02:24.059636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:02:24.059636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:02:24.059636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:02:24.059636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:02:24.059636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:24.063878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 402/803] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Sep 28 12:02:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:24.065095 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc63aa7-56ce-4021-a922-35e7a1544273 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:24.175801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc63aa7-56ce-4021-a922-35e7a1544273 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:24.212628 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7742ca-7db5-45e5-acb7-90a5bbe76196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:24.213207 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7742ca-7db5-45e5-acb7-90a5bbe76196 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:24.213491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7742ca-7db5-45e5-acb7-90a5bbe76196 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:24.213765 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7742ca-7db5-45e5-acb7-90a5bbe76196 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:24.214594 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7742ca-7db5-45e5-acb7-90a5bbe76196 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:24.214907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7742ca-7db5-45e5-acb7-90a5bbe76196 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:24.216353 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7742ca-7db5-45e5-acb7-90a5bbe76196 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:24.216797 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 402/804] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:02:24.245949 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 403/805] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Sep 28 12:02:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:24.256520 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b0111-afd4-4cb0-b62f-59b83187c593 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:24.348768 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7742ca-7db5-45e5-acb7-90a5bbe76196 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:24.373776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b0111-afd4-4cb0-b62f-59b83187c593 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:24.379826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:24.419957 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ede54-1ffb-4f3a-a55a-bf0f142de789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:24.420579 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ede54-1ffb-4f3a-a55a-bf0f142de789 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:24.421164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ede54-1ffb-4f3a-a55a-bf0f142de789 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:24.421441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ede54-1ffb-4f3a-a55a-bf0f142de789 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:24.424718 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:24.467369 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7742ca-7db5-45e5-acb7-90a5bbe76196 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:24.498317 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ede54-1ffb-4f3a-a55a-bf0f142de789 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:24.500102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ede54-1ffb-4f3a-a55a-bf0f142de789 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:24.510558 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd5b56-e626-4550-8e08-a260bbe4380e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:24.511193 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd5b56-e626-4550-8e08-a260bbe4380e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:24.511493 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd5b56-e626-4550-8e08-a260bbe4380e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:24.511816 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd5b56-e626-4550-8e08-a260bbe4380e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:24.512402 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd5b56-e626-4550-8e08-a260bbe4380e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:24.514225 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd5b56-e626-4550-8e08-a260bbe4380e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:24.527779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-8bfd5b56-e626-4550-8e08-a260bbe4380e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 28 12:02:24.527779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:24.527779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:02:24.527779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:02:24.527779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:02:24.527779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:02:24.527779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:02:24.527779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:24.527779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 28 12:02:24.527779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:24.527779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:02:24.527779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:24.527779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:24.527779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:24.527779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:24.527779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:24.527779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:24.528827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:24.528827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:24.528827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:24.528827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:24.528827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:24.528827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:24.528827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:02:24.528827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:02:24.528827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:02:24.528827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:02:24.528827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:24.528827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:24.528827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:24.528827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:24.528827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:24.528827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:24.529692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:24.529692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:24.529692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:24.529692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:24.529692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:24.529692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:24.529692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:24.529692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:24.529692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:24.529692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:24.529692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:02:24.529692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:24.529692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 28 12:02:24.529692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:24.529692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 404/806] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Sep 28 12:02:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:24.537538 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd5b56-e626-4550-8e08-a260bbe4380e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:24.631330 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 403/807] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:02:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:02:24.635380 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ede54-1ffb-4f3a-a55a-bf0f142de789 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:24.683566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:24.727929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:24.747112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd5b56-e626-4550-8e08-a260bbe4380e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:24.758085 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ede54-1ffb-4f3a-a55a-bf0f142de789 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:24.784053 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f553b-6005-4a62-89ec-ca0b7a27ac18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:24.785324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f553b-6005-4a62-89ec-ca0b7a27ac18 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:24.785689 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f553b-6005-4a62-89ec-ca0b7a27ac18 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:24.786026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f553b-6005-4a62-89ec-ca0b7a27ac18 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:24.786719 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f553b-6005-4a62-89ec-ca0b7a27ac18 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:24.787088 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f553b-6005-4a62-89ec-ca0b7a27ac18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:24.788495 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f553b-6005-4a62-89ec-ca0b7a27ac18 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:24.797657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 405/808] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Sep 28 12:02:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:24.797657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f553b-6005-4a62-89ec-ca0b7a27ac18 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:24.798292 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd94a5-9a35-4e61-8557-127b5c32c3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:24.798939 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd94a5-9a35-4e61-8557-127b5c32c3a3 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:24.799221 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd94a5-9a35-4e61-8557-127b5c32c3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:24.799577 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd94a5-9a35-4e61-8557-127b5c32c3a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:24.814184 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd94a5-9a35-4e61-8557-127b5c32c3a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:24.816222 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd94a5-9a35-4e61-8557-127b5c32c3a3 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:24.836934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-17bd94a5-9a35-4e61-8557-127b5c32c3a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:24.836934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:24.836934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:24.836934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:24.836934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:24.836934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:24.836934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:24.836934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:24.836934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:24.836934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:24.836934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:24.836934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:24.836934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:24.836934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:24.836934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:24.836934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:24.837916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:24.837916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:24.837916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:24.837916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:24.837916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:24.837916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:24.837916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:24.837916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:24.837916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:24.837916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:24.837916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:24.837916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:24.837916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:24.837916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:24.837916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:24.837916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:24.837916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:24.838817 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:24.838817 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:24.838817 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:24.839002 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 404/809] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:24.840107 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2401f0-997e-4bd1-a02e-915cd97fea10 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:24.840391 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2401f0-997e-4bd1-a02e-915cd97fea10 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:24.840662 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2401f0-997e-4bd1-a02e-915cd97fea10 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:24.846331 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 405/810] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:24.846331 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2401f0-997e-4bd1-a02e-915cd97fea10 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:24.910399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f553b-6005-4a62-89ec-ca0b7a27ac18 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:24.940921 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:24.947332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bbc75-4109-4456-9e4a-7f68a700006c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:24.947995 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bbc75-4109-4456-9e4a-7f68a700006c None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:24.948284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bbc75-4109-4456-9e4a-7f68a700006c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:24.948527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bbc75-4109-4456-9e4a-7f68a700006c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:24.959769 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631bbc75-4109-4456-9e4a-7f68a700006c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:02:24.961877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2401f0-997e-4bd1-a02e-915cd97fea10 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:24.965006 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-631bbc75-4109-4456-9e4a-7f68a700006c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:02:24.965006 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:24.965006 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:24.965006 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:24.965006 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:24.965006 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:24.965006 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:24.965006 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:24.965006 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:24.965006 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:24.965006 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:24.965006 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:24.965006 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:02:24.965006 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:02:24.965006 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:02:24.965006 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:02:24.965970 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:02:24.965970 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:02:24.965970 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:02:24.965970 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:02:24.965970 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:24.965970 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:24.965970 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:24.965970 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:24.965970 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:24.965970 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:24.965970 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:24.965970 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:24.965970 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:24.965970 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:24.965970 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:24.965970 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:24.966824 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:24.966824 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:24.966824 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:24.966824 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:24.966824 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:02:24.966824 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:02:24.966824 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:02:24.966824 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:02:24.966824 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:02:24.966824 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:02:24.966824 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:02:24.966824 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:24.966824 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 406/811] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 28 12:02:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:24.966824 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bbc75-4109-4456-9e4a-7f68a700006c None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:24.984085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:25.001397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778576b3-3824-4897-8fd7-c41cca6eb373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:25.002429 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778576b3-3824-4897-8fd7-c41cca6eb373 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:25.002721 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778576b3-3824-4897-8fd7-c41cca6eb373 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:25.003868 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778576b3-3824-4897-8fd7-c41cca6eb373 None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:25.004507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778576b3-3824-4897-8fd7-c41cca6eb373 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:25.005066 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778576b3-3824-4897-8fd7-c41cca6eb373 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:25.007161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778576b3-3824-4897-8fd7-c41cca6eb373 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:25.015574 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 406/812] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Sep 28 12:02:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:25.017009 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5d351-1438-466c-9706-64721999936b None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:25.017449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5d351-1438-466c-9706-64721999936b None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:25.017722 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5d351-1438-466c-9706-64721999936b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:25.035385 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-eff5d351-1438-466c-9706-64721999936b None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:25.036556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-eff5d351-1438-466c-9706-64721999936b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:25.081285 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bbc75-4109-4456-9e4a-7f68a700006c None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:25.106535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 407/813] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:02:25.107155 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5d351-1438-466c-9706-64721999936b None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:25.135064 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df32949-1adf-46b3-acae-49cf6de87b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:25.136524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df32949-1adf-46b3-acae-49cf6de87b41 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:25.136992 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df32949-1adf-46b3-acae-49cf6de87b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:25.137450 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df32949-1adf-46b3-acae-49cf6de87b41 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:25.138432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df32949-1adf-46b3-acae-49cf6de87b41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:25.139234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df32949-1adf-46b3-acae-49cf6de87b41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:25.141263 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df32949-1adf-46b3-acae-49cf6de87b41 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:25.162136 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 407/814] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:25.162136 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df32949-1adf-46b3-acae-49cf6de87b41 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:25.200477 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:25.221941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5d351-1438-466c-9706-64721999936b None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:25.248870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:25.258418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c7220-188e-42cb-9aa3-8f2173a6e6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:25.259034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c7220-188e-42cb-9aa3-8f2173a6e6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:25.259365 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c7220-188e-42cb-9aa3-8f2173a6e6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:25.259676 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c7220-188e-42cb-9aa3-8f2173a6e6c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:25.260347 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c7220-188e-42cb-9aa3-8f2173a6e6c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:25.260656 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c7220-188e-42cb-9aa3-8f2173a6e6c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:25.262205 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c7220-188e-42cb-9aa3-8f2173a6e6c0 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:25.275792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 408/815] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 28 12:02:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:25.276662 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c7220-188e-42cb-9aa3-8f2173a6e6c0 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:25.295387 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df32949-1adf-46b3-acae-49cf6de87b41 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:25.341762 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a34d5-1931-4f89-bc41-287295cce4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:25.342727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a34d5-1931-4f89-bc41-287295cce4bc None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:25.343209 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a34d5-1931-4f89-bc41-287295cce4bc None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:25.343710 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a34d5-1931-4f89-bc41-287295cce4bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:25.345555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a34d5-1931-4f89-bc41-287295cce4bc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:25.347557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a34d5-1931-4f89-bc41-287295cce4bc None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:25.375200 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 408/816] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:02:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:02:25.376501 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a34d5-1931-4f89-bc41-287295cce4bc None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:25.390954 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c7220-188e-42cb-9aa3-8f2173a6e6c0 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:25.447869 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8be435-8acd-4006-8e7a-1cd78b973907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:25.448567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8be435-8acd-4006-8e7a-1cd78b973907 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:25.448841 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8be435-8acd-4006-8e7a-1cd78b973907 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:25.449109 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8be435-8acd-4006-8e7a-1cd78b973907 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:25.459972 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8be435-8acd-4006-8e7a-1cd78b973907 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:25.462470 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8be435-8acd-4006-8e7a-1cd78b973907 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:25.467576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:25.484927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-9b8be435-8acd-4006-8e7a-1cd78b973907 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:25.484927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:25.484927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:25.484927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:25.484927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:25.484927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:25.484927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:25.484927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:25.484927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:25.484927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:25.484927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:25.484927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:25.484927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:02:25.484927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:02:25.484927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:02:25.485901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:02:25.485901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:25.485901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:25.485901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:25.485901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:25.485901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:25.485901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:25.485901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:25.485901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:25.485901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:25.485901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:25.485901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:25.485901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:25.485901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:25.485901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:25.485901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:25.485901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:25.486841 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:02:25.486841 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:02:25.486841 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:02:25.486841 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:02:25.486841 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:02:25.486841 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:02:25.486841 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:25.486841 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:25.490718 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 409/817] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:25.492085 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8be435-8acd-4006-8e7a-1cd78b973907 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:25.524867 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a34d5-1931-4f89-bc41-287295cce4bc None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:25.555474 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:25.571708 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d91d3-a22c-4ab1-b1ef-6a09c0cd863c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:25.572352 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d91d3-a22c-4ab1-b1ef-6a09c0cd863c None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:25.572633 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d91d3-a22c-4ab1-b1ef-6a09c0cd863c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:25.572911 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d91d3-a22c-4ab1-b1ef-6a09c0cd863c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:25.586569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d91d3-a22c-4ab1-b1ef-6a09c0cd863c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:25.588085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d91d3-a22c-4ab1-b1ef-6a09c0cd863c None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:25.603525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-6e6d91d3-a22c-4ab1-b1ef-6a09c0cd863c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:25.603525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:25.603525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:25.603525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:25.603525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:25.603525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:25.603525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:25.603525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:25.603525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:25.603525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:25.603525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:25.603525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:25.603525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:25.603525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:25.603525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:25.603525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:25.604532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:25.604532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:25.604532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:25.604532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:25.604532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:25.604532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:25.604532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:25.604532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:25.604532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:25.604532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:25.604532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:25.604532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:25.604532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:25.604532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:25.604532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:25.604532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:25.604532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:25.605963 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:25.605963 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:25.605963 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:25.605963 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 409/818] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:25.605963 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d91d3-a22c-4ab1-b1ef-6a09c0cd863c None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:25.633658 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8be435-8acd-4006-8e7a-1cd78b973907 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:25.683362 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4a27d-4034-4279-b9a9-bbee9835b571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:25.684574 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4a27d-4034-4279-b9a9-bbee9835b571 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:25.685029 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4a27d-4034-4279-b9a9-bbee9835b571 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:25.685448 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4a27d-4034-4279-b9a9-bbee9835b571 None admin] PATH_INFO: `/v3/services/network` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:25.686202 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4a27d-4034-4279-b9a9-bbee9835b571 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:25.688636 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4a27d-4034-4279-b9a9-bbee9835b571 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:25.701204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-efb4a27d-4034-4279-b9a9-bbee9835b571 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 28 12:02:25.701204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:25.701204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:02:25.701204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:02:25.701204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:02:25.701204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:02:25.701204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:02:25.701204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:25.701204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 28 12:02:25.701204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:25.701204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:02:25.701204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:25.701204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:25.701204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:25.701204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:25.701204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:25.701204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:25.702504 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:25.702504 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:25.702504 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:25.702504 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:25.702504 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:25.702504 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:25.702504 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:02:25.702504 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:02:25.702504 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:02:25.702504 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:02:25.702504 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:25.702504 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:25.702504 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:25.702504 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:25.702504 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:25.702504 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:25.703635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:25.703635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:25.703635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:25.703635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:25.703635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:25.703635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:25.703635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:25.703635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:25.703635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:25.703635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:25.703635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:02:25.703635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:25.703635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 28 12:02:25.703635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:25.706977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 410/819] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:25 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:25.708184 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4a27d-4034-4279-b9a9-bbee9835b571 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:25.735059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d91d3-a22c-4ab1-b1ef-6a09c0cd863c None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:25.786093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d001d4-5341-4a72-92b2-83c81ea11f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:25.787407 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d001d4-5341-4a72-92b2-83c81ea11f03 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:25.787936 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d001d4-5341-4a72-92b2-83c81ea11f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:25.788478 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d001d4-5341-4a72-92b2-83c81ea11f03 None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:25.789635 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d001d4-5341-4a72-92b2-83c81ea11f03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:25.790508 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d001d4-5341-4a72-92b2-83c81ea11f03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:25.792701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d001d4-5341-4a72-92b2-83c81ea11f03 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:25.804667 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:25.815209 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 410/820] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:02:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:25.816945 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d001d4-5341-4a72-92b2-83c81ea11f03 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:25.854783 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4a27d-4034-4279-b9a9-bbee9835b571 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:25.859994 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:25.892765 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae847ae-812a-4d96-bd13-30412ab147bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:25.893373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae847ae-812a-4d96-bd13-30412ab147bd None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:25.893687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae847ae-812a-4d96-bd13-30412ab147bd None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:25.893958 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae847ae-812a-4d96-bd13-30412ab147bd None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:25.894603 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae847ae-812a-4d96-bd13-30412ab147bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:25.894906 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae847ae-812a-4d96-bd13-30412ab147bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:25.896313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae847ae-812a-4d96-bd13-30412ab147bd None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:25.911806 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 411/821] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:25.911806 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae847ae-812a-4d96-bd13-30412ab147bd None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:25.936944 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d001d4-5341-4a72-92b2-83c81ea11f03 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:25.972691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e5098-8435-4793-9d12-f5a23cb96e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:25.973362 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e5098-8435-4793-9d12-f5a23cb96e97 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:25.973640 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e5098-8435-4793-9d12-f5a23cb96e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:25.973908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e5098-8435-4793-9d12-f5a23cb96e97 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:25.974531 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e5098-8435-4793-9d12-f5a23cb96e97 None admin] RBAC: Adding query filter params (name=network) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:25.974817 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e5098-8435-4793-9d12-f5a23cb96e97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:25.976201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e5098-8435-4793-9d12-f5a23cb96e97 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:25.985306 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 411/822] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 28 12:02:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:25.986410 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fdfda-8c17-4a90-855c-23a212f956c1 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:25.986690 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fdfda-8c17-4a90-855c-23a212f956c1 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:25.986959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fdfda-8c17-4a90-855c-23a212f956c1 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:25.988812 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 412/823] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:25.989497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fdfda-8c17-4a90-855c-23a212f956c1 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:26.027219 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae847ae-812a-4d96-bd13-30412ab147bd None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:26.054729 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:26.069673 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef903e88-d19d-4c69-bdb6-71c6c73e48de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:26.070996 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef903e88-d19d-4c69-bdb6-71c6c73e48de None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:26.071487 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef903e88-d19d-4c69-bdb6-71c6c73e48de None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:26.072379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef903e88-d19d-4c69-bdb6-71c6c73e48de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:26.073596 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef903e88-d19d-4c69-bdb6-71c6c73e48de None admin] RBAC: Adding query filter params (role.id=66456d39fc0c496c8f290a436b726216, scope.project.id=c854d366f35145e8b2fadb9b014d0199, user.id=0e81804e04514ae882a1fd93789db025) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:26.074041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef903e88-d19d-4c69-bdb6-71c6c73e48de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:26.076478 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef903e88-d19d-4c69-bdb6-71c6c73e48de None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:26.091502 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 412/824] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:02:25 2022] GET /identity/v3/role_assignments?user.id=0e81804e04514ae882a1fd93789db025&scope.project.id=c854d366f35145e8b2fadb9b014d0199&role.id=66456d39fc0c496c8f290a436b726216 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:26.091502 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef903e88-d19d-4c69-bdb6-71c6c73e48de None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:26.102390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:26.107770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fdfda-8c17-4a90-855c-23a212f956c1 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:26.150048 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58eaa5c-0217-4422-96d1-2f11d4363993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:26.150700 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58eaa5c-0217-4422-96d1-2f11d4363993 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:26.150978 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58eaa5c-0217-4422-96d1-2f11d4363993 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:26.151249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58eaa5c-0217-4422-96d1-2f11d4363993 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:26.159968 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58eaa5c-0217-4422-96d1-2f11d4363993 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:26.161632 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58eaa5c-0217-4422-96d1-2f11d4363993 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:26.177295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-e58eaa5c-0217-4422-96d1-2f11d4363993 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 12:02:26.177295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:26.177295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:26.177295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:26.177295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:26.177295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:26.177295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:26.177295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:26.177295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:26.177295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:26.177295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:26.177295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:26.177295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:02:26.177295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:02:26.177295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:02:26.177295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:02:26.178346 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:26.178346 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:26.178346 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:02:26.178346 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:26.178346 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:02:26.178346 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:26.178346 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:26.178346 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:26.178346 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:26.178346 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:26.178346 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:26.178346 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:26.178346 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:26.178346 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:26.178346 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:26.178346 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:26.178346 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:26.178346 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:26.179336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:26.179336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:26.179336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:02:26.179336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:02:26.179336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:02:26.179336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:02:26.179336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:02:26.179336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:02:26.179336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 12:02:26.179336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:26.179336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 413/825] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 28 12:02:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:26.180452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5b63a-705a-4810-9ec0-cd63ed0a7fc0 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:26.180452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5b63a-705a-4810-9ec0-cd63ed0a7fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:26.180748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5b63a-705a-4810-9ec0-cd63ed0a7fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:26.202547 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-6ca5b63a-705a-4810-9ec0-cd63ed0a7fc0 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:26.203848 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6ca5b63a-705a-4810-9ec0-cd63ed0a7fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:26.220540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef903e88-d19d-4c69-bdb6-71c6c73e48de None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:26.262934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4874ab-5ec1-4016-a2d3-28af97d90d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:26.263615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4874ab-5ec1-4016-a2d3-28af97d90d52 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:26.263944 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4874ab-5ec1-4016-a2d3-28af97d90d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:26.264217 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4874ab-5ec1-4016-a2d3-28af97d90d52 None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:26.264868 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4874ab-5ec1-4016-a2d3-28af97d90d52 None admin] RBAC: Adding query filter params (type=network) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:26.265299 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4874ab-5ec1-4016-a2d3-28af97d90d52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:26.266823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4874ab-5ec1-4016-a2d3-28af97d90d52 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:26.278006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 413/826] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 28 12:02:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:26.278006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4874ab-5ec1-4016-a2d3-28af97d90d52 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:26.290792 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 414/827] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:02:26.292003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5b63a-705a-4810-9ec0-cd63ed0a7fc0 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:26.376950 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:26.388994 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:26.400238 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5b63a-705a-4810-9ec0-cd63ed0a7fc0 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:26.436816 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4639121-22da-4d9c-bf91-645ba1465ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:26.437756 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4639121-22da-4d9c-bf91-645ba1465ee4 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:26.438061 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4874ab-5ec1-4016-a2d3-28af97d90d52 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:26.438445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4639121-22da-4d9c-bf91-645ba1465ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:26.438909 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4639121-22da-4d9c-bf91-645ba1465ee4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:26.439812 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4639121-22da-4d9c-bf91-645ba1465ee4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:26.441968 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4639121-22da-4d9c-bf91-645ba1465ee4 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:26.463013 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 415/828] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:02:26 2022] POST /identity/v3/endpoints => generated 337 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:02:26.492967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62733dc-f336-4044-a78a-254f66bf0ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:26.493605 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62733dc-f336-4044-a78a-254f66bf0ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:26.493888 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62733dc-f336-4044-a78a-254f66bf0ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:26.494182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62733dc-f336-4044-a78a-254f66bf0ce7 None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:26.495016 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62733dc-f336-4044-a78a-254f66bf0ce7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:26.495400 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62733dc-f336-4044-a78a-254f66bf0ce7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:26.496873 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62733dc-f336-4044-a78a-254f66bf0ce7 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:26.521324 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 414/829] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Sep 28 12:02:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:26.527267 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4639121-22da-4d9c-bf91-645ba1465ee4 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:26.603068 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62733dc-f336-4044-a78a-254f66bf0ce7 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:26.719591 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4639121-22da-4d9c-bf91-645ba1465ee4 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:26.747622 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62733dc-f336-4044-a78a-254f66bf0ce7 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:26.751071 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:26.770837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c2295-b338-4b08-ba84-c6cb0af13119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:26.771505 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c2295-b338-4b08-ba84-c6cb0af13119 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:26.771789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c2295-b338-4b08-ba84-c6cb0af13119 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:26.772238 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c2295-b338-4b08-ba84-c6cb0af13119 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:26.787304 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c2295-b338-4b08-ba84-c6cb0af13119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:26.788797 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c2295-b338-4b08-ba84-c6cb0af13119 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:26.797728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce9393-3e73-4eab-b517-8fd35a464c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:26.798704 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:26.799497 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce9393-3e73-4eab-b517-8fd35a464c21 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:26.800084 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce9393-3e73-4eab-b517-8fd35a464c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:26.801198 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce9393-3e73-4eab-b517-8fd35a464c21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:26.808768 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-e55c2295-b338-4b08-ba84-c6cb0af13119 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:26.808768 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:26.808768 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:26.808768 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:26.808768 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:26.808768 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:26.808768 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:26.808768 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:26.808768 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:26.808768 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:26.808768 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:26.808768 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:26.808768 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:26.808768 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:26.808768 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:26.808768 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:26.809912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:26.809912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:26.809912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:26.809912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:26.809912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:26.809912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:26.809912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:26.809912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:26.809912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:26.809912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:26.809912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:26.809912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:26.809912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:26.809912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:26.809912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:26.809912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:26.809912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:26.810804 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:26.810804 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:26.810804 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:26.813679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 416/830] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:26.819835 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c2295-b338-4b08-ba84-c6cb0af13119 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:26.825325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce9393-3e73-4eab-b517-8fd35a464c21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:02:26.830387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-84ce9393-3e73-4eab-b517-8fd35a464c21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:02:26.830387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:26.830387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:26.830387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:26.830387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:26.830387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:26.830387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:26.830387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:26.830387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:26.830387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:26.830387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:26.830387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:26.830387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:02:26.830387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:02:26.830387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:02:26.830387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:02:26.831573 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:02:26.831573 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:02:26.831573 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:02:26.831573 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:02:26.831573 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:26.831573 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:26.831573 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:26.831573 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:26.831573 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:26.831573 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:26.831573 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:26.831573 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:26.831573 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:26.831573 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:26.831573 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:26.831573 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:26.832416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:26.832416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:26.832416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:26.832416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:26.832416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:02:26.832416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:02:26.832416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:02:26.832416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:02:26.832416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:02:26.832416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:02:26.832416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:02:26.832416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:26.836431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 415/831] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:02:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:26.838634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce9393-3e73-4eab-b517-8fd35a464c21 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:26.945171 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c2295-b338-4b08-ba84-c6cb0af13119 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:26.964005 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce9393-3e73-4eab-b517-8fd35a464c21 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:26.987205 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91110e3-4c43-4185-85e4-fbea5e66b6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:26.988404 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91110e3-4c43-4185-85e4-fbea5e66b6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:26.988685 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91110e3-4c43-4185-85e4-fbea5e66b6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:26.988958 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91110e3-4c43-4185-85e4-fbea5e66b6e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:26.989609 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91110e3-4c43-4185-85e4-fbea5e66b6e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:26.989914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91110e3-4c43-4185-85e4-fbea5e66b6e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:26.991564 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91110e3-4c43-4185-85e4-fbea5e66b6e2 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:27.008137 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 417/832] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:27.012902 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2f72c-4cb8-4c57-a571-b40ce2f08188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:27.013517 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2f72c-4cb8-4c57-a571-b40ce2f08188 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:27.013791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2f72c-4cb8-4c57-a571-b40ce2f08188 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:27.014059 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2f72c-4cb8-4c57-a571-b40ce2f08188 None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:27.014718 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2f72c-4cb8-4c57-a571-b40ce2f08188 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:27.015015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2f72c-4cb8-4c57-a571-b40ce2f08188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:27.016578 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2f72c-4cb8-4c57-a571-b40ce2f08188 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:27.017763 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91110e3-4c43-4185-85e4-fbea5e66b6e2 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:27.031465 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 416/833] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:02:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:27.033279 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2f72c-4cb8-4c57-a571-b40ce2f08188 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:27.063881 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:27.085720 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:27.137073 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91110e3-4c43-4185-85e4-fbea5e66b6e2 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:27.147327 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2f72c-4cb8-4c57-a571-b40ce2f08188 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:27.176672 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19605ab4-e93f-4cfa-a7e1-cc05409a95ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:27.177793 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19605ab4-e93f-4cfa-a7e1-cc05409a95ef None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:27.178330 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19605ab4-e93f-4cfa-a7e1-cc05409a95ef None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:27.178706 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19605ab4-e93f-4cfa-a7e1-cc05409a95ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:27.182610 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955c49a-d36d-413d-8ed3-64a0d203aa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:27.183515 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955c49a-d36d-413d-8ed3-64a0d203aa45 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:27.183937 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955c49a-d36d-413d-8ed3-64a0d203aa45 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:27.184347 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955c49a-d36d-413d-8ed3-64a0d203aa45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:27.187456 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19605ab4-e93f-4cfa-a7e1-cc05409a95ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:27.189000 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19605ab4-e93f-4cfa-a7e1-cc05409a95ef None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:27.196342 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955c49a-d36d-413d-8ed3-64a0d203aa45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:27.197966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955c49a-d36d-413d-8ed3-64a0d203aa45 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:27.201872 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-19605ab4-e93f-4cfa-a7e1-cc05409a95ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:27.201872 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:27.201872 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:27.201872 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:27.201872 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:27.201872 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:27.201872 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:27.201872 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:27.201872 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:27.201872 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:27.201872 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:27.201872 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:27.201872 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:02:27.201872 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:02:27.201872 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:02:27.202907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:02:27.202907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:27.202907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:27.202907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:27.202907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:27.202907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:27.202907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:27.202907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:27.202907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:27.202907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:27.202907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:27.202907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:27.202907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:27.202907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:27.202907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:27.202907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:27.202907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:27.203847 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:02:27.203847 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:02:27.203847 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:02:27.203847 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:02:27.203847 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:02:27.203847 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:02:27.203847 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:27.203847 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:27.209252 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 418/834] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:27.210619 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19605ab4-e93f-4cfa-a7e1-cc05409a95ef None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:27.216788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-2955c49a-d36d-413d-8ed3-64a0d203aa45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:27.216788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:27.216788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:27.216788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:27.216788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:27.216788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:27.216788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:27.216788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:27.216788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:27.216788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:27.216788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:27.216788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:27.216788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:27.216788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:27.216788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:27.216788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:27.217728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:27.217728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:27.217728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:27.217728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:27.217728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:27.217728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:27.217728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:27.217728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:27.217728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:27.217728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:27.217728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:27.217728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:27.217728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:27.217728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:27.217728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:27.217728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:27.217728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:27.218630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:27.218630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:27.218630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:27.220757 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 417/835] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:27.227848 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955c49a-d36d-413d-8ed3-64a0d203aa45 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:27.332184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19605ab4-e93f-4cfa-a7e1-cc05409a95ef None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:27.344023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:27.354249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:27.374937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916e09d-5133-4638-9aff-341c2f7a5876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:27.375610 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916e09d-5133-4638-9aff-341c2f7a5876 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:27.375892 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916e09d-5133-4638-9aff-341c2f7a5876 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:27.376222 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916e09d-5133-4638-9aff-341c2f7a5876 None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:27.376934 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916e09d-5133-4638-9aff-341c2f7a5876 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:27.377368 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916e09d-5133-4638-9aff-341c2f7a5876 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:27.379634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916e09d-5133-4638-9aff-341c2f7a5876 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:27.381065 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955c49a-d36d-413d-8ed3-64a0d203aa45 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:27.401130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 419/836] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:02:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:27.402593 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916e09d-5133-4638-9aff-341c2f7a5876 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:27.428099 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae7ffc-69fd-424d-8114-d90b72c0e6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:27.429240 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae7ffc-69fd-424d-8114-d90b72c0e6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:27.430050 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae7ffc-69fd-424d-8114-d90b72c0e6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:27.430626 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae7ffc-69fd-424d-8114-d90b72c0e6d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:27.431531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae7ffc-69fd-424d-8114-d90b72c0e6d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:27.432219 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae7ffc-69fd-424d-8114-d90b72c0e6d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:27.434382 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae7ffc-69fd-424d-8114-d90b72c0e6d6 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:27.451706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 418/837] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:27.457979 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae7ffc-69fd-424d-8114-d90b72c0e6d6 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:27.521820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916e09d-5133-4638-9aff-341c2f7a5876 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:27.562839 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf1c45a-fca4-4064-9de1-26b8c27d4f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:27.563991 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1c45a-fca4-4064-9de1-26b8c27d4f5a None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:27.564456 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1c45a-fca4-4064-9de1-26b8c27d4f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:27.564991 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1c45a-fca4-4064-9de1-26b8c27d4f5a None admin] PATH_INFO: `/v3/projects/c854d366f35145e8b2fadb9b014d0199/users/c0e57ea982d349c1a86b544e9a6e7758/roles/9b8671e5f63c4b08982273f189eab5ec` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:27.585641 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf1c45a-fca4-4064-9de1-26b8c27d4f5a None admin] RBAC: Authorizing `identity:create_grant(project_id=c854d366f35145e8b2fadb9b014d0199, user_id=c0e57ea982d349c1a86b544e9a6e7758, role_id=9b8671e5f63c4b08982273f189eab5ec)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:27.587387 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf1c45a-fca4-4064-9de1-26b8c27d4f5a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:27.602846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 420/838] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 28 12:02:27 2022] PUT /identity/v3/projects/c854d366f35145e8b2fadb9b014d0199/users/c0e57ea982d349c1a86b544e9a6e7758/roles/9b8671e5f63c4b08982273f189eab5ec => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:02:27.674176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035a0c5-899d-4a41-928a-bd0ca82959c0 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:27.674536 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035a0c5-899d-4a41-928a-bd0ca82959c0 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:27.674732 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035a0c5-899d-4a41-928a-bd0ca82959c0 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:27.676454 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 421/839] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:02:27.682247 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd53359-fa7d-48dd-b7b7-35444af70eac None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:27.682534 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd53359-fa7d-48dd-b7b7-35444af70eac None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:27.682811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd53359-fa7d-48dd-b7b7-35444af70eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:27.707470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-1cd53359-fa7d-48dd-b7b7-35444af70eac None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:27.708855 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-1cd53359-fa7d-48dd-b7b7-35444af70eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:27.740108 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae7ffc-69fd-424d-8114-d90b72c0e6d6 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:27.746452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:27.786695 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997331b-ff07-4f27-9c40-a4bd80d5b3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:27.787238 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997331b-ff07-4f27-9c40-a4bd80d5b3ae None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:27.788267 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997331b-ff07-4f27-9c40-a4bd80d5b3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:27.788267 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997331b-ff07-4f27-9c40-a4bd80d5b3ae None admin] PATH_INFO: `/v3/users/swift` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:27.797819 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997331b-ff07-4f27-9c40-a4bd80d5b3ae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:27.799269 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997331b-ff07-4f27-9c40-a4bd80d5b3ae None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:27.801908 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:27.812047 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 422/840] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:02:27.816313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-4997331b-ff07-4f27-9c40-a4bd80d5b3ae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 28 12:02:27.816313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:27.816313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:27.816313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:27.816313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:27.816313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:27.816313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:27.816313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:27.816313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:27.816313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:27.816313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:27.816313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:27.816313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:02:27.816313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:02:27.816313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:02:27.816313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:02:27.817272 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:27.817272 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:27.817272 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:02:27.817272 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:27.817272 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:02:27.817272 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:27.817272 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:27.817272 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:27.817272 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:27.817272 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:27.817272 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:27.817272 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:27.817272 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:27.817272 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:27.817272 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:27.817272 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:27.817272 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:27.817272 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:27.818325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:27.818325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:27.818325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:02:27.818325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:02:27.818325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:02:27.818325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:02:27.818325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:02:27.818325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:02:27.818325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 28 12:02:27.818325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:27.824816 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 419/841] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:02:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:27.827104 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd53359-fa7d-48dd-b7b7-35444af70eac None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:27.935248 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd53359-fa7d-48dd-b7b7-35444af70eac None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:27.971752 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcde57c-6de7-4ec3-ac27-af820ad9f9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:27.972876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcde57c-6de7-4ec3-ac27-af820ad9f9eb None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:27.973185 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcde57c-6de7-4ec3-ac27-af820ad9f9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:27.974118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcde57c-6de7-4ec3-ac27-af820ad9f9eb None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:27.974118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcde57c-6de7-4ec3-ac27-af820ad9f9eb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:27.974419 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcde57c-6de7-4ec3-ac27-af820ad9f9eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:27.976127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcde57c-6de7-4ec3-ac27-af820ad9f9eb None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:27.998916 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 423/842] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Sep 28 12:02:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:28.000309 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997331b-ff07-4f27-9c40-a4bd80d5b3ae None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:28.093728 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcde57c-6de7-4ec3-ac27-af820ad9f9eb None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:28.112845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997331b-ff07-4f27-9c40-a4bd80d5b3ae None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:28.116324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:28.149466 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5c090-0ccc-448c-b6a8-364c993a01c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:28.149897 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5c090-0ccc-448c-b6a8-364c993a01c4 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:28.150180 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5c090-0ccc-448c-b6a8-364c993a01c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:28.150460 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5c090-0ccc-448c-b6a8-364c993a01c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:28.215973 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcde57c-6de7-4ec3-ac27-af820ad9f9eb None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:28.219866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:28.224717 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5c090-0ccc-448c-b6a8-364c993a01c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:28.226399 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5c090-0ccc-448c-b6a8-364c993a01c4 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:28.263772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e03c85-09be-466d-af3d-7e81acac7180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:28.264730 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e03c85-09be-466d-af3d-7e81acac7180 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:28.265098 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e03c85-09be-466d-af3d-7e81acac7180 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:28.265474 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e03c85-09be-466d-af3d-7e81acac7180 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:28.266867 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e03c85-09be-466d-af3d-7e81acac7180 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:28.268279 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e03c85-09be-466d-af3d-7e81acac7180 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:28.280770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-f8e03c85-09be-466d-af3d-7e81acac7180 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 28 12:02:28.280770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:28.280770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:02:28.280770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:02:28.280770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:02:28.280770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:02:28.280770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:02:28.280770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:28.280770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 28 12:02:28.280770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:28.280770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:02:28.280770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:28.280770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:28.280770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:28.280770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:28.280770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:28.280770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:28.281829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:28.281829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:28.281829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:28.281829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:28.281829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:28.281829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:28.281829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:02:28.281829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:02:28.281829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:02:28.281829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:02:28.281829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:28.281829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:28.281829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:28.281829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:28.281829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:28.281829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:28.282695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:28.282695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:28.282695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:28.282695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:28.282695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:28.282695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:28.282695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:28.282695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:28.282695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:28.282695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:28.282695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:02:28.282695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:28.282695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 28 12:02:28.282695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:28.290039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 424/843] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 28 12:02:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:28.292406 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e03c85-09be-466d-af3d-7e81acac7180 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:28.355612 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 420/844] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:02:27 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:02:28.361209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5c090-0ccc-448c-b6a8-364c993a01c4 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:28.391863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:28.420181 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e03c85-09be-466d-af3d-7e81acac7180 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:28.461667 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe6a7c-268c-4ba3-87b1-a71a464fb4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:28.462288 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe6a7c-268c-4ba3-87b1-a71a464fb4fc None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:28.462570 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe6a7c-268c-4ba3-87b1-a71a464fb4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:28.462844 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe6a7c-268c-4ba3-87b1-a71a464fb4fc None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:28.463499 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe6a7c-268c-4ba3-87b1-a71a464fb4fc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:28.463910 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe6a7c-268c-4ba3-87b1-a71a464fb4fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:28.465390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe6a7c-268c-4ba3-87b1-a71a464fb4fc None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:28.474840 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 425/845] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 28 12:02:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:28.477389 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe6a7c-268c-4ba3-87b1-a71a464fb4fc None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:28.484504 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:28.488898 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5c090-0ccc-448c-b6a8-364c993a01c4 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:28.534044 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165285bf-6762-49db-be07-728310263d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:28.535354 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165285bf-6762-49db-be07-728310263d1c None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:28.535785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165285bf-6762-49db-be07-728310263d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:28.536162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165285bf-6762-49db-be07-728310263d1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:28.553078 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165285bf-6762-49db-be07-728310263d1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:28.555377 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165285bf-6762-49db-be07-728310263d1c None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:28.575691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-165285bf-6762-49db-be07-728310263d1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:28.575691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:28.575691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:28.575691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:28.575691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:28.575691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:28.575691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:28.575691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:28.575691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:28.575691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:28.575691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:28.575691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:28.575691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:28.575691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:28.575691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:28.575691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:28.577268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:28.577268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:28.577268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:28.577268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:28.577268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:28.577268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:28.577268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:28.577268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:28.577268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:28.577268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:28.577268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:28.577268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:28.577268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:28.577268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:28.577268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:28.577268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:28.577268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:28.578530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:28.578530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:28.578530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:28.582692 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 421/846] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:28.584066 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165285bf-6762-49db-be07-728310263d1c None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:28.637836 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe6a7c-268c-4ba3-87b1-a71a464fb4fc None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:28.682815 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16a7e1-8982-4777-b7e4-5aa3dcc248b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:28.683512 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16a7e1-8982-4777-b7e4-5aa3dcc248b8 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:28.683866 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16a7e1-8982-4777-b7e4-5aa3dcc248b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:28.684260 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16a7e1-8982-4777-b7e4-5aa3dcc248b8 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:28.684974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16a7e1-8982-4777-b7e4-5aa3dcc248b8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:28.685414 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16a7e1-8982-4777-b7e4-5aa3dcc248b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:28.686856 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16a7e1-8982-4777-b7e4-5aa3dcc248b8 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:28.699475 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 426/847] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 28 12:02:28 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:28.723640 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165285bf-6762-49db-be07-728310263d1c None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:28.745096 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00171d11-222e-43b9-b406-4bed4ecd6762 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:28.745382 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00171d11-222e-43b9-b406-4bed4ecd6762 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:28.745663 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00171d11-222e-43b9-b406-4bed4ecd6762 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:28.747336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 427/848] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:02:28.753160 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc7083-76b4-4d77-ada2-565b7bfc65ee None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:28.753767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc7083-76b4-4d77-ada2-565b7bfc65ee None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:28.754295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc7083-76b4-4d77-ada2-565b7bfc65ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:28.774912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-73fc7083-76b4-4d77-ada2-565b7bfc65ee None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:28.776540 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-73fc7083-76b4-4d77-ada2-565b7bfc65ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:28.776729 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02dc60e-23b8-417f-adc3-d15e3c57fd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:28.777354 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dc60e-23b8-417f-adc3-d15e3c57fd66 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:28.777634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dc60e-23b8-417f-adc3-d15e3c57fd66 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:28.777909 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dc60e-23b8-417f-adc3-d15e3c57fd66 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:28.778572 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02dc60e-23b8-417f-adc3-d15e3c57fd66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:28.778881 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02dc60e-23b8-417f-adc3-d15e3c57fd66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:28.780451 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02dc60e-23b8-417f-adc3-d15e3c57fd66 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:28.790792 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:28.803780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 422/849] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:28.805692 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02dc60e-23b8-417f-adc3-d15e3c57fd66 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:28.820143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:28.861675 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 428/850] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:02:28.920070 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02dc60e-23b8-417f-adc3-d15e3c57fd66 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:28.955815 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2de6d-5d37-441c-9d78-c436578f802b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:28.957412 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2de6d-5d37-441c-9d78-c436578f802b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:28.957913 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2de6d-5d37-441c-9d78-c436578f802b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:28.958384 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2de6d-5d37-441c-9d78-c436578f802b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:28.965644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2de6d-5d37-441c-9d78-c436578f802b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:28.967365 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2de6d-5d37-441c-9d78-c436578f802b None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:28.979956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-6da2de6d-5d37-441c-9d78-c436578f802b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:28.979956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:28.979956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:28.979956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:28.979956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:28.979956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:28.979956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:28.979956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:28.979956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:28.979956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:28.979956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:28.979956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:28.979956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:02:28.979956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:02:28.979956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:02:28.980900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:02:28.980900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:28.980900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:28.980900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:28.980900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:28.980900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:28.980900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:28.980900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:28.980900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:28.980900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:28.980900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:28.980900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:28.980900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:28.980900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:28.980900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:28.980900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:28.980900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:28.981812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:02:28.981812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:02:28.981812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:02:28.981812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:02:28.981812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:02:28.981812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:02:28.981812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:28.981812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:28.988015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 423/851] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:28.991347 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc7083-76b4-4d77-ada2-565b7bfc65ee None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:29.093981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc7083-76b4-4d77-ada2-565b7bfc65ee None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:29.130321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b3f5c-45e1-4745-ba3e-bda9079ef155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:29.130931 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b3f5c-45e1-4745-ba3e-bda9079ef155 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:29.131212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b3f5c-45e1-4745-ba3e-bda9079ef155 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:29.131508 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b3f5c-45e1-4745-ba3e-bda9079ef155 None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:29.132204 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b3f5c-45e1-4745-ba3e-bda9079ef155 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:29.132507 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b3f5c-45e1-4745-ba3e-bda9079ef155 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:29.133934 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b3f5c-45e1-4745-ba3e-bda9079ef155 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:29.140646 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:29.146308 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 429/852] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:02:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:29.152879 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2de6d-5d37-441c-9d78-c436578f802b None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:29.158727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b3f5c-45e1-4745-ba3e-bda9079ef155 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:29.238591 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:29.278016 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2de6d-5d37-441c-9d78-c436578f802b None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:29.286187 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b3f5c-45e1-4745-ba3e-bda9079ef155 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:29.323964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7beca-5be2-4872-bafa-e02213a0acac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:29.324574 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7beca-5be2-4872-bafa-e02213a0acac None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:29.324850 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7beca-5be2-4872-bafa-e02213a0acac None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:29.325118 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7beca-5be2-4872-bafa-e02213a0acac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:29.325846 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7beca-5be2-4872-bafa-e02213a0acac None admin] RBAC: Adding query filter params (role.id=66456d39fc0c496c8f290a436b726216, scope.project.id=c854d366f35145e8b2fadb9b014d0199, user.id=822e394e80fd41adb54d330adaf65a68) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:29.326152 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7beca-5be2-4872-bafa-e02213a0acac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:29.327236 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf42a52-477d-43dc-bf1a-d057baa64ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:29.327600 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7beca-5be2-4872-bafa-e02213a0acac None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:29.328373 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf42a52-477d-43dc-bf1a-d057baa64ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:29.328852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf42a52-477d-43dc-bf1a-d057baa64ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:29.329335 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf42a52-477d-43dc-bf1a-d057baa64ff7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:29.330187 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf42a52-477d-43dc-bf1a-d057baa64ff7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:29.332409 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf42a52-477d-43dc-bf1a-d057baa64ff7 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:29.335480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 424/853] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:02:29 2022] GET /identity/v3/role_assignments?user.id=822e394e80fd41adb54d330adaf65a68&scope.project.id=c854d366f35145e8b2fadb9b014d0199&role.id=66456d39fc0c496c8f290a436b726216 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:29.352795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-5cf42a52-477d-43dc-bf1a-d057baa64ff7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 28 12:02:29.352795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:29.352795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:02:29.352795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:02:29.352795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:02:29.352795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:02:29.352795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:02:29.352795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:29.352795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 28 12:02:29.352795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:29.352795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:02:29.352795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:29.352795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:29.352795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:29.352795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:29.352795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:29.353858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:29.353858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:29.353858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:29.353858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:29.353858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:29.353858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:29.353858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:29.353858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:02:29.353858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:02:29.353858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:02:29.353858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:02:29.353858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:29.353858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:29.353858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:29.353858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:29.353858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:29.353858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:29.354802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:29.354802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:29.354802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:29.354802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:29.354802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:29.354802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:29.354802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:29.354802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:29.354802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:29.354802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:29.354802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:02:29.354802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:29.354802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 28 12:02:29.354802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:29.357918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 430/854] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Sep 28 12:02:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:29.364836 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7beca-5be2-4872-bafa-e02213a0acac None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:29.485297 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7beca-5be2-4872-bafa-e02213a0acac None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:29.525701 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39ab48-69d9-4910-bd03-ed507f2202ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:29.526324 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39ab48-69d9-4910-bd03-ed507f2202ab None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:29.526602 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39ab48-69d9-4910-bd03-ed507f2202ab None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:29.526874 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39ab48-69d9-4910-bd03-ed507f2202ab None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:29.527542 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39ab48-69d9-4910-bd03-ed507f2202ab None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:29.527851 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39ab48-69d9-4910-bd03-ed507f2202ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:29.529326 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39ab48-69d9-4910-bd03-ed507f2202ab None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:29.530564 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:29.540407 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf42a52-477d-43dc-bf1a-d057baa64ff7 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:29.540829 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 425/855] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 28 12:02:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:29.607901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:29.655964 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf42a52-477d-43dc-bf1a-d057baa64ff7 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:29.692839 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996dd003-391f-4d08-9c45-84e4805fd536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:29.693813 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996dd003-391f-4d08-9c45-84e4805fd536 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:29.694299 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996dd003-391f-4d08-9c45-84e4805fd536 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:29.694770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996dd003-391f-4d08-9c45-84e4805fd536 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:29.695664 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996dd003-391f-4d08-9c45-84e4805fd536 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:29.696194 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996dd003-391f-4d08-9c45-84e4805fd536 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:29.697760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996dd003-391f-4d08-9c45-84e4805fd536 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:29.715622 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 431/856] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 28 12:02:29 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:29.842575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda21c6-c30b-4f36-9cc2-9d4c20841eb2 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:29.842774 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda21c6-c30b-4f36-9cc2-9d4c20841eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:29.843031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda21c6-c30b-4f36-9cc2-9d4c20841eb2 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:29.844683 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 426/857] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:29.851031 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df42d6-b728-4586-a9db-c3fc40917325 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:29.851309 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df42d6-b728-4586-a9db-c3fc40917325 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:29.851617 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df42d6-b728-4586-a9db-c3fc40917325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:29.872870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-c2df42d6-b728-4586-a9db-c3fc40917325 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:29.874470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c2df42d6-b728-4586-a9db-c3fc40917325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:29.954679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 432/858] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:02:30.224875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda21c6-c30b-4f36-9cc2-9d4c20841eb2 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:30.331729 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda21c6-c30b-4f36-9cc2-9d4c20841eb2 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:30.371914 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061046ef-c80d-4589-b2cf-7e087caae5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:30.372549 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061046ef-c80d-4589-b2cf-7e087caae5bc None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:30.372827 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061046ef-c80d-4589-b2cf-7e087caae5bc None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:30.373096 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061046ef-c80d-4589-b2cf-7e087caae5bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:30.384486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061046ef-c80d-4589-b2cf-7e087caae5bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:02:30.389232 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-061046ef-c80d-4589-b2cf-7e087caae5bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:02:30.389232 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:30.389232 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:30.389232 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:30.389232 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:30.389232 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:30.389232 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:30.389232 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:30.389232 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:30.389232 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:30.389232 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:30.389232 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:30.389232 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:02:30.389232 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:02:30.389232 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:02:30.389232 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:02:30.390162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:02:30.390162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:02:30.390162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:02:30.390162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:02:30.390162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:30.390162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:30.390162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:30.390162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:30.390162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:30.390162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:30.390162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:30.390162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:30.390162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:30.390162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:30.390162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:30.390162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:30.391171 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:30.391171 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:30.391171 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:30.391171 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:30.391171 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:02:30.391171 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:02:30.391171 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:02:30.391171 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:02:30.391171 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:02:30.391171 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:02:30.391171 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:02:30.391171 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:30.391171 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 427/859] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 28 12:02:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:30.396493 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df42d6-b728-4586-a9db-c3fc40917325 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:30.456067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:30.503719 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df42d6-b728-4586-a9db-c3fc40917325 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:30.539924 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d000ee5-0744-47fb-89f7-e7e4e780f552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:30.540584 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d000ee5-0744-47fb-89f7-e7e4e780f552 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:30.540858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d000ee5-0744-47fb-89f7-e7e4e780f552 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:30.541126 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d000ee5-0744-47fb-89f7-e7e4e780f552 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:30.541823 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d000ee5-0744-47fb-89f7-e7e4e780f552 None admin] RBAC: Adding query filter params (name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:30.542125 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d000ee5-0744-47fb-89f7-e7e4e780f552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:30.543483 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d000ee5-0744-47fb-89f7-e7e4e780f552 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:30.552859 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 433/860] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 28 12:02:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:30.558462 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061046ef-c80d-4589-b2cf-7e087caae5bc None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:30.621615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:30.664586 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061046ef-c80d-4589-b2cf-7e087caae5bc None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:30.707139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd72a7-d8e1-41f4-ab16-8936af10e18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:30.707823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd72a7-d8e1-41f4-ab16-8936af10e18b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:30.708104 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd72a7-d8e1-41f4-ab16-8936af10e18b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:30.708372 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd72a7-d8e1-41f4-ab16-8936af10e18b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:30.720097 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd72a7-d8e1-41f4-ab16-8936af10e18b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:30.721711 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd72a7-d8e1-41f4-ab16-8936af10e18b None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:30.738674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-0fdd72a7-d8e1-41f4-ab16-8936af10e18b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:30.738674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:30.738674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:30.738674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:30.738674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:30.738674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:30.738674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:30.738674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:30.738674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:30.738674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:30.738674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:30.738674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:30.738674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:30.738674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:30.738674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:30.738674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:30.740090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:30.740090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:30.740090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:30.740090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:30.740090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:30.740090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:30.740090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:30.740090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:30.740090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:30.740090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:30.740090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:30.740090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:30.740090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:30.740090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:30.740090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:30.740090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:30.740090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:30.741006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:30.741006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:30.741006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:30.741006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 428/861] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:30.744672 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d000ee5-0744-47fb-89f7-e7e4e780f552 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:30.856331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d000ee5-0744-47fb-89f7-e7e4e780f552 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:30.876704 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:30.895548 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a7310-8ef6-416d-b01f-c9a24e00689a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:30.896153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a7310-8ef6-416d-b01f-c9a24e00689a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:30.896428 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a7310-8ef6-416d-b01f-c9a24e00689a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:30.896697 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a7310-8ef6-416d-b01f-c9a24e00689a None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:30.897339 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a7310-8ef6-416d-b01f-c9a24e00689a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:30.897639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a7310-8ef6-416d-b01f-c9a24e00689a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:30.898986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a7310-8ef6-416d-b01f-c9a24e00689a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:30.911830 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 434/862] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:30.917324 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd72a7-d8e1-41f4-ab16-8936af10e18b None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:30.967690 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82c0f0-8448-4680-8de5-8b04ac488b04 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:30.968035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82c0f0-8448-4680-8de5-8b04ac488b04 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:30.968224 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82c0f0-8448-4680-8de5-8b04ac488b04 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:30.969829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 435/863] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:02:30.976894 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418aa40-c6d2-45cd-aeab-64f93848e695 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:30.977276 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418aa40-c6d2-45cd-aeab-64f93848e695 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:30.977632 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418aa40-c6d2-45cd-aeab-64f93848e695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:30.999583 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-c418aa40-c6d2-45cd-aeab-64f93848e695 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:31.000898 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c418aa40-c6d2-45cd-aeab-64f93848e695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:31.034893 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd72a7-d8e1-41f4-ab16-8936af10e18b None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:31.048797 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:31.078897 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb477f5-ec18-482d-9f7f-1907f09d98fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:31.080063 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb477f5-ec18-482d-9f7f-1907f09d98fe None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:31.080541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb477f5-ec18-482d-9f7f-1907f09d98fe None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:31.081498 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb477f5-ec18-482d-9f7f-1907f09d98fe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:31.089938 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb477f5-ec18-482d-9f7f-1907f09d98fe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:31.091692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 436/864] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:02:31.092015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb477f5-ec18-482d-9f7f-1907f09d98fe None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:31.104450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-0bb477f5-ec18-482d-9f7f-1907f09d98fe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 12:02:31.104450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:31.104450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:31.104450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:31.104450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:31.104450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:31.104450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:31.104450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:31.104450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:31.104450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:31.104450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:31.104450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:31.104450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:02:31.104450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:02:31.104450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:02:31.104450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:02:31.105454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:31.105454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:31.105454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:02:31.105454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:31.105454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:02:31.105454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:31.105454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:31.105454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:31.105454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:31.105454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:31.105454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:31.105454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:31.105454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:31.105454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:31.105454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:31.105454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:31.105454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:31.105454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:31.106451 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:31.106451 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:31.106451 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:02:31.106451 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:02:31.106451 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:02:31.106451 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:02:31.106451 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:02:31.106451 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:02:31.106451 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 12:02:31.106451 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:31.108983 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 429/865] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 28 12:02:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:31.114984 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418aa40-c6d2-45cd-aeab-64f93848e695 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:31.217226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418aa40-c6d2-45cd-aeab-64f93848e695 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:31.227066 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:31.254801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b96ab8-8902-47b1-aa51-126b7adcac89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:31.255411 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b96ab8-8902-47b1-aa51-126b7adcac89 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:31.255713 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b96ab8-8902-47b1-aa51-126b7adcac89 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:31.255982 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b96ab8-8902-47b1-aa51-126b7adcac89 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:31.256761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b96ab8-8902-47b1-aa51-126b7adcac89 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:31.257062 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b96ab8-8902-47b1-aa51-126b7adcac89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:31.258530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b96ab8-8902-47b1-aa51-126b7adcac89 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:31.276681 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 437/866] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Sep 28 12:02:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:31.282266 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb477f5-ec18-482d-9f7f-1907f09d98fe None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:31.365376 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b96ab8-8902-47b1-aa51-126b7adcac89 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:31.396338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb477f5-ec18-482d-9f7f-1907f09d98fe None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:31.446914 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bb616-88f8-4d47-a6ca-b0742bb52cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:31.447634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bb616-88f8-4d47-a6ca-b0742bb52cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:31.447925 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bb616-88f8-4d47-a6ca-b0742bb52cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:31.448200 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bb616-88f8-4d47-a6ca-b0742bb52cb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:31.487571 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b96ab8-8902-47b1-aa51-126b7adcac89 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:31.501512 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:31.535002 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69bb616-88f8-4d47-a6ca-b0742bb52cb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:31.536458 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69bb616-88f8-4d47-a6ca-b0742bb52cb2 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:31.539108 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26113f8-c978-49c5-991a-da09c049dfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:31.539983 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26113f8-c978-49c5-991a-da09c049dfcd None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:31.540464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26113f8-c978-49c5-991a-da09c049dfcd None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:31.540932 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26113f8-c978-49c5-991a-da09c049dfcd None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:31.541811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26113f8-c978-49c5-991a-da09c049dfcd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:31.543417 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26113f8-c978-49c5-991a-da09c049dfcd None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:31.567914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 438/867] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 28 12:02:31 2022] POST /identity/v3/services => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:02:31.656769 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 430/868] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:02:31 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:02:31.662615 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26113f8-c978-49c5-991a-da09c049dfcd None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:31.698452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:31.699632 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc557e8e-dfab-4ff3-b89d-f66bc4e5bff0 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:31.699911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc557e8e-dfab-4ff3-b89d-f66bc4e5bff0 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:31.700229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc557e8e-dfab-4ff3-b89d-f66bc4e5bff0 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:31.702257 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 431/869] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:31.708072 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99030681-1121-45cf-9171-f49867d94606 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:31.708366 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99030681-1121-45cf-9171-f49867d94606 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:31.708634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99030681-1121-45cf-9171-f49867d94606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:31.729269 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-99030681-1121-45cf-9171-f49867d94606 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:31.730642 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-99030681-1121-45cf-9171-f49867d94606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:31.812607 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26113f8-c978-49c5-991a-da09c049dfcd None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:31.816417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:31.821974 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 432/870] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:31 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:02:31.857468 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0da576-abdb-418f-a5da-e58030b91a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:31.858108 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0da576-abdb-418f-a5da-e58030b91a9a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:31.858434 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0da576-abdb-418f-a5da-e58030b91a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:31.858711 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0da576-abdb-418f-a5da-e58030b91a9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:31.869828 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0da576-abdb-418f-a5da-e58030b91a9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:31.871332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0da576-abdb-418f-a5da-e58030b91a9a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:31.887133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-fa0da576-abdb-418f-a5da-e58030b91a9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:31.887133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:31.887133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:31.887133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:31.887133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:31.887133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:31.887133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:31.887133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:31.887133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:31.887133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:31.887133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:31.887133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:31.887133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:31.887133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:31.887133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:31.887133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:31.888190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:31.888190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:31.888190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:31.888190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:31.888190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:31.888190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:31.888190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:31.888190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:31.888190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:31.888190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:31.888190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:31.888190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:31.888190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:31.888190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:31.888190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:31.888190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:31.888190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:31.889172 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:31.889172 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:31.889172 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:31.889172 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 439/871] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:31.895692 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99030681-1121-45cf-9171-f49867d94606 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:32.013114 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99030681-1121-45cf-9171-f49867d94606 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:32.049251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa027bf-cd56-4318-9d91-be26ee99c49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:32.050391 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa027bf-cd56-4318-9d91-be26ee99c49a None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:32.050675 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa027bf-cd56-4318-9d91-be26ee99c49a None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:32.050943 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa027bf-cd56-4318-9d91-be26ee99c49a None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:32.051632 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa027bf-cd56-4318-9d91-be26ee99c49a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:32.051908 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa027bf-cd56-4318-9d91-be26ee99c49a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:32.053265 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa027bf-cd56-4318-9d91-be26ee99c49a None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:32.065122 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 433/872] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:32.072567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0da576-abdb-418f-a5da-e58030b91a9a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:32.113043 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ce1f8-dd94-4561-b287-026f34b1d752 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:32.113698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ce1f8-dd94-4561-b287-026f34b1d752 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:32.114192 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ce1f8-dd94-4561-b287-026f34b1d752 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:32.116289 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 434/873] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:32.121054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ce1f8-dd94-4561-b287-026f34b1d752 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:32.154974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:32.183095 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0da576-abdb-418f-a5da-e58030b91a9a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:32.186418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:32.220311 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825c195-1977-44dc-aaf8-d01a52f77caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:32.220882 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825c195-1977-44dc-aaf8-d01a52f77caf None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:32.221158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825c195-1977-44dc-aaf8-d01a52f77caf None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:32.221442 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825c195-1977-44dc-aaf8-d01a52f77caf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:32.228312 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825c195-1977-44dc-aaf8-d01a52f77caf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:32.229735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825c195-1977-44dc-aaf8-d01a52f77caf None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:32.230287 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ce1f8-dd94-4561-b287-026f34b1d752 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:32.241749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-6825c195-1977-44dc-aaf8-d01a52f77caf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:32.241749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:32.241749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:32.241749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:32.241749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:32.241749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:32.241749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:32.241749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:32.241749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:32.241749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:32.241749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:32.241749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:32.241749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:02:32.241749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:02:32.241749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:02:32.242691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:02:32.242691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:32.242691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:32.242691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:32.242691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:32.242691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:32.242691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:32.242691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:32.242691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:32.242691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:32.242691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:32.242691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:32.242691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:32.242691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:32.242691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:32.242691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:32.242691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:32.243682 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:02:32.243682 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:02:32.243682 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:02:32.243682 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:02:32.243682 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:02:32.243682 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:02:32.243682 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:32.243682 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:32.243682 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 440/874] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:32.244191 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc12c8d-1d47-4dfa-877b-bc8da5a0274d None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:32.244271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc12c8d-1d47-4dfa-877b-bc8da5a0274d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:32.244911 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc12c8d-1d47-4dfa-877b-bc8da5a0274d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:32.263310 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-0dc12c8d-1d47-4dfa-877b-bc8da5a0274d None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:32.264471 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0dc12c8d-1d47-4dfa-877b-bc8da5a0274d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:32.272727 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3b1ce-65e7-438a-87b4-dbb1eb96a99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:32.273358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3b1ce-65e7-438a-87b4-dbb1eb96a99d None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:32.273635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3b1ce-65e7-438a-87b4-dbb1eb96a99d None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:32.273905 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3b1ce-65e7-438a-87b4-dbb1eb96a99d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:32.274489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3b1ce-65e7-438a-87b4-dbb1eb96a99d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:32.275891 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3b1ce-65e7-438a-87b4-dbb1eb96a99d None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:32.285467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-3ac3b1ce-65e7-438a-87b4-dbb1eb96a99d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:02:32.285467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:32.285467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:02:32.285467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:02:32.285467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:02:32.285467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:02:32.285467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:02:32.285467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:32.285467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:02:32.285467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:32.285467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:02:32.285467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:32.285467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:32.285467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:32.285467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:32.285467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:32.285467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:32.287910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:32.287910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:32.287910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:32.287910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:32.287910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:32.287910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:32.287910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:02:32.287910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:02:32.287910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:02:32.287910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:02:32.287910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:32.287910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:32.287910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:32.287910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:32.287910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:32.287910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:32.288813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:32.288813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:32.288813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:32.288813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:32.288813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:32.288813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:32.288813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:32.288813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:32.288813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:32.288813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:32.288813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:02:32.288813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:32.288813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:02:32.288813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:32.288813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 435/875] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 28 12:02:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:32.289631 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3b1ce-65e7-438a-87b4-dbb1eb96a99d None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:32.346358 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 441/876] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:32 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:02:32.347566 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc12c8d-1d47-4dfa-877b-bc8da5a0274d None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:32.417472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:32.419727 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3b1ce-65e7-438a-87b4-dbb1eb96a99d None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:32.454254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:32.461084 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc12c8d-1d47-4dfa-877b-bc8da5a0274d None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:32.468900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ae263-514d-4a86-bfe6-0f8eb44072a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:32.470313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ae263-514d-4a86-bfe6-0f8eb44072a6 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:32.470845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ae263-514d-4a86-bfe6-0f8eb44072a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:32.471842 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ae263-514d-4a86-bfe6-0f8eb44072a6 None admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:32.472753 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ae263-514d-4a86-bfe6-0f8eb44072a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:32.473663 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ae263-514d-4a86-bfe6-0f8eb44072a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:32.475722 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ae263-514d-4a86-bfe6-0f8eb44072a6 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:32.489412 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 436/877] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:02:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:32.495084 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ae263-514d-4a86-bfe6-0f8eb44072a6 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:32.511549 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec58d34-dc75-4ae9-b741-a3c64c1e829d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:32.512202 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec58d34-dc75-4ae9-b741-a3c64c1e829d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:32.512446 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec58d34-dc75-4ae9-b741-a3c64c1e829d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:32.512719 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec58d34-dc75-4ae9-b741-a3c64c1e829d None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:32.513472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec58d34-dc75-4ae9-b741-a3c64c1e829d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:32.513724 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec58d34-dc75-4ae9-b741-a3c64c1e829d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:32.515281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec58d34-dc75-4ae9-b741-a3c64c1e829d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:32.525985 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 442/878] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 28 12:02:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:32.529086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec58d34-dc75-4ae9-b741-a3c64c1e829d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:32.615378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ae263-514d-4a86-bfe6-0f8eb44072a6 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:32.636695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec58d34-dc75-4ae9-b741-a3c64c1e829d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:32.651571 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60964d-fa34-4d3a-8c58-d6e5248c44d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:32.652421 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60964d-fa34-4d3a-8c58-d6e5248c44d7 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:32.652850 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60964d-fa34-4d3a-8c58-d6e5248c44d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:32.653266 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60964d-fa34-4d3a-8c58-d6e5248c44d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:32.654143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60964d-fa34-4d3a-8c58-d6e5248c44d7 None admin] RBAC: Adding query filter params (role.id=9b8671e5f63c4b08982273f189eab5ec, scope.project.id=c854d366f35145e8b2fadb9b014d0199, user.id=c0e57ea982d349c1a86b544e9a6e7758) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:32.654615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60964d-fa34-4d3a-8c58-d6e5248c44d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:32.656196 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60964d-fa34-4d3a-8c58-d6e5248c44d7 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:32.662996 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 437/879] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:02:32 2022] GET /identity/v3/role_assignments?user.id=c0e57ea982d349c1a86b544e9a6e7758&scope.project.id=c854d366f35145e8b2fadb9b014d0199&role.id=9b8671e5f63c4b08982273f189eab5ec => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:32.663965 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60964d-fa34-4d3a-8c58-d6e5248c44d7 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:32.673779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:32.683705 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd640e1-4e25-4426-8d9e-bba06079977e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:32.684653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd640e1-4e25-4426-8d9e-bba06079977e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:32.685214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd640e1-4e25-4426-8d9e-bba06079977e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:32.685643 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd640e1-4e25-4426-8d9e-bba06079977e None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:32.686461 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd640e1-4e25-4426-8d9e-bba06079977e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:32.686941 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd640e1-4e25-4426-8d9e-bba06079977e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:32.688720 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd640e1-4e25-4426-8d9e-bba06079977e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:32.695139 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 443/880] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 28 12:02:32 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:32.740931 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:32.806181 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60964d-fa34-4d3a-8c58-d6e5248c44d7 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:32.847561 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f1a85-fb13-42cb-9beb-0c6d8cbcfc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:32.848201 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f1a85-fb13-42cb-9beb-0c6d8cbcfc4a None admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:32.848482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f1a85-fb13-42cb-9beb-0c6d8cbcfc4a None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:32.848755 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f1a85-fb13-42cb-9beb-0c6d8cbcfc4a None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:32.849432 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f1a85-fb13-42cb-9beb-0c6d8cbcfc4a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:32.850863 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f1a85-fb13-42cb-9beb-0c6d8cbcfc4a None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:32.871668 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 438/881] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 28 12:02:32 2022] POST /identity/v3/services => generated 269 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:02:33.829781 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8c2ac-9eb5-4d63-9d27-2d166c7e9b54 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:33.830294 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8c2ac-9eb5-4d63-9d27-2d166c7e9b54 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:33.830409 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8c2ac-9eb5-4d63-9d27-2d166c7e9b54 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:33.831980 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 444/882] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:33.839459 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd498e-c3a8-43cf-bb4b-46c8f8d8de96 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:33.839869 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd498e-c3a8-43cf-bb4b-46c8f8d8de96 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:33.840196 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd498e-c3a8-43cf-bb4b-46c8f8d8de96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:33.859247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-dfbd498e-c3a8-43cf-bb4b-46c8f8d8de96 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:33.860473 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-dfbd498e-c3a8-43cf-bb4b-46c8f8d8de96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:33.936621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 439/883] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:02:34.206252 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8c2ac-9eb5-4d63-9d27-2d166c7e9b54 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:34.311329 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8c2ac-9eb5-4d63-9d27-2d166c7e9b54 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:34.347520 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8de3e-00be-440e-8e08-486db781d756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:34.348148 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8de3e-00be-440e-8e08-486db781d756 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:34.348422 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8de3e-00be-440e-8e08-486db781d756 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:34.348684 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8de3e-00be-440e-8e08-486db781d756 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:34.349253 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8de3e-00be-440e-8e08-486db781d756 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:34.350604 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8de3e-00be-440e-8e08-486db781d756 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:34.359479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-59e8de3e-00be-440e-8e08-486db781d756 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 28 12:02:34.359479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:34.359479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:02:34.359479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:02:34.359479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:02:34.359479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:02:34.359479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:02:34.359479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:34.359479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 28 12:02:34.359479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:34.359479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:02:34.359479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:34.359479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:34.359479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:34.359479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:34.359479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:34.359479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:34.360464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:34.360464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:34.360464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:34.360464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:34.360464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:34.360464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:34.360464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:02:34.360464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:02:34.360464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:02:34.360464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:02:34.360464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:34.360464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:34.360464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:34.360464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:34.360464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:34.360464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:34.361929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:34.361929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:34.361929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:34.361929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:34.361929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:34.361929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:34.361929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:34.361929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:34.361929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:34.361929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:34.361929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:02:34.361929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:34.361929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 28 12:02:34.361929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:34.361929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 445/884] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 28 12:02:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:34.368097 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd498e-c3a8-43cf-bb4b-46c8f8d8de96 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:34.404347 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:34.477688 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd498e-c3a8-43cf-bb4b-46c8f8d8de96 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:34.514875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23adeb-9ff1-46ce-b4d6-b729cab9b47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:34.515516 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23adeb-9ff1-46ce-b4d6-b729cab9b47b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:34.515849 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23adeb-9ff1-46ce-b4d6-b729cab9b47b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:34.516123 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23adeb-9ff1-46ce-b4d6-b729cab9b47b None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:34.516754 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23adeb-9ff1-46ce-b4d6-b729cab9b47b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:34.517055 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23adeb-9ff1-46ce-b4d6-b729cab9b47b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:34.518444 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23adeb-9ff1-46ce-b4d6-b729cab9b47b None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:34.527842 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 440/885] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 28 12:02:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:34.529628 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8de3e-00be-440e-8e08-486db781d756 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:34.588475 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:34.634542 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8de3e-00be-440e-8e08-486db781d756 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:34.669850 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b36a2-da51-4eaf-aaf9-265595b46b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:34.670457 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b36a2-da51-4eaf-aaf9-265595b46b76 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:34.670731 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b36a2-da51-4eaf-aaf9-265595b46b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:34.671001 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b36a2-da51-4eaf-aaf9-265595b46b76 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:34.671655 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b36a2-da51-4eaf-aaf9-265595b46b76 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:34.671955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b36a2-da51-4eaf-aaf9-265595b46b76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:34.673377 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b36a2-da51-4eaf-aaf9-265595b46b76 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:34.678612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 446/886] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 28 12:02:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:34.684263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23adeb-9ff1-46ce-b4d6-b729cab9b47b None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:34.802856 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:34.808309 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23adeb-9ff1-46ce-b4d6-b729cab9b47b None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:34.848373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd118bc-f536-4d62-bb34-395c85a2dbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:34.849801 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd118bc-f536-4d62-bb34-395c85a2dbc2 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:34.850281 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd118bc-f536-4d62-bb34-395c85a2dbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:34.850750 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd118bc-f536-4d62-bb34-395c85a2dbc2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:34.851687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd118bc-f536-4d62-bb34-395c85a2dbc2 None admin] RBAC: Adding query filter params (interface=public, service_id=81b83e930e8e40e3877e2e896c161522, region_id=RegionOne) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:34.852296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd118bc-f536-4d62-bb34-395c85a2dbc2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:34.853884 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd118bc-f536-4d62-bb34-395c85a2dbc2 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:34.864019 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 441/887] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Sep 28 12:02:34 2022] GET /identity/v3/endpoints?service_id=81b83e930e8e40e3877e2e896c161522&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:34.865656 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b36a2-da51-4eaf-aaf9-265595b46b76 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:34.910584 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db154aa4-8c54-4011-b54f-f14474ca7b81 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:34.910921 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db154aa4-8c54-4011-b54f-f14474ca7b81 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:34.911133 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db154aa4-8c54-4011-b54f-f14474ca7b81 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:34.912857 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 442/888] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:34.918771 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68e58a-bfd0-4e7a-a1f1-b4de3ea18317 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:34.919100 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68e58a-bfd0-4e7a-a1f1-b4de3ea18317 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:34.919317 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68e58a-bfd0-4e7a-a1f1-b4de3ea18317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:34.942699 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-6f68e58a-bfd0-4e7a-a1f1-b4de3ea18317 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:34.944403 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-6f68e58a-bfd0-4e7a-a1f1-b4de3ea18317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:34.982486 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b36a2-da51-4eaf-aaf9-265595b46b76 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:35.006599 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:35.023181 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa59c8b-670e-49a1-b168-1a40ee30157d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:35.023826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa59c8b-670e-49a1-b168-1a40ee30157d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:35.024103 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa59c8b-670e-49a1-b168-1a40ee30157d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:35.024372 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa59c8b-670e-49a1-b168-1a40ee30157d None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:35.024978 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa59c8b-670e-49a1-b168-1a40ee30157d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:35.026443 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa59c8b-670e-49a1-b168-1a40ee30157d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:35.027193 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 443/889] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:02:35.028368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514be731-380c-42de-ae3e-1cc528564329 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:35.028651 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514be731-380c-42de-ae3e-1cc528564329 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:35.028947 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514be731-380c-42de-ae3e-1cc528564329 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:35.030296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 444/890] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:35.035264 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0635e-7356-42de-82ba-15e14e290d0a None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:35.035596 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0635e-7356-42de-82ba-15e14e290d0a None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:35.035875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0635e-7356-42de-82ba-15e14e290d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:35.041955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 447/891] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Sep 28 12:02:34 2022] GET /identity/v3/services => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:02:35.056087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-b0c0635e-7356-42de-82ba-15e14e290d0a None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:35.057751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b0c0635e-7356-42de-82ba-15e14e290d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:35.112046 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce083dc8-acba-4593-b032-b9ffc1a4cca9 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:35.113411 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce083dc8-acba-4593-b032-b9ffc1a4cca9 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:35.113982 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce083dc8-acba-4593-b032-b9ffc1a4cca9 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:35.117270 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 448/892] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:02:35.123107 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200841f-1ab9-4714-a2a4-e7c5c6a2b412 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:35.123799 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200841f-1ab9-4714-a2a4-e7c5c6a2b412 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:35.124419 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200841f-1ab9-4714-a2a4-e7c5c6a2b412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:35.142947 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 445/893] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:02:35.147201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-a200841f-1ab9-4714-a2a4-e7c5c6a2b412 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:35.148867 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a200841f-1ab9-4714-a2a4-e7c5c6a2b412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:35.230870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 449/894] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:02:35.316963 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0635e-7356-42de-82ba-15e14e290d0a None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:35.343277 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:35.420838 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200841f-1ab9-4714-a2a4-e7c5c6a2b412 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:35.422594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0635e-7356-42de-82ba-15e14e290d0a None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:35.461122 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cada9-e0f8-44f1-a04f-b505c40a618e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:35.461734 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cada9-e0f8-44f1-a04f-b505c40a618e None admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:35.462010 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cada9-e0f8-44f1-a04f-b505c40a618e None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:35.462278 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cada9-e0f8-44f1-a04f-b505c40a618e None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:35.462928 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cada9-e0f8-44f1-a04f-b505c40a618e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:35.464537 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cada9-e0f8-44f1-a04f-b505c40a618e None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:35.488791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 446/895] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 28 12:02:35 2022] POST /identity/v3/services => generated 241 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:02:35.498431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cada9-e0f8-44f1-a04f-b505c40a618e None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:35.556143 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200841f-1ab9-4714-a2a4-e7c5c6a2b412 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:35.573906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:35.605099 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a9183-767e-4dda-bed3-21a6ad6125a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:35.606732 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a9183-767e-4dda-bed3-21a6ad6125a7 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:35.607013 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a9183-767e-4dda-bed3-21a6ad6125a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:35.607289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a9183-767e-4dda-bed3-21a6ad6125a7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:35.622102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:35.624128 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a9183-767e-4dda-bed3-21a6ad6125a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:02:35.632374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-233a9183-767e-4dda-bed3-21a6ad6125a7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 12:02:35.632374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:35.632374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:35.632374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:35.632374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:35.632374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:35.632374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:35.632374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:35.632374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:35.632374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:35.632374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:35.632374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:35.632374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:02:35.632374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:02:35.632374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:02:35.632374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:02:35.633699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:02:35.633699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:02:35.633699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:02:35.633699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:02:35.633699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:35.633699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:35.633699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:35.633699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:35.633699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:35.633699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:35.633699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:35.633699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:35.633699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:35.633699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:35.633699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:35.633699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:35.634770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:35.634770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:35.634770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:35.634770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:35.634770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:02:35.634770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:02:35.634770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:02:35.634770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:02:35.634770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:02:35.634770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:02:35.634770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 12:02:35.634770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:35.638051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 450/896] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Sep 28 12:02:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:35.643720 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a9183-767e-4dda-bed3-21a6ad6125a7 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:35.651939 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cada9-e0f8-44f1-a04f-b505c40a618e None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:35.706875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb9fc7-df46-4357-9db3-11f1a011740b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:35.707556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb9fc7-df46-4357-9db3-11f1a011740b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:35.707836 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb9fc7-df46-4357-9db3-11f1a011740b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:35.708104 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb9fc7-df46-4357-9db3-11f1a011740b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:35.708685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb9fc7-df46-4357-9db3-11f1a011740b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:35.710059 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb9fc7-df46-4357-9db3-11f1a011740b None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:35.723054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-16cb9fc7-df46-4357-9db3-11f1a011740b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 28 12:02:35.723054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:35.723054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:02:35.723054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:02:35.723054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:02:35.723054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:02:35.723054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:02:35.723054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:35.723054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 28 12:02:35.723054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:35.723054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:02:35.723054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:35.723054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:35.723054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:35.723054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:35.723054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:35.724210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:35.724210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:35.724210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:35.724210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:35.724210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:35.724210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:35.724210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:35.724210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:02:35.724210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:02:35.724210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:02:35.724210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:02:35.724210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:35.724210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:35.724210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:35.724210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:35.724210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:35.724210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:35.728286 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:35.728286 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:35.728286 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:35.728286 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:35.728286 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:35.728286 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:35.728286 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:35.728286 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:35.728286 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:35.728286 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:35.728286 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:02:35.728286 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:35.728286 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 28 12:02:35.728286 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:35.728286 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 447/897] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Sep 28 12:02:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:35.734490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb9fc7-df46-4357-9db3-11f1a011740b None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:35.797453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a9183-767e-4dda-bed3-21a6ad6125a7 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:35.840683 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e67f8-21fe-47c5-b5aa-f2dda4d0f258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:35.841780 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e67f8-21fe-47c5-b5aa-f2dda4d0f258 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:35.842062 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e67f8-21fe-47c5-b5aa-f2dda4d0f258 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:35.842333 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e67f8-21fe-47c5-b5aa-f2dda4d0f258 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:35.843005 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e67f8-21fe-47c5-b5aa-f2dda4d0f258 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:35.843306 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e67f8-21fe-47c5-b5aa-f2dda4d0f258 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:35.844706 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e67f8-21fe-47c5-b5aa-f2dda4d0f258 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:35.855488 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 451/898] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Sep 28 12:02:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:35.861427 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e67f8-21fe-47c5-b5aa-f2dda4d0f258 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:35.862690 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb9fc7-df46-4357-9db3-11f1a011740b None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:35.901680 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:35.903411 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cd3da-1cad-46b4-8dbc-82c77ac74d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:35.904434 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cd3da-1cad-46b4-8dbc-82c77ac74d12 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:35.904966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cd3da-1cad-46b4-8dbc-82c77ac74d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:35.905398 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cd3da-1cad-46b4-8dbc-82c77ac74d12 None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:35.906204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cd3da-1cad-46b4-8dbc-82c77ac74d12 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:35.906860 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cd3da-1cad-46b4-8dbc-82c77ac74d12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:35.908518 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cd3da-1cad-46b4-8dbc-82c77ac74d12 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:35.916298 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 448/899] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 28 12:02:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:35.921787 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cd3da-1cad-46b4-8dbc-82c77ac74d12 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:35.941945 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:35.984059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e67f8-21fe-47c5-b5aa-f2dda4d0f258 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:36.037918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446c6f4-3655-4979-aa8f-d6ef039befa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:36.039537 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446c6f4-3655-4979-aa8f-d6ef039befa3 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:36.040007 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446c6f4-3655-4979-aa8f-d6ef039befa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:36.040479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446c6f4-3655-4979-aa8f-d6ef039befa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:36.044560 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cd3da-1cad-46b4-8dbc-82c77ac74d12 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:36.055567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446c6f4-3655-4979-aa8f-d6ef039befa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:36.058153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446c6f4-3655-4979-aa8f-d6ef039befa3 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:36.079116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-e446c6f4-3655-4979-aa8f-d6ef039befa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:36.079116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:36.079116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:36.079116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:36.079116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:36.079116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:36.079116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:36.079116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:36.079116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:36.079116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:36.079116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:36.079116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:36.079116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:36.079116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:36.079116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:36.079116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:36.080269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:36.080269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:36.080269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:36.080269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:36.080269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:36.080269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:36.080269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:36.080269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:36.080269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:36.080269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:36.080269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:36.080269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:36.080269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:36.080269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:36.080269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:36.080269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:36.080269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:36.081497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:36.081497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:36.081497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:36.087261 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fec9ae-96a3-4ee9-88df-0aeff0553571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:36.087261 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fec9ae-96a3-4ee9-88df-0aeff0553571 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:36.087261 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fec9ae-96a3-4ee9-88df-0aeff0553571 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:36.087261 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fec9ae-96a3-4ee9-88df-0aeff0553571 None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:36.087681 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fec9ae-96a3-4ee9-88df-0aeff0553571 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:36.087681 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fec9ae-96a3-4ee9-88df-0aeff0553571 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:36.088468 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 452/900] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:36.089188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fec9ae-96a3-4ee9-88df-0aeff0553571 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:36.089588 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446c6f4-3655-4979-aa8f-d6ef039befa3 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:36.099696 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 449/901] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 28 12:02:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:36.100801 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fec9ae-96a3-4ee9-88df-0aeff0553571 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:36.189527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:36.201184 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:36.214727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446c6f4-3655-4979-aa8f-d6ef039befa3 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:36.243206 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fec9ae-96a3-4ee9-88df-0aeff0553571 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:36.254196 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe859f-ada1-4f8f-a80f-842e7232e9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:36.255505 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe859f-ada1-4f8f-a80f-842e7232e9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:36.255988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe859f-ada1-4f8f-a80f-842e7232e9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:36.256851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe859f-ada1-4f8f-a80f-842e7232e9a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:36.257961 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe859f-ada1-4f8f-a80f-842e7232e9a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:36.258445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe859f-ada1-4f8f-a80f-842e7232e9a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:36.261442 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe859f-ada1-4f8f-a80f-842e7232e9a3 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:36.283530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591c712-5573-4b93-8e0f-4ff46173fb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:36.283530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591c712-5573-4b93-8e0f-4ff46173fb64 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:36.283530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591c712-5573-4b93-8e0f-4ff46173fb64 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:36.283530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591c712-5573-4b93-8e0f-4ff46173fb64 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:36.283948 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591c712-5573-4b93-8e0f-4ff46173fb64 None admin] RBAC: Adding query filter params (interface=public, service_id=551c4759f6864739bf516e7e846b7dc0, region_id=RegionOne) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:36.284956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591c712-5573-4b93-8e0f-4ff46173fb64 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:36.285113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 453/902] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:36.286131 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe859f-ada1-4f8f-a80f-842e7232e9a3 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:36.286615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591c712-5573-4b93-8e0f-4ff46173fb64 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:36.293151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 450/903] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Sep 28 12:02:36 2022] GET /identity/v3/endpoints?service_id=551c4759f6864739bf516e7e846b7dc0&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:36.298586 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591c712-5573-4b93-8e0f-4ff46173fb64 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:36.415361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe859f-ada1-4f8f-a80f-842e7232e9a3 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:36.417026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591c712-5573-4b93-8e0f-4ff46173fb64 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:36.453677 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8368aa2-a793-4385-bca7-4ad5746ac32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:36.454501 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8368aa2-a793-4385-bca7-4ad5746ac32f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:36.454879 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8368aa2-a793-4385-bca7-4ad5746ac32f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:36.455248 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8368aa2-a793-4385-bca7-4ad5746ac32f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:36.465051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8368aa2-a793-4385-bca7-4ad5746ac32f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:36.465864 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7affcf5-bd7b-4708-babe-fbe9bf311d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:36.466727 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7affcf5-bd7b-4708-babe-fbe9bf311d8d None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:36.466851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8368aa2-a793-4385-bca7-4ad5746ac32f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:36.467264 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7affcf5-bd7b-4708-babe-fbe9bf311d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:36.467763 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7affcf5-bd7b-4708-babe-fbe9bf311d8d None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:36.468510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7affcf5-bd7b-4708-babe-fbe9bf311d8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:36.470931 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7affcf5-bd7b-4708-babe-fbe9bf311d8d None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:36.478031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 451/904] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Sep 28 12:02:36 2022] GET /identity/v3/services => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:02:36.485071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-e8368aa2-a793-4385-bca7-4ad5746ac32f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 12:02:36.485071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:36.485071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:36.485071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:36.485071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:36.485071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:36.485071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:36.485071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:36.485071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:36.485071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:36.485071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:36.485071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:36.485071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:02:36.485071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:02:36.485071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:02:36.485071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:02:36.486127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:36.486127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:36.486127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:02:36.486127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:36.486127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:02:36.486127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:36.486127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:36.486127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:36.486127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:36.486127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:36.486127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:36.486127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:36.486127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:36.486127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:36.486127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:36.486127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:36.486127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:36.486127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:36.487141 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:36.487141 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:36.487141 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:02:36.487141 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:02:36.487141 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:02:36.487141 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:02:36.487141 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:02:36.487141 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:02:36.487141 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 12:02:36.487141 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:36.489665 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 454/905] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 28 12:02:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:36.496177 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7affcf5-bd7b-4708-babe-fbe9bf311d8d None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:36.499673 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:36.611733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7affcf5-bd7b-4708-babe-fbe9bf311d8d None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:36.652087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f9a24-c187-43c9-a311-4e1efde8fe3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:36.653013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f9a24-c187-43c9-a311-4e1efde8fe3c None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:36.653465 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f9a24-c187-43c9-a311-4e1efde8fe3c None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:36.653897 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f9a24-c187-43c9-a311-4e1efde8fe3c None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:36.654779 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f9a24-c187-43c9-a311-4e1efde8fe3c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:36.655228 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f9a24-c187-43c9-a311-4e1efde8fe3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:36.656820 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f9a24-c187-43c9-a311-4e1efde8fe3c None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:36.676514 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 452/906] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Sep 28 12:02:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:36.682336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8368aa2-a793-4385-bca7-4ad5746ac32f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:36.686555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:36.788583 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8368aa2-a793-4385-bca7-4ad5746ac32f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:36.824480 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a85db-cb27-4803-80dc-a799dc9f829e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:36.825090 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a85db-cb27-4803-80dc-a799dc9f829e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:36.825368 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a85db-cb27-4803-80dc-a799dc9f829e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:36.825637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a85db-cb27-4803-80dc-a799dc9f829e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:36.896581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a85db-cb27-4803-80dc-a799dc9f829e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:36.898029 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a85db-cb27-4803-80dc-a799dc9f829e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:36.901095 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:37.005687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 455/907] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:02:36 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:02:37.011138 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f9a24-c187-43c9-a311-4e1efde8fe3c None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:37.074472 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:37.125708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f9a24-c187-43c9-a311-4e1efde8fe3c None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:37.162093 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0498982-3ad3-4ce3-a1bf-9f8d47b364d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:37.162743 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0498982-3ad3-4ce3-a1bf-9f8d47b364d2 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:37.163017 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0498982-3ad3-4ce3-a1bf-9f8d47b364d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:37.163285 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0498982-3ad3-4ce3-a1bf-9f8d47b364d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:37.176353 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0498982-3ad3-4ce3-a1bf-9f8d47b364d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:37.177841 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0498982-3ad3-4ce3-a1bf-9f8d47b364d2 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:37.195254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-e0498982-3ad3-4ce3-a1bf-9f8d47b364d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:37.195254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:37.195254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:37.195254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:37.195254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:37.195254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:37.195254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:37.195254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:37.195254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:37.195254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:37.195254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:37.195254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:37.195254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:37.195254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:37.195254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:37.195254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:37.196346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:37.196346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:37.196346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:37.196346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:37.196346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:37.196346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:37.196346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:37.196346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:37.196346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:37.196346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:37.196346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:37.196346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:37.196346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:37.196346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:37.196346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:37.196346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:37.196346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:37.197930 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:37.197930 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:37.197930 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:37.197930 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 453/908] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:37.202348 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a85db-cb27-4803-80dc-a799dc9f829e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:37.294398 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafc681-a6f5-4ab9-b7ee-4e3252e15939 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:37.294735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafc681-a6f5-4ab9-b7ee-4e3252e15939 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:37.294928 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafc681-a6f5-4ab9-b7ee-4e3252e15939 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:37.296503 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 454/909] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:37.301658 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d836f-1381-4dab-b11c-56d2312da2a3 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:37.301934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d836f-1381-4dab-b11c-56d2312da2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:37.302204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d836f-1381-4dab-b11c-56d2312da2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:37.306830 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a85db-cb27-4803-80dc-a799dc9f829e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:37.309300 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:37.321007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-5c5d836f-1381-4dab-b11c-56d2312da2a3 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:37.322194 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-5c5d836f-1381-4dab-b11c-56d2312da2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:37.344051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100710f-de3c-4498-93e8-b02070bf40d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:37.344663 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100710f-de3c-4498-93e8-b02070bf40d9 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:37.344942 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100710f-de3c-4498-93e8-b02070bf40d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:37.345219 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100710f-de3c-4498-93e8-b02070bf40d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:37.345916 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100710f-de3c-4498-93e8-b02070bf40d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:37.346219 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100710f-de3c-4498-93e8-b02070bf40d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:37.347805 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100710f-de3c-4498-93e8-b02070bf40d9 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:37.360005 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 456/910] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:37.365278 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100710f-de3c-4498-93e8-b02070bf40d9 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:37.399519 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 455/911] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:02:37.477233 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100710f-de3c-4498-93e8-b02070bf40d9 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:37.515893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f77e4-0bb2-448c-a604-99a7c353720a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:37.516530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f77e4-0bb2-448c-a604-99a7c353720a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:37.516810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f77e4-0bb2-448c-a604-99a7c353720a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:37.517087 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f77e4-0bb2-448c-a604-99a7c353720a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:37.524371 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f77e4-0bb2-448c-a604-99a7c353720a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:37.525977 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f77e4-0bb2-448c-a604-99a7c353720a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:37.537657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-db5f77e4-0bb2-448c-a604-99a7c353720a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:37.537657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:37.537657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:37.537657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:37.537657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:37.537657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:37.537657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:37.537657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:37.537657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:37.537657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:37.537657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:37.537657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:37.537657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:02:37.537657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:02:37.537657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:02:37.539801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:02:37.539801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:37.539801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:37.539801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:37.539801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:37.539801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:37.539801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:37.539801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:37.539801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:37.539801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:37.539801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:37.539801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:37.539801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:37.539801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:37.539801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:37.539801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:37.539801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:37.541927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:02:37.541927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:02:37.541927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:02:37.541927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:02:37.541927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:02:37.541927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:02:37.541927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:37.541927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:37.541927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 457/912] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:37.545537 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d836f-1381-4dab-b11c-56d2312da2a3 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:37.589206 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:37.647053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d836f-1381-4dab-b11c-56d2312da2a3 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:37.670050 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f77e4-0bb2-448c-a604-99a7c353720a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:37.683872 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6be16-6d20-4827-8a84-f90c3eb494da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:37.684510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6be16-6d20-4827-8a84-f90c3eb494da None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:37.685193 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6be16-6d20-4827-8a84-f90c3eb494da None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:37.685193 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6be16-6d20-4827-8a84-f90c3eb494da None admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:37.685745 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6be16-6d20-4827-8a84-f90c3eb494da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:37.686056 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6be16-6d20-4827-8a84-f90c3eb494da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:37.687789 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6be16-6d20-4827-8a84-f90c3eb494da None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:37.706146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 456/913] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:02:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:37.708295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6be16-6d20-4827-8a84-f90c3eb494da None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:37.710207 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:37.794641 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f77e4-0bb2-448c-a604-99a7c353720a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:37.812154 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6be16-6d20-4827-8a84-f90c3eb494da None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:37.813680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:37.835785 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77b4c5-9201-4b8f-ab34-38f0392bd25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:37.836420 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77b4c5-9201-4b8f-ab34-38f0392bd25a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:37.836694 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77b4c5-9201-4b8f-ab34-38f0392bd25a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:37.836961 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77b4c5-9201-4b8f-ab34-38f0392bd25a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:37.837533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77b4c5-9201-4b8f-ab34-38f0392bd25a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:37.838890 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77b4c5-9201-4b8f-ab34-38f0392bd25a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:37.848266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-3a77b4c5-9201-4b8f-ab34-38f0392bd25a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 28 12:02:37.848266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:37.848266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:02:37.848266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:02:37.848266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:02:37.848266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:02:37.848266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:02:37.848266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:37.848266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 28 12:02:37.848266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:37.848266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:02:37.848266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:37.848266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:37.848266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:37.848266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:37.848266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:37.848266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:37.849310 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:37.849310 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:37.849310 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:37.849310 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:37.849310 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:37.849310 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:37.849310 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:02:37.849310 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:02:37.849310 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:02:37.849310 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:02:37.849310 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:37.849310 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:37.849310 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:37.849310 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:37.849310 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:37.849310 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:37.850155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:37.850155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:37.850155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:37.850155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:37.850155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:37.850155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:37.850155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:37.850155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:37.850155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:37.850155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:37.850155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:02:37.850155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:37.850155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 28 12:02:37.850155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:37.850155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 458/914] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 28 12:02:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:37.850960 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360ad58-8ee3-4084-b45d-4988862e2d38 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:37.850960 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360ad58-8ee3-4084-b45d-4988862e2d38 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:37.850960 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360ad58-8ee3-4084-b45d-4988862e2d38 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:37.856176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 459/915] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:37.856176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360ad58-8ee3-4084-b45d-4988862e2d38 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:37.860985 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ae9e4-395d-49cc-97c2-aa3c7ec63cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:37.861597 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ae9e4-395d-49cc-97c2-aa3c7ec63cee None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:37.861871 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ae9e4-395d-49cc-97c2-aa3c7ec63cee None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:37.862212 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ae9e4-395d-49cc-97c2-aa3c7ec63cee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:37.863545 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ae9e4-395d-49cc-97c2-aa3c7ec63cee None admin] RBAC: Adding query filter params (role.id=d36bf69b347c431a8923d10a00d66e1c, scope.project.id=c854d366f35145e8b2fadb9b014d0199, user.id=c0e57ea982d349c1a86b544e9a6e7758) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:37.863858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ae9e4-395d-49cc-97c2-aa3c7ec63cee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:37.865723 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ae9e4-395d-49cc-97c2-aa3c7ec63cee None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:37.883620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 457/916] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:02:37 2022] GET /identity/v3/role_assignments?user.id=c0e57ea982d349c1a86b544e9a6e7758&scope.project.id=c854d366f35145e8b2fadb9b014d0199&role.id=d36bf69b347c431a8923d10a00d66e1c => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:37.883620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e0795-c903-429a-ba0e-9465536439f7 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:37.883620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e0795-c903-429a-ba0e-9465536439f7 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:37.883620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e0795-c903-429a-ba0e-9465536439f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:37.903094 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-777e0795-c903-429a-ba0e-9465536439f7 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:37.904348 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-777e0795-c903-429a-ba0e-9465536439f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:37.983518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:37.989816 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 458/917] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:02:38.000635 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360ad58-8ee3-4084-b45d-4988862e2d38 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:38.038452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997db1a1-dba9-4619-8b82-535acf85a199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:38.039082 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997db1a1-dba9-4619-8b82-535acf85a199 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:38.039339 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997db1a1-dba9-4619-8b82-535acf85a199 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:38.039631 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997db1a1-dba9-4619-8b82-535acf85a199 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:38.040277 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997db1a1-dba9-4619-8b82-535acf85a199 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:38.040577 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997db1a1-dba9-4619-8b82-535acf85a199 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:38.042092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997db1a1-dba9-4619-8b82-535acf85a199 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:38.047845 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 460/918] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 28 12:02:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:38.053977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e0795-c903-429a-ba0e-9465536439f7 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:38.156810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:38.164491 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e0795-c903-429a-ba0e-9465536439f7 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:38.201082 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bef876-c0a9-4638-b573-e63a14f1eb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:38.202087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bef876-c0a9-4638-b573-e63a14f1eb9f None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:38.202551 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bef876-c0a9-4638-b573-e63a14f1eb9f None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:38.203040 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bef876-c0a9-4638-b573-e63a14f1eb9f None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:38.203885 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bef876-c0a9-4638-b573-e63a14f1eb9f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:38.204370 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bef876-c0a9-4638-b573-e63a14f1eb9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:38.205982 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bef876-c0a9-4638-b573-e63a14f1eb9f None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:38.212523 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 459/919] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 28 12:02:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:38.218395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997db1a1-dba9-4619-8b82-535acf85a199 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:38.267944 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bef876-c0a9-4638-b573-e63a14f1eb9f None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:38.337719 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997db1a1-dba9-4619-8b82-535acf85a199 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:38.385068 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa815a7d-87a0-4d1d-99c5-01f4c7986268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:38.385985 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa815a7d-87a0-4d1d-99c5-01f4c7986268 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:38.386474 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa815a7d-87a0-4d1d-99c5-01f4c7986268 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:38.386922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa815a7d-87a0-4d1d-99c5-01f4c7986268 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:38.387827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa815a7d-87a0-4d1d-99c5-01f4c7986268 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:38.388102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bef876-c0a9-4638-b573-e63a14f1eb9f None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:38.389845 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa815a7d-87a0-4d1d-99c5-01f4c7986268 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:38.423534 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 461/920] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:02:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:02:38.444595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6410acb-695f-4555-ab9c-7ca693f1200f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:38.445251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6410acb-695f-4555-ab9c-7ca693f1200f None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:38.445534 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6410acb-695f-4555-ab9c-7ca693f1200f None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:38.445857 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6410acb-695f-4555-ab9c-7ca693f1200f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:38.446460 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6410acb-695f-4555-ab9c-7ca693f1200f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:38.448018 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6410acb-695f-4555-ab9c-7ca693f1200f None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:38.459037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-e6410acb-695f-4555-ab9c-7ca693f1200f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:02:38.459037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:38.459037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:02:38.459037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:02:38.459037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:02:38.459037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:02:38.459037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:02:38.459037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:38.459037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:02:38.459037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:38.459037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:02:38.459037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:38.459037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:38.459037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:38.459037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:38.459037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:38.459037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:38.460146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:38.460146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:38.460146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:38.460146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:38.460146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:38.460146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:38.460146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:02:38.460146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:02:38.460146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:02:38.460146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:02:38.460146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:38.460146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:38.460146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:38.460146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:38.460146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:38.460146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:38.461023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:38.461023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:38.461023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:38.461023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:38.461023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:38.461023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:38.461023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:38.461023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:38.461023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:38.461023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:38.461023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:02:38.461023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:38.461023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:02:38.461023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:38.461023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 460/921] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 28 12:02:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:38.466883 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa815a7d-87a0-4d1d-99c5-01f4c7986268 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:38.493645 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:38.584463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa815a7d-87a0-4d1d-99c5-01f4c7986268 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:38.622673 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765e632-2ca7-4bfa-bf50-a4149b73a36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:38.623311 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765e632-2ca7-4bfa-bf50-a4149b73a36e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:38.623629 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765e632-2ca7-4bfa-bf50-a4149b73a36e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:38.623901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765e632-2ca7-4bfa-bf50-a4149b73a36e None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:38.624554 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765e632-2ca7-4bfa-bf50-a4149b73a36e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:38.624856 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765e632-2ca7-4bfa-bf50-a4149b73a36e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:38.626285 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765e632-2ca7-4bfa-bf50-a4149b73a36e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:38.633803 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 462/922] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 28 12:02:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:38.640596 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6410acb-695f-4555-ab9c-7ca693f1200f None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:38.669360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:38.762366 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6410acb-695f-4555-ab9c-7ca693f1200f None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:38.763364 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd9af1-ff89-44f8-9a6c-1c275dfd375b None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:38.763678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd9af1-ff89-44f8-9a6c-1c275dfd375b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:38.764130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd9af1-ff89-44f8-9a6c-1c275dfd375b None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:38.766415 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 463/923] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:38.772826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac082958-40d0-44cb-80f5-f14da11945e6 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:38.773478 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac082958-40d0-44cb-80f5-f14da11945e6 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:38.773989 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac082958-40d0-44cb-80f5-f14da11945e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:38.798201 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858e086-7e2a-4aa5-9503-cc49aba0f871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:38.798554 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-ac082958-40d0-44cb-80f5-f14da11945e6 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:38.799374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858e086-7e2a-4aa5-9503-cc49aba0f871 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:38.799846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ac082958-40d0-44cb-80f5-f14da11945e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:38.800170 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858e086-7e2a-4aa5-9503-cc49aba0f871 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:38.800635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858e086-7e2a-4aa5-9503-cc49aba0f871 None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:38.801526 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858e086-7e2a-4aa5-9503-cc49aba0f871 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:38.802034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858e086-7e2a-4aa5-9503-cc49aba0f871 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:38.803706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858e086-7e2a-4aa5-9503-cc49aba0f871 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:38.809883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 461/924] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 28 12:02:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:38.817779 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858e086-7e2a-4aa5-9503-cc49aba0f871 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:38.891457 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 464/925] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:02:38.925316 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:38.944026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858e086-7e2a-4aa5-9503-cc49aba0f871 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:38.979932 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471f3f8-13cb-4c4e-b551-fee2b249797c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:38.980471 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471f3f8-13cb-4c4e-b551-fee2b249797c None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:38.980748 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471f3f8-13cb-4c4e-b551-fee2b249797c None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:38.981023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471f3f8-13cb-4c4e-b551-fee2b249797c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:38.981730 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471f3f8-13cb-4c4e-b551-fee2b249797c None admin] RBAC: Adding query filter params (interface=public, service_id=3f10be4d7e2c4753b93fbcfa58f3fdd0, region_id=RegionOne) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:38.982038 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471f3f8-13cb-4c4e-b551-fee2b249797c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:38.983546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471f3f8-13cb-4c4e-b551-fee2b249797c None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:38.990239 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 462/926] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Sep 28 12:02:38 2022] GET /identity/v3/endpoints?service_id=3f10be4d7e2c4753b93fbcfa58f3fdd0&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:38.996277 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac082958-40d0-44cb-80f5-f14da11945e6 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:38.999307 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:39.119774 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac082958-40d0-44cb-80f5-f14da11945e6 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:39.156543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b87e37-0d65-47a5-918f-9456571b6f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:39.157514 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b87e37-0d65-47a5-918f-9456571b6f09 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:39.157992 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b87e37-0d65-47a5-918f-9456571b6f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:39.158458 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b87e37-0d65-47a5-918f-9456571b6f09 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:39.159331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b87e37-0d65-47a5-918f-9456571b6f09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:39.160972 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b87e37-0d65-47a5-918f-9456571b6f09 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:39.163845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471f3f8-13cb-4c4e-b551-fee2b249797c None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:39.168537 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 465/927] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Sep 28 12:02:38 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:02:39.282508 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471f3f8-13cb-4c4e-b551-fee2b249797c None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:39.321302 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d080d-afd0-4095-bd99-46b4cf504940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:39.321957 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d080d-afd0-4095-bd99-46b4cf504940 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:39.322234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d080d-afd0-4095-bd99-46b4cf504940 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:39.322504 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d080d-afd0-4095-bd99-46b4cf504940 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:39.323097 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d080d-afd0-4095-bd99-46b4cf504940 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:39.324509 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d080d-afd0-4095-bd99-46b4cf504940 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:39.335164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-e34d080d-afd0-4095-bd99-46b4cf504940 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 28 12:02:39.335164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:39.335164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:02:39.335164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:02:39.335164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:02:39.335164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:02:39.335164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:02:39.335164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:39.335164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 28 12:02:39.335164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:39.335164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:02:39.335164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:39.335164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:39.335164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:39.335164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:39.335164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:39.336234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:39.336234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:39.336234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:39.336234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:39.336234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:39.336234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:39.336234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:39.336234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:02:39.336234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:02:39.336234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:02:39.336234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:02:39.336234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:39.336234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:39.336234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:39.336234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:39.336234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:39.336234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:39.337135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:39.337135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:39.337135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:39.337135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:39.337135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:39.337135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:39.337135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:39.337135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:39.337135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:39.337135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:39.337135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:02:39.337135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:39.337135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 28 12:02:39.337135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:39.337135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 463/928] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Sep 28 12:02:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:39.343188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b87e37-0d65-47a5-918f-9456571b6f09 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:39.416437 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:39.451842 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b87e37-0d65-47a5-918f-9456571b6f09 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:39.487426 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e03017-8e50-453d-9107-c87d313408af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:39.488059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e03017-8e50-453d-9107-c87d313408af None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:39.488386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e03017-8e50-453d-9107-c87d313408af None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:39.488664 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e03017-8e50-453d-9107-c87d313408af None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:39.489295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e03017-8e50-453d-9107-c87d313408af None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:39.489595 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e03017-8e50-453d-9107-c87d313408af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:39.490947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e03017-8e50-453d-9107-c87d313408af None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:39.496456 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 466/929] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 28 12:02:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:39.501995 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d080d-afd0-4095-bd99-46b4cf504940 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:39.521076 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:39.610985 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d080d-afd0-4095-bd99-46b4cf504940 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:39.650381 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399effb-6fef-4ed1-a596-e480b2040f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:39.651350 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399effb-6fef-4ed1-a596-e480b2040f94 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:39.651860 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399effb-6fef-4ed1-a596-e480b2040f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:39.652384 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399effb-6fef-4ed1-a596-e480b2040f94 None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:39.653210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399effb-6fef-4ed1-a596-e480b2040f94 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:39.653717 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399effb-6fef-4ed1-a596-e480b2040f94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:39.655292 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399effb-6fef-4ed1-a596-e480b2040f94 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:39.661664 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 464/930] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 28 12:02:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:39.669702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e03017-8e50-453d-9107-c87d313408af None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:39.775104 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e03017-8e50-453d-9107-c87d313408af None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:39.804879 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:39.811062 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae236e0-9a46-4609-99b9-0c96a87e7d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:39.811703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae236e0-9a46-4609-99b9-0c96a87e7d1e None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:39.812383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae236e0-9a46-4609-99b9-0c96a87e7d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:39.812660 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae236e0-9a46-4609-99b9-0c96a87e7d1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:39.813341 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae236e0-9a46-4609-99b9-0c96a87e7d1e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:39.815069 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae236e0-9a46-4609-99b9-0c96a87e7d1e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:39.837864 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 467/931] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:02:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:02:40.110707 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9761559-239f-419d-a7b3-172a5eddc6fe None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:40.110982 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9761559-239f-419d-a7b3-172a5eddc6fe None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:40.111259 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9761559-239f-419d-a7b3-172a5eddc6fe None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:40.112973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 465/932] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:40.118413 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d921b1a-93d0-4737-9778-5b48d796ba67 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:40.118698 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d921b1a-93d0-4737-9778-5b48d796ba67 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:40.118976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d921b1a-93d0-4737-9778-5b48d796ba67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:40.138518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-3d921b1a-93d0-4737-9778-5b48d796ba67 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:40.139759 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3d921b1a-93d0-4737-9778-5b48d796ba67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:40.221234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 468/933] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:02:40.490861 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9761559-239f-419d-a7b3-172a5eddc6fe None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:40.572458 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:40.599161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9761559-239f-419d-a7b3-172a5eddc6fe None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:40.641609 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccccb27-9a5a-4d1d-a3c0-cbc339cd3aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:40.642259 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccccb27-9a5a-4d1d-a3c0-cbc339cd3aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:40.642539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccccb27-9a5a-4d1d-a3c0-cbc339cd3aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:40.642811 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccccb27-9a5a-4d1d-a3c0-cbc339cd3aa0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:40.654353 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccccb27-9a5a-4d1d-a3c0-cbc339cd3aa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:02:40.659247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-4ccccb27-9a5a-4d1d-a3c0-cbc339cd3aa0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 12:02:40.659247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:40.659247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:40.659247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:40.659247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:40.659247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:40.659247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:40.659247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:40.659247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:40.659247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:40.659247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:40.659247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:40.659247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:02:40.659247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:02:40.659247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:02:40.659247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:02:40.660221 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:02:40.660221 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:02:40.660221 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:02:40.660221 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:02:40.660221 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:40.660221 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:40.660221 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:40.660221 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:40.660221 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:40.660221 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:40.660221 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:40.660221 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:40.660221 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:40.660221 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:40.660221 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:40.660221 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:40.662139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:40.662139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:40.662139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:40.662139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:40.662139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:02:40.662139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:02:40.662139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:02:40.662139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:02:40.662139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:02:40.662139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:02:40.662139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 12:02:40.662139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:40.662139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 466/934] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Sep 28 12:02:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:40.668547 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d921b1a-93d0-4737-9778-5b48d796ba67 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:40.729814 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e659cba-5c5e-4dc0-967f-bd25254ee916 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:40.730136 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e659cba-5c5e-4dc0-967f-bd25254ee916 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:40.730371 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e659cba-5c5e-4dc0-967f-bd25254ee916 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:40.732586 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 467/935] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:40.738267 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eff191-a122-47f6-9369-ac28c90a3fb8 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:40.738546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eff191-a122-47f6-9369-ac28c90a3fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:40.738816 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eff191-a122-47f6-9369-ac28c90a3fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:40.761144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-a6eff191-a122-47f6-9369-ac28c90a3fb8 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:40.762265 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-a6eff191-a122-47f6-9369-ac28c90a3fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:40.781392 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d921b1a-93d0-4737-9778-5b48d796ba67 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:40.797018 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:40.822292 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466be19c-5a56-4f92-aaee-7e285a1f9eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:40.823304 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466be19c-5a56-4f92-aaee-7e285a1f9eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:40.823882 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466be19c-5a56-4f92-aaee-7e285a1f9eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:40.824353 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466be19c-5a56-4f92-aaee-7e285a1f9eb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:40.825210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466be19c-5a56-4f92-aaee-7e285a1f9eb4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:40.825726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466be19c-5a56-4f92-aaee-7e285a1f9eb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:40.827500 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466be19c-5a56-4f92-aaee-7e285a1f9eb4 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:40.837920 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 469/936] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Sep 28 12:02:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:40.842633 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 468/937] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:02:40.847554 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466be19c-5a56-4f92-aaee-7e285a1f9eb4 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:40.962731 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466be19c-5a56-4f92-aaee-7e285a1f9eb4 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:40.999253 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765dfdb1-396d-4d79-8727-a0931ee0e191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:40.999956 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dfdb1-396d-4d79-8727-a0931ee0e191 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:41.000234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dfdb1-396d-4d79-8727-a0931ee0e191 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:41.000499 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dfdb1-396d-4d79-8727-a0931ee0e191 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:41.012248 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765dfdb1-396d-4d79-8727-a0931ee0e191 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:41.013613 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765dfdb1-396d-4d79-8727-a0931ee0e191 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:41.028402 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-765dfdb1-396d-4d79-8727-a0931ee0e191 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:41.028402 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:41.028402 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:41.028402 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:41.028402 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:41.028402 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:41.028402 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:41.028402 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:41.028402 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:41.028402 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:41.028402 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:41.028402 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:41.028402 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:41.028402 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:41.028402 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:41.028402 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:41.029391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:41.029391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:41.029391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:41.029391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:41.029391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:41.029391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:41.029391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:41.029391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:41.029391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:41.029391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:41.029391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:41.029391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:41.029391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:41.029391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:41.029391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:41.029391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:41.029391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:41.030299 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:41.030299 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:41.030299 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:41.030299 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 470/938] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:41.040562 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eff191-a122-47f6-9369-ac28c90a3fb8 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:41.113384 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:41.130932 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765dfdb1-396d-4d79-8727-a0931ee0e191 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:41.151663 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eff191-a122-47f6-9369-ac28c90a3fb8 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:41.160565 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:41.187027 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addb329-473e-45f5-824e-e21237e81a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:41.187667 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addb329-473e-45f5-824e-e21237e81a43 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:41.187946 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addb329-473e-45f5-824e-e21237e81a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:41.188219 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addb329-473e-45f5-824e-e21237e81a43 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:41.188867 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addb329-473e-45f5-824e-e21237e81a43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:41.189172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addb329-473e-45f5-824e-e21237e81a43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:41.191097 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addb329-473e-45f5-824e-e21237e81a43 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:41.203117 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 469/939] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:41.212378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addb329-473e-45f5-824e-e21237e81a43 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:41.243033 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765dfdb1-396d-4d79-8727-a0931ee0e191 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:41.284171 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972f3ec-be4f-470a-accf-448aa1174edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:41.284843 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972f3ec-be4f-470a-accf-448aa1174edf None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:41.285119 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972f3ec-be4f-470a-accf-448aa1174edf None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:41.285387 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972f3ec-be4f-470a-accf-448aa1174edf None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:41.286150 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0972f3ec-be4f-470a-accf-448aa1174edf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:41.288323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0972f3ec-be4f-470a-accf-448aa1174edf None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:41.291553 dv-cinder-859193-2-smb devstack@keystone.service[81598]: WARNING keystone.server.flask.common [None req-0972f3ec-be4f-470a-accf-448aa1174edf None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 28 12:02:41.313100 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.sql.core [None req-0972f3ec-be4f-470a-accf-448aa1174edf None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 28 12:02:41.313100 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 28 12:02:41.313100 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [parameters: {'id': '443644a0fe374630a1020693b386fd11', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 28 12:02:41.313100 dv-cinder-859193-2-smb devstack@keystone.service[81598]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81598) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 28 12:02:41.319421 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addb329-473e-45f5-824e-e21237e81a43 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:41.321549 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-0972f3ec-be4f-470a-accf-448aa1174edf None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 443644a0fe374630a1020693b386fd11.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 443644a0fe374630a1020693b386fd11. Sep 28 12:02:41.321549 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:41.321549 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 28 12:02:41.321549 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 28 12:02:41.321549 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 28 12:02:41.321549 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 28 12:02:41.321549 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 28 12:02:41.321549 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application result = self._query(query) Sep 28 12:02:41.321549 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 28 12:02:41.321549 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application conn.query(q) Sep 28 12:02:41.321549 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 28 12:02:41.321549 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 28 12:02:41.321549 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 28 12:02:41.322399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application result.read() Sep 28 12:02:41.322399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 28 12:02:41.322399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 28 12:02:41.322399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 28 12:02:41.322399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 28 12:02:41.322399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 28 12:02:41.322399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 28 12:02:41.322399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 28 12:02:41.322399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 28 12:02:41.322399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 28 12:02:41.322399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:41.322399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 28 12:02:41.322399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:41.322399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:41.322399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 28 12:02:41.322399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 28 12:02:41.322399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 28 12:02:41.322399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 28 12:02:41.323878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 28 12:02:41.323878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application next(self.gen) Sep 28 12:02:41.323878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 28 12:02:41.323878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application yield resource Sep 28 12:02:41.323878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 28 12:02:41.323878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application next(self.gen) Sep 28 12:02:41.323878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 28 12:02:41.323878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self.session.rollback() Sep 28 12:02:41.323878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 28 12:02:41.323878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self.force_reraise() Sep 28 12:02:41.323878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 28 12:02:41.323878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise self.value Sep 28 12:02:41.323878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 28 12:02:41.323878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 28 12:02:41.323878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 28 12:02:41.323878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application session.commit() Sep 28 12:02:41.323878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 28 12:02:41.326075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 28 12:02:41.326075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 28 12:02:41.326075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._prepare_impl() Sep 28 12:02:41.326075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 28 12:02:41.326075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self.session.flush() Sep 28 12:02:41.326075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 28 12:02:41.326075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._flush(objects) Sep 28 12:02:41.326075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 28 12:02:41.326075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 28 12:02:41.326075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 28 12:02:41.326075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application compat.raise_( Sep 28 12:02:41.326075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 28 12:02:41.326075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception Sep 28 12:02:41.326075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 28 12:02:41.326075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application flush_context.execute() Sep 28 12:02:41.326075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 28 12:02:41.326075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rec.execute(self) Sep 28 12:02:41.328340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 28 12:02:41.328340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 28 12:02:41.328340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 28 12:02:41.328340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 28 12:02:41.328340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 28 12:02:41.328340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 28 12:02:41.328340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 28 12:02:41.328340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 28 12:02:41.328340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 28 12:02:41.328340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 28 12:02:41.328340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 28 12:02:41.328340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 28 12:02:41.328340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 28 12:02:41.328340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 28 12:02:41.328340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 28 12:02:41.331800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 28 12:02:41.331800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 28 12:02:41.331800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception Sep 28 12:02:41.331800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 28 12:02:41.331800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 28 12:02:41.331800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 28 12:02:41.331800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 28 12:02:41.331800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 28 12:02:41.331800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application result = self._query(query) Sep 28 12:02:41.331800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 28 12:02:41.331800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application conn.query(q) Sep 28 12:02:41.331800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 28 12:02:41.331800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 28 12:02:41.331800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 28 12:02:41.331800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application result.read() Sep 28 12:02:41.331800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 28 12:02:41.331800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 28 12:02:41.332723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 28 12:02:41.332723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 28 12:02:41.332723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 28 12:02:41.332723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 28 12:02:41.332723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 28 12:02:41.332723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 28 12:02:41.332723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 28 12:02:41.332723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 28 12:02:41.332723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [parameters: {'id': '443644a0fe374630a1020693b386fd11', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 28 12:02:41.332723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 28 12:02:41.332723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:41.332723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:02:41.332723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:41.332723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:41.332723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 28 12:02:41.333527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 28 12:02:41.333527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 28 12:02:41.333527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 28 12:02:41.333527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 28 12:02:41.333527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:41.333527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:02:41.333527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:41.333527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:41.333527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:41.333527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:41.333527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:41.333527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:41.333527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:41.333527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:41.333527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:41.333527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:41.333527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:41.334438 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:41.334438 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 28 12:02:41.334438 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 28 12:02:41.334438 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:41.334438 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:41.334438 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 28 12:02:41.334438 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 28 12:02:41.334438 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 443644a0fe374630a1020693b386fd11. Sep 28 12:02:41.334438 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:41.334438 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 471/940] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Sep 28 12:02:41 2022] POST /identity/v3/projects => generated 262 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:41.334438 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972f3ec-be4f-470a-accf-448aa1174edf None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:41.345297 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:41.356204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2265f-58c4-4fb7-9c29-7614c1018662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:41.356909 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2265f-58c4-4fb7-9c29-7614c1018662 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:41.357199 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2265f-58c4-4fb7-9c29-7614c1018662 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:41.357566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2265f-58c4-4fb7-9c29-7614c1018662 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:41.366590 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2265f-58c4-4fb7-9c29-7614c1018662 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:41.368278 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2265f-58c4-4fb7-9c29-7614c1018662 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:41.382028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-b4b2265f-58c4-4fb7-9c29-7614c1018662 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 12:02:41.382028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:41.382028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:41.382028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:41.382028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:41.382028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:41.382028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:41.382028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:41.382028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:41.382028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:41.382028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:41.382028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:41.382028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:02:41.382028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:02:41.382028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:02:41.382028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:02:41.382989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:41.382989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:41.382989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:02:41.382989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:41.382989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:02:41.382989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:41.382989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:41.382989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:41.382989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:41.382989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:41.382989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:41.382989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:41.382989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:41.382989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:41.382989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:41.382989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:41.382989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:41.382989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:41.384325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:41.384325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:41.384325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:02:41.384325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:02:41.384325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:02:41.384325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:02:41.384325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:02:41.384325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:02:41.384325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 12:02:41.384325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:41.384325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 470/941] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 28 12:02:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:41.388946 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2265f-58c4-4fb7-9c29-7614c1018662 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:41.432557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:41.455682 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972f3ec-be4f-470a-accf-448aa1174edf None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:41.497150 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf35ad3-5232-4cf3-9bb3-c3795a96035c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:41.498182 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf35ad3-5232-4cf3-9bb3-c3795a96035c None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:41.498656 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf35ad3-5232-4cf3-9bb3-c3795a96035c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:41.499139 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf35ad3-5232-4cf3-9bb3-c3795a96035c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:41.506860 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2265f-58c4-4fb7-9c29-7614c1018662 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:41.508338 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf35ad3-5232-4cf3-9bb3-c3795a96035c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:41.510324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf35ad3-5232-4cf3-9bb3-c3795a96035c None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:41.522797 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-cdf35ad3-5232-4cf3-9bb3-c3795a96035c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:41.522797 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:41.522797 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:41.522797 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:41.522797 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:41.522797 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:41.522797 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:41.522797 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:41.522797 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:41.522797 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:41.522797 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:41.522797 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:41.522797 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:02:41.522797 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:02:41.522797 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:02:41.523775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:02:41.523775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:41.523775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:41.523775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:41.523775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:41.523775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:41.523775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:41.523775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:41.523775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:41.523775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:41.523775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:41.523775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:41.523775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:41.523775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:41.523775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:41.523775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:41.523775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:41.524698 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:02:41.524698 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:02:41.524698 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:02:41.524698 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:02:41.524698 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:02:41.524698 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:02:41.524698 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:41.524698 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:41.531866 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 472/942] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:41.533426 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf35ad3-5232-4cf3-9bb3-c3795a96035c None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:41.543224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b8880-a79e-42c2-97f9-24c26a47fc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:41.543861 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b8880-a79e-42c2-97f9-24c26a47fc46 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:41.544140 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b8880-a79e-42c2-97f9-24c26a47fc46 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:41.544410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b8880-a79e-42c2-97f9-24c26a47fc46 None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:41.545193 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b8880-a79e-42c2-97f9-24c26a47fc46 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:41.545502 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b8880-a79e-42c2-97f9-24c26a47fc46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:41.547062 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b8880-a79e-42c2-97f9-24c26a47fc46 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:41.572939 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 471/943] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Sep 28 12:02:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:41.573843 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b8880-a79e-42c2-97f9-24c26a47fc46 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:41.622491 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:41.646534 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf35ad3-5232-4cf3-9bb3-c3795a96035c None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:41.682063 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b8880-a79e-42c2-97f9-24c26a47fc46 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:41.682261 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e9183-1b6c-4f49-ba2d-87486d462219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:41.682835 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e9183-1b6c-4f49-ba2d-87486d462219 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:41.683112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e9183-1b6c-4f49-ba2d-87486d462219 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:41.683380 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e9183-1b6c-4f49-ba2d-87486d462219 None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:41.684067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e9183-1b6c-4f49-ba2d-87486d462219 None admin] RBAC: Adding query filter params (name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:41.684362 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e9183-1b6c-4f49-ba2d-87486d462219 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:41.685786 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e9183-1b6c-4f49-ba2d-87486d462219 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:41.715615 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 473/944] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 28 12:02:41 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:41.717125 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299cabf-d91e-4e7a-9fa4-0b81b93bc401 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:41.717412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299cabf-d91e-4e7a-9fa4-0b81b93bc401 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:41.717681 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299cabf-d91e-4e7a-9fa4-0b81b93bc401 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:41.719241 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 474/945] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:41.725486 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816cbb9-ae97-43ae-89c5-cdfe1e72e064 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:41.725787 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816cbb9-ae97-43ae-89c5-cdfe1e72e064 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:41.726038 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816cbb9-ae97-43ae-89c5-cdfe1e72e064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:41.731770 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85206474-1ff1-4732-b2e7-a60675eb07fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:41.732708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85206474-1ff1-4732-b2e7-a60675eb07fc None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:41.733216 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85206474-1ff1-4732-b2e7-a60675eb07fc None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:41.733741 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85206474-1ff1-4732-b2e7-a60675eb07fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:41.735135 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:41.750455 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b816cbb9-ae97-43ae-89c5-cdfe1e72e064 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:41.752363 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b816cbb9-ae97-43ae-89c5-cdfe1e72e064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:41.759753 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85206474-1ff1-4732-b2e7-a60675eb07fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:41.762388 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85206474-1ff1-4732-b2e7-a60675eb07fc None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:41.785239 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-85206474-1ff1-4732-b2e7-a60675eb07fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:41.785239 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:41.785239 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:41.785239 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:41.785239 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:41.785239 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:41.785239 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:41.785239 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:41.785239 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:41.785239 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:41.785239 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:41.785239 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:41.785239 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:41.785239 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:41.785239 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:41.785239 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:41.786328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:41.786328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:41.786328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:41.786328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:41.786328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:41.786328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:41.786328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:41.786328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:41.786328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:41.786328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:41.786328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:41.786328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:41.786328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:41.786328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:41.786328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:41.786328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:41.786328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:41.787240 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:41.787240 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:41.787240 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:41.793622 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 472/946] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:41.794415 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85206474-1ff1-4732-b2e7-a60675eb07fc None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:41.847459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 475/947] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:02:41.916792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:41.922741 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85206474-1ff1-4732-b2e7-a60675eb07fc None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:41.967247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856f904-bb80-4773-b758-f7b85c6ee29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:41.967914 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856f904-bb80-4773-b758-f7b85c6ee29d None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:41.968193 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856f904-bb80-4773-b758-f7b85c6ee29d None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:41.968462 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856f904-bb80-4773-b758-f7b85c6ee29d None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:41.969116 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e856f904-bb80-4773-b758-f7b85c6ee29d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:41.969417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e856f904-bb80-4773-b758-f7b85c6ee29d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:41.970800 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e856f904-bb80-4773-b758-f7b85c6ee29d None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:41.984156 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 473/948] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:41.989955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816cbb9-ae97-43ae-89c5-cdfe1e72e064 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:42.060813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10cab5-c95f-409c-8a65-fbf739d76222 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:42.061071 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10cab5-c95f-409c-8a65-fbf739d76222 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:42.061803 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10cab5-c95f-409c-8a65-fbf739d76222 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:42.063762 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 474/949] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:02:42.074622 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813592cf-6d12-4ea5-bdff-a5a9792a2162 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:42.075036 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813592cf-6d12-4ea5-bdff-a5a9792a2162 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:42.075417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813592cf-6d12-4ea5-bdff-a5a9792a2162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:42.096861 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816cbb9-ae97-43ae-89c5-cdfe1e72e064 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:42.097963 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-813592cf-6d12-4ea5-bdff-a5a9792a2162 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:42.099299 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-813592cf-6d12-4ea5-bdff-a5a9792a2162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:42.131806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:42.137320 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279489a9-2a1b-4990-b5dd-13fe7e745a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:42.138487 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279489a9-2a1b-4990-b5dd-13fe7e745a51 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:42.139005 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279489a9-2a1b-4990-b5dd-13fe7e745a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:42.139729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279489a9-2a1b-4990-b5dd-13fe7e745a51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:42.147132 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279489a9-2a1b-4990-b5dd-13fe7e745a51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:42.148612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279489a9-2a1b-4990-b5dd-13fe7e745a51 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:42.160390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-279489a9-2a1b-4990-b5dd-13fe7e745a51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:42.160390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:42.160390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:42.160390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:42.160390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:42.160390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:42.160390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:42.160390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:42.160390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:42.160390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:42.160390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:42.160390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:42.160390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:02:42.160390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:02:42.160390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:02:42.162032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:02:42.162032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:42.162032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:42.162032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:42.162032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:42.162032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:42.162032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:42.162032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:42.162032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:42.162032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:42.162032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:42.162032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:42.162032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:42.162032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:42.162032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:42.162032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:42.162032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:42.162957 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:02:42.162957 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:02:42.162957 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:02:42.162957 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:02:42.162957 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:02:42.162957 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:02:42.162957 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:42.162957 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:42.162957 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 476/950] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:42.162957 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279489a9-2a1b-4990-b5dd-13fe7e745a51 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:42.183717 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 475/951] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:02:42.184457 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813592cf-6d12-4ea5-bdff-a5a9792a2162 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:42.274655 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:42.282295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279489a9-2a1b-4990-b5dd-13fe7e745a51 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:42.291847 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813592cf-6d12-4ea5-bdff-a5a9792a2162 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:42.320484 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcf7cd-2624-4fe2-b8dc-93ca803c153e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:42.321584 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcf7cd-2624-4fe2-b8dc-93ca803c153e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:42.322085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcf7cd-2624-4fe2-b8dc-93ca803c153e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:42.322562 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcf7cd-2624-4fe2-b8dc-93ca803c153e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:42.323470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcf7cd-2624-4fe2-b8dc-93ca803c153e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:42.325139 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcf7cd-2624-4fe2-b8dc-93ca803c153e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:42.329030 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4ee63-88f2-4872-a477-f34d2d1314ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:42.329637 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4ee63-88f2-4872-a477-f34d2d1314ca None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:42.329912 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4ee63-88f2-4872-a477-f34d2d1314ca None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:42.330180 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4ee63-88f2-4872-a477-f34d2d1314ca None admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:42.331405 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4ee63-88f2-4872-a477-f34d2d1314ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:42.331780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4ee63-88f2-4872-a477-f34d2d1314ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:42.333179 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4ee63-88f2-4872-a477-f34d2d1314ca None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:42.336889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-a9dcf7cd-2624-4fe2-b8dc-93ca803c153e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:02:42.336889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:42.336889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:02:42.336889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:02:42.336889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:02:42.336889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:02:42.336889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:02:42.336889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:42.336889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:02:42.336889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:42.336889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:02:42.336889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:42.336889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:42.336889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:42.336889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:42.336889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:42.336889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:42.337893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:42.337893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:42.337893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:42.337893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:42.337893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:42.337893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:42.337893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:02:42.337893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:02:42.337893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:02:42.337893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:02:42.337893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:42.337893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:42.337893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:42.337893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:42.337893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:42.337893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:42.338908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:42.338908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:42.338908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:42.338908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:42.338908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:42.338908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:42.338908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:42.338908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:42.338908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:42.338908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:42.338908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:02:42.338908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:42.338908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:02:42.338908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:42.341692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 477/952] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 28 12:02:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:42.350428 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcf7cd-2624-4fe2-b8dc-93ca803c153e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:42.351464 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 476/953] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:02:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:42.351751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4ee63-88f2-4872-a477-f34d2d1314ca None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:42.418060 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:42.460478 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4ee63-88f2-4872-a477-f34d2d1314ca None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:42.471195 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcf7cd-2624-4fe2-b8dc-93ca803c153e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:42.503203 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d355bbb-0a4d-4a42-b2cf-13d21b786a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:42.504152 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d355bbb-0a4d-4a42-b2cf-13d21b786a34 None admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:42.504436 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d355bbb-0a4d-4a42-b2cf-13d21b786a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:42.504954 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d355bbb-0a4d-4a42-b2cf-13d21b786a34 None admin] PATH_INFO: `/v3/projects/c854d366f35145e8b2fadb9b014d0199/users/c0e57ea982d349c1a86b544e9a6e7758/roles/d36bf69b347c431a8923d10a00d66e1c` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:42.507983 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d355bbb-0a4d-4a42-b2cf-13d21b786a34 None admin] RBAC: Authorizing `identity:create_grant(project_id=c854d366f35145e8b2fadb9b014d0199, user_id=c0e57ea982d349c1a86b544e9a6e7758, role_id=d36bf69b347c431a8923d10a00d66e1c)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:42.509511 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d355bbb-0a4d-4a42-b2cf-13d21b786a34 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:42.510238 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b303c6-14d9-4640-a3ed-f0fefafadd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:42.510836 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b303c6-14d9-4640-a3ed-f0fefafadd70 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:42.511109 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b303c6-14d9-4640-a3ed-f0fefafadd70 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:42.511372 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b303c6-14d9-4640-a3ed-f0fefafadd70 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:42.512037 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b303c6-14d9-4640-a3ed-f0fefafadd70 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:42.512334 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b303c6-14d9-4640-a3ed-f0fefafadd70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:42.513760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b303c6-14d9-4640-a3ed-f0fefafadd70 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:42.519728 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 478/954] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 28 12:02:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:42.519943 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b303c6-14d9-4640-a3ed-f0fefafadd70 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:42.526357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 477/955] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 28 12:02:42 2022] PUT /identity/v3/projects/c854d366f35145e8b2fadb9b014d0199/users/c0e57ea982d349c1a86b544e9a6e7758/roles/d36bf69b347c431a8923d10a00d66e1c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:02:42.528327 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d355bbb-0a4d-4a42-b2cf-13d21b786a34 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:42.540471 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:42.660327 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b303c6-14d9-4640-a3ed-f0fefafadd70 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:42.684500 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d355bbb-0a4d-4a42-b2cf-13d21b786a34 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:42.684895 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:42.710104 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb3071-2bfa-48bc-829e-0e9a92953e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:42.710750 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb3071-2bfa-48bc-829e-0e9a92953e60 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:42.711022 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb3071-2bfa-48bc-829e-0e9a92953e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:42.711295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb3071-2bfa-48bc-829e-0e9a92953e60 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:42.711912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb3071-2bfa-48bc-829e-0e9a92953e60 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:42.713386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb3071-2bfa-48bc-829e-0e9a92953e60 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:42.723974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-2cdb3071-2bfa-48bc-829e-0e9a92953e60 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 28 12:02:42.723974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:42.723974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:02:42.723974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:02:42.723974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:02:42.723974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:02:42.723974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:02:42.723974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:42.723974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 28 12:02:42.723974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:42.723974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:02:42.723974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:42.723974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:42.723974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:42.723974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:42.723974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:42.723974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:42.725146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:42.725146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:42.725146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:42.725146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:42.725146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:42.725146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:42.725146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:02:42.725146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:02:42.725146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:02:42.725146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:02:42.725146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:42.725146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:42.725146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:42.725146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:42.725146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:42.725146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:42.726027 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:42.726027 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:42.726027 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:42.726027 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:42.726027 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:42.726027 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:42.726027 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:42.726027 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:42.726027 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:42.726027 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:42.726027 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:02:42.726027 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:42.726027 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 28 12:02:42.726027 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:42.726774 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 479/956] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:42.734092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb3071-2bfa-48bc-829e-0e9a92953e60 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:42.744986 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43151d5c-f85b-4a69-9d09-f6990b310e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:42.744986 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43151d5c-f85b-4a69-9d09-f6990b310e77 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:42.744986 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43151d5c-f85b-4a69-9d09-f6990b310e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:42.744986 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43151d5c-f85b-4a69-9d09-f6990b310e77 None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:42.745480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43151d5c-f85b-4a69-9d09-f6990b310e77 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:42.745710 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43151d5c-f85b-4a69-9d09-f6990b310e77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:42.747115 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43151d5c-f85b-4a69-9d09-f6990b310e77 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:42.753876 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 478/957] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 28 12:02:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:42.759397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43151d5c-f85b-4a69-9d09-f6990b310e77 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:42.831576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:42.859429 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb3071-2bfa-48bc-829e-0e9a92953e60 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:42.864997 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43151d5c-f85b-4a69-9d09-f6990b310e77 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:42.899476 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506d81e-459d-4887-ba2a-ae6a5218227b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:42.900191 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506d81e-459d-4887-ba2a-ae6a5218227b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:42.900559 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506d81e-459d-4887-ba2a-ae6a5218227b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:42.900834 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506d81e-459d-4887-ba2a-ae6a5218227b None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:42.900959 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fe0f8-dcd7-4d81-b476-74895d389773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:42.901441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fe0f8-dcd7-4d81-b476-74895d389773 None admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:42.901544 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506d81e-459d-4887-ba2a-ae6a5218227b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:42.901716 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fe0f8-dcd7-4d81-b476-74895d389773 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:42.901824 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506d81e-459d-4887-ba2a-ae6a5218227b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:42.901979 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fe0f8-dcd7-4d81-b476-74895d389773 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:42.902637 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fe0f8-dcd7-4d81-b476-74895d389773 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:42.903088 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506d81e-459d-4887-ba2a-ae6a5218227b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:42.904027 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fe0f8-dcd7-4d81-b476-74895d389773 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:42.908639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 480/958] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 28 12:02:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:42.915389 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506d81e-459d-4887-ba2a-ae6a5218227b None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:42.943475 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 479/959] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:02:42 2022] POST /identity/v3/endpoints => generated 349 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:02:42.975404 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:43.035250 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506d81e-459d-4887-ba2a-ae6a5218227b None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:43.078261 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73af915-ad48-49de-a4f3-dafd2b368bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:43.078878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73af915-ad48-49de-a4f3-dafd2b368bdf None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:43.079155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73af915-ad48-49de-a4f3-dafd2b368bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:43.079425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73af915-ad48-49de-a4f3-dafd2b368bdf None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:43.080130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73af915-ad48-49de-a4f3-dafd2b368bdf None admin] RBAC: Adding query filter params (type=compute) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:43.080437 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73af915-ad48-49de-a4f3-dafd2b368bdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:43.082394 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73af915-ad48-49de-a4f3-dafd2b368bdf None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:43.088015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 481/960] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 28 12:02:42 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:44.067602 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79ff84-2f4f-4d9e-be29-1fc8356df0b1 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:44.068124 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79ff84-2f4f-4d9e-be29-1fc8356df0b1 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:44.068205 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79ff84-2f4f-4d9e-be29-1fc8356df0b1 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:44.069721 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 480/961] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:44.075468 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e756d45-296b-484d-8f2e-a9223752a122 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:44.075876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e756d45-296b-484d-8f2e-a9223752a122 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:44.076058 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e756d45-296b-484d-8f2e-a9223752a122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:44.094916 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-0e756d45-296b-484d-8f2e-a9223752a122 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:44.096137 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0e756d45-296b-484d-8f2e-a9223752a122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:44.169399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 482/962] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:02:44.449730 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79ff84-2f4f-4d9e-be29-1fc8356df0b1 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:44.556719 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79ff84-2f4f-4d9e-be29-1fc8356df0b1 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:44.583400 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:44.593235 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d99afc-fbcc-464c-9d10-c52368279d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:44.594144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d99afc-fbcc-464c-9d10-c52368279d2d None admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:44.594655 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d99afc-fbcc-464c-9d10-c52368279d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:44.595290 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d99afc-fbcc-464c-9d10-c52368279d2d None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:44.596164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d99afc-fbcc-464c-9d10-c52368279d2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:44.598507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d99afc-fbcc-464c-9d10-c52368279d2d None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:44.601391 dv-cinder-859193-2-smb devstack@keystone.service[81599]: WARNING keystone.server.flask.common [None req-60d99afc-fbcc-464c-9d10-c52368279d2d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 28 12:02:44.616099 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.sql.core [None req-60d99afc-fbcc-464c-9d10-c52368279d2d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 28 12:02:44.616099 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 28 12:02:44.616099 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [parameters: {'user_id': '421ee0dd975d49199287f6f0dbc2513d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 28 12:02:44.616099 dv-cinder-859193-2-smb devstack@keystone.service[81599]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81599) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 28 12:02:44.634101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-60d99afc-fbcc-464c-9d10-c52368279d2d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 28 12:02:44.634101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:44.634101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 28 12:02:44.634101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 28 12:02:44.634101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 28 12:02:44.634101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 28 12:02:44.634101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 28 12:02:44.634101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application result = self._query(query) Sep 28 12:02:44.634101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 28 12:02:44.634101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application conn.query(q) Sep 28 12:02:44.634101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 28 12:02:44.634101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 28 12:02:44.634101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 28 12:02:44.634101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application result.read() Sep 28 12:02:44.634101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 28 12:02:44.635026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 28 12:02:44.635026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 28 12:02:44.635026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 28 12:02:44.635026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 28 12:02:44.635026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 28 12:02:44.635026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 28 12:02:44.635026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 28 12:02:44.635026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 28 12:02:44.635026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:44.635026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 28 12:02:44.635026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:44.635026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:44.635026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 28 12:02:44.635026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 28 12:02:44.635026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 28 12:02:44.635026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 28 12:02:44.635026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 28 12:02:44.635026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application next(self.gen) Sep 28 12:02:44.636110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 28 12:02:44.636110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application yield resource Sep 28 12:02:44.636110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 28 12:02:44.636110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application next(self.gen) Sep 28 12:02:44.636110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 28 12:02:44.636110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self.session.rollback() Sep 28 12:02:44.636110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 28 12:02:44.636110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self.force_reraise() Sep 28 12:02:44.636110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 28 12:02:44.636110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise self.value Sep 28 12:02:44.636110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 28 12:02:44.636110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 28 12:02:44.636110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 28 12:02:44.636110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application session.commit() Sep 28 12:02:44.636110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 28 12:02:44.636110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 28 12:02:44.636110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 28 12:02:44.637034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self._prepare_impl() Sep 28 12:02:44.637034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 28 12:02:44.637034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self.session.flush() Sep 28 12:02:44.637034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 28 12:02:44.637034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self._flush(objects) Sep 28 12:02:44.637034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 28 12:02:44.637034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 28 12:02:44.637034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 28 12:02:44.637034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application compat.raise_( Sep 28 12:02:44.637034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 28 12:02:44.637034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception Sep 28 12:02:44.637034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 28 12:02:44.637034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application flush_context.execute() Sep 28 12:02:44.637034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 28 12:02:44.637034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rec.execute(self) Sep 28 12:02:44.637034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 28 12:02:44.637034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 28 12:02:44.637949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 28 12:02:44.637949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 28 12:02:44.637949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 28 12:02:44.637949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 28 12:02:44.637949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 28 12:02:44.637949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 28 12:02:44.637949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 28 12:02:44.637949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 28 12:02:44.637949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 28 12:02:44.637949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 28 12:02:44.637949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 28 12:02:44.637949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 28 12:02:44.637949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 28 12:02:44.637949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 28 12:02:44.637949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 28 12:02:44.637949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception Sep 28 12:02:44.638813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 28 12:02:44.638813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 28 12:02:44.638813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 28 12:02:44.638813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 28 12:02:44.638813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 28 12:02:44.638813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application result = self._query(query) Sep 28 12:02:44.638813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 28 12:02:44.638813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application conn.query(q) Sep 28 12:02:44.638813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 28 12:02:44.638813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 28 12:02:44.638813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 28 12:02:44.638813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application result.read() Sep 28 12:02:44.638813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 28 12:02:44.638813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 28 12:02:44.638813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 28 12:02:44.638813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 28 12:02:44.640978 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 28 12:02:44.640978 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 28 12:02:44.640978 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 28 12:02:44.640978 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 28 12:02:44.640978 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 28 12:02:44.640978 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 28 12:02:44.640978 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [parameters: {'user_id': '421ee0dd975d49199287f6f0dbc2513d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 28 12:02:44.640978 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 28 12:02:44.640978 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:44.640978 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:02:44.640978 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:44.640978 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:44.640978 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:44.640978 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:44.640978 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:44.642901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:44.642901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:44.642901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:44.642901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:44.642901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:44.642901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:44.642901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:44.642901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 28 12:02:44.642901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 28 12:02:44.642901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:44.642901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:44.642901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:02:44.642901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:44.642901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:02:44.642901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:44.642901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 28 12:02:44.642901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 28 12:02:44.645183 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 28 12:02:44.645183 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 28 12:02:44.645183 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 28 12:02:44.645183 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 28 12:02:44.645183 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 28 12:02:44.645183 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:44.647638 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 481/963] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Sep 28 12:02:44 2022] POST /identity/v3/users => generated 160 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:44.655600 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e756d45-296b-484d-8f2e-a9223752a122 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:44.705215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:44.770297 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e756d45-296b-484d-8f2e-a9223752a122 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:44.792171 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7658c8-20c4-4769-be49-2768fb61537e None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:44.792496 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7658c8-20c4-4769-be49-2768fb61537e None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:44.793279 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7658c8-20c4-4769-be49-2768fb61537e None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:44.799505 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 482/964] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:44.805213 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e1883-be37-43ab-8788-7268da3fc238 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:44.805496 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e1883-be37-43ab-8788-7268da3fc238 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:44.805773 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e1883-be37-43ab-8788-7268da3fc238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:44.810639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f248aa-ebb9-4516-8b76-7dc3b0c13f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:44.811282 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f248aa-ebb9-4516-8b76-7dc3b0c13f6d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:44.811594 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f248aa-ebb9-4516-8b76-7dc3b0c13f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:44.812004 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f248aa-ebb9-4516-8b76-7dc3b0c13f6d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:44.820561 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f248aa-ebb9-4516-8b76-7dc3b0c13f6d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:44.822016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f248aa-ebb9-4516-8b76-7dc3b0c13f6d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:44.825905 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-578e1883-be37-43ab-8788-7268da3fc238 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:44.827693 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-578e1883-be37-43ab-8788-7268da3fc238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:44.834959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-e9f248aa-ebb9-4516-8b76-7dc3b0c13f6d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 28 12:02:44.834959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:44.834959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:44.834959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:44.834959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:44.834959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:44.834959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:44.834959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:44.834959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:44.834959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:44.834959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:44.834959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:44.834959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:02:44.834959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:02:44.834959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:02:44.834959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:02:44.836002 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:44.836002 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:44.836002 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:02:44.836002 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:44.836002 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:02:44.836002 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:44.836002 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:44.836002 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:44.836002 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:44.836002 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:44.836002 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:44.836002 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:44.836002 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:44.836002 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:44.836002 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:44.836002 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:44.836002 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:44.836002 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:44.837638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:44.837638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:44.837638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:02:44.837638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:02:44.837638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:02:44.837638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:02:44.837638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:02:44.837638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:02:44.837638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 28 12:02:44.837638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:44.837638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 483/965] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:02:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:44.842153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f248aa-ebb9-4516-8b76-7dc3b0c13f6d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:44.907546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 483/966] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:02:44.949545 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:44.953702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f248aa-ebb9-4516-8b76-7dc3b0c13f6d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:44.990104 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d83176-0725-4d22-8031-01463427a641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:44.990683 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d83176-0725-4d22-8031-01463427a641 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:44.990967 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d83176-0725-4d22-8031-01463427a641 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:44.991528 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d83176-0725-4d22-8031-01463427a641 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:44.992237 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d83176-0725-4d22-8031-01463427a641 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:44.992540 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d83176-0725-4d22-8031-01463427a641 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:44.993958 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d83176-0725-4d22-8031-01463427a641 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:45.030085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 484/967] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 28 12:02:44 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:45.173876 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e1883-be37-43ab-8788-7268da3fc238 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:45.178999 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8627c-63b2-4c7e-847e-a1ce0e59cf81 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:45.180091 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8627c-63b2-4c7e-847e-a1ce0e59cf81 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:45.180576 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8627c-63b2-4c7e-847e-a1ce0e59cf81 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:45.182666 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 485/968] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:02:45.189605 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040c24d-b66a-4ff7-9ab6-4e93d876e2e9 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:45.190844 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040c24d-b66a-4ff7-9ab6-4e93d876e2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:45.191326 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040c24d-b66a-4ff7-9ab6-4e93d876e2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:45.219345 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-3040c24d-b66a-4ff7-9ab6-4e93d876e2e9 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:45.220928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3040c24d-b66a-4ff7-9ab6-4e93d876e2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:45.305448 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e1883-be37-43ab-8788-7268da3fc238 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:45.305802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 486/969] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:02:45.307375 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6457a0-5790-455f-b118-229564532a3e None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:45.307690 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6457a0-5790-455f-b118-229564532a3e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:45.307966 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6457a0-5790-455f-b118-229564532a3e None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:45.309295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 487/970] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:45.316696 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f96db-5bf9-410c-8f9b-0a819d4a121d None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:45.317246 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f96db-5bf9-410c-8f9b-0a819d4a121d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:45.317515 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f96db-5bf9-410c-8f9b-0a819d4a121d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:45.323714 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:45.343020 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b09f96db-5bf9-410c-8f9b-0a819d4a121d None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:45.344414 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b09f96db-5bf9-410c-8f9b-0a819d4a121d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:45.345597 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f7920-2b44-4cd1-8449-f4cb2b54e46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:45.346244 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f7920-2b44-4cd1-8449-f4cb2b54e46f None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:45.347060 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f7920-2b44-4cd1-8449-f4cb2b54e46f None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:45.347326 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f7920-2b44-4cd1-8449-f4cb2b54e46f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:45.363572 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f7920-2b44-4cd1-8449-f4cb2b54e46f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:02:45.368823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-9b3f7920-2b44-4cd1-8449-f4cb2b54e46f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 12:02:45.368823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:45.368823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:45.368823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:45.368823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:45.368823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:45.368823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:45.368823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:45.368823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:45.368823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:45.368823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:45.368823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:45.368823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:02:45.368823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:02:45.368823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:02:45.368823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:02:45.369780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:02:45.369780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:02:45.369780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:02:45.369780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:02:45.369780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:45.369780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:45.369780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:45.369780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:45.369780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:45.369780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:45.369780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:45.369780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:45.369780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:45.369780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:45.369780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:45.369780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:45.370661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:45.370661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:45.370661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:45.370661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:45.370661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:02:45.370661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:02:45.370661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:02:45.370661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:02:45.370661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:02:45.370661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:02:45.370661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 12:02:45.370661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:45.370661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 484/971] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Sep 28 12:02:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:45.376219 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f7920-2b44-4cd1-8449-f4cb2b54e46f None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:45.437952 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 488/972] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:02:45.488152 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f7920-2b44-4cd1-8449-f4cb2b54e46f None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:45.522131 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc35d6-659d-4e02-bae4-14cbbd73afaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:45.522807 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc35d6-659d-4e02-bae4-14cbbd73afaf None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:45.523155 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc35d6-659d-4e02-bae4-14cbbd73afaf None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:45.523528 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc35d6-659d-4e02-bae4-14cbbd73afaf None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:45.524255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc35d6-659d-4e02-bae4-14cbbd73afaf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:45.524627 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc35d6-659d-4e02-bae4-14cbbd73afaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:45.526173 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc35d6-659d-4e02-bae4-14cbbd73afaf None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:45.534292 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 485/973] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Sep 28 12:02:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:45.540597 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f96db-5bf9-410c-8f9b-0a819d4a121d None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:45.559589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:45.578679 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc35d6-659d-4e02-bae4-14cbbd73afaf None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:45.620156 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:45.645378 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f96db-5bf9-410c-8f9b-0a819d4a121d None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:45.681815 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc35d6-659d-4e02-bae4-14cbbd73afaf None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:45.683372 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac9bab-8473-40c8-8ade-f4e596aebd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:45.684932 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac9bab-8473-40c8-8ade-f4e596aebd7f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:45.685314 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac9bab-8473-40c8-8ade-f4e596aebd7f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:45.685685 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac9bab-8473-40c8-8ade-f4e596aebd7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:45.699238 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac9bab-8473-40c8-8ade-f4e596aebd7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:45.702623 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac9bab-8473-40c8-8ade-f4e596aebd7f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:45.718596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-cfac9bab-8473-40c8-8ade-f4e596aebd7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:45.718596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:45.718596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:45.718596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:45.718596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:45.718596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:45.718596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:45.718596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:45.718596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:45.718596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:45.718596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:45.718596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:45.718596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:45.718596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:45.718596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:45.718596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:45.719811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:45.719811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:45.719811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:45.719811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:45.719811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:45.719811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:45.719811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:45.719811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:45.719811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:45.719811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:45.719811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:45.719811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:45.719811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:45.719811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:45.719811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:45.719811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:45.719811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:45.720939 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:45.720939 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:45.720939 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:45.720939 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 489/974] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:45.720939 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac9bab-8473-40c8-8ade-f4e596aebd7f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:45.722188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904848c9-e52c-4436-961e-ab9d8358e8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:45.722818 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904848c9-e52c-4436-961e-ab9d8358e8c8 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:45.723092 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904848c9-e52c-4436-961e-ab9d8358e8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:45.723357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904848c9-e52c-4436-961e-ab9d8358e8c8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:45.723977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904848c9-e52c-4436-961e-ab9d8358e8c8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:45.725436 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904848c9-e52c-4436-961e-ab9d8358e8c8 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:45.740022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-904848c9-e52c-4436-961e-ab9d8358e8c8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:02:45.740022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:45.740022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:02:45.740022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:02:45.740022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:02:45.740022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:02:45.740022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:02:45.740022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:45.740022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:02:45.740022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:45.740022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:02:45.740022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:45.740022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:45.740022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:45.740022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:45.740022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:45.740022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:45.741510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:45.741510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:45.741510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:45.741510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:45.741510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:45.741510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:45.741510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:02:45.741510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:02:45.741510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:02:45.741510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:02:45.741510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:45.741510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:45.741510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:45.741510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:45.741510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:45.741510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:45.742615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:45.742615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:45.742615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:45.742615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:45.742615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:45.742615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:45.742615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:45.742615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:45.742615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:45.742615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:45.742615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:02:45.742615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:45.742615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:02:45.742615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:45.742615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 486/975] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 28 12:02:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:45.743954 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904848c9-e52c-4436-961e-ab9d8358e8c8 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:45.789049 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:45.825782 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac9bab-8473-40c8-8ade-f4e596aebd7f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:45.842722 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904848c9-e52c-4436-961e-ab9d8358e8c8 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:45.845406 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:45.858693 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4283011-ba82-4dfb-b0bc-708f50d6338a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:45.859298 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4283011-ba82-4dfb-b0bc-708f50d6338a None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:45.859610 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4283011-ba82-4dfb-b0bc-708f50d6338a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:45.859882 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4283011-ba82-4dfb-b0bc-708f50d6338a None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:45.860551 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4283011-ba82-4dfb-b0bc-708f50d6338a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:45.861888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4283011-ba82-4dfb-b0bc-708f50d6338a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:45.876277 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 490/976] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 28 12:02:45 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:02:45.877067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4283011-ba82-4dfb-b0bc-708f50d6338a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:45.894700 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26595fed-f5f9-4bda-97d7-e4eeac4e7293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:45.895321 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26595fed-f5f9-4bda-97d7-e4eeac4e7293 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:45.895631 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26595fed-f5f9-4bda-97d7-e4eeac4e7293 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:45.895895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26595fed-f5f9-4bda-97d7-e4eeac4e7293 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:45.896547 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26595fed-f5f9-4bda-97d7-e4eeac4e7293 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:45.896852 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26595fed-f5f9-4bda-97d7-e4eeac4e7293 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:45.898231 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26595fed-f5f9-4bda-97d7-e4eeac4e7293 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:45.911925 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 487/977] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:45.917716 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26595fed-f5f9-4bda-97d7-e4eeac4e7293 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:46.002203 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4283011-ba82-4dfb-b0bc-708f50d6338a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:46.033067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:46.033284 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26595fed-f5f9-4bda-97d7-e4eeac4e7293 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:46.043723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2557c-8a97-40ba-b40c-3950d5869b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:46.045002 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2557c-8a97-40ba-b40c-3950d5869b75 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:46.045277 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2557c-8a97-40ba-b40c-3950d5869b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:46.045543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2557c-8a97-40ba-b40c-3950d5869b75 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:46.046177 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2557c-8a97-40ba-b40c-3950d5869b75 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:46.046478 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2557c-8a97-40ba-b40c-3950d5869b75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:46.047860 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2557c-8a97-40ba-b40c-3950d5869b75 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:46.053740 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 491/978] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 28 12:02:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:46.059482 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2557c-8a97-40ba-b40c-3950d5869b75 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:46.083141 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930da64-2f63-4228-be5a-5bfe6a022c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:46.083739 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930da64-2f63-4228-be5a-5bfe6a022c8a None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:46.084017 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930da64-2f63-4228-be5a-5bfe6a022c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:46.084284 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930da64-2f63-4228-be5a-5bfe6a022c8a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:46.091940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930da64-2f63-4228-be5a-5bfe6a022c8a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:46.093391 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930da64-2f63-4228-be5a-5bfe6a022c8a None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:46.106500 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-b930da64-2f63-4228-be5a-5bfe6a022c8a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 12:02:46.106500 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:46.106500 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:46.106500 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:46.106500 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:46.106500 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:46.106500 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:46.106500 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:46.106500 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:46.106500 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:46.106500 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:46.106500 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:46.106500 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:02:46.106500 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:02:46.106500 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:02:46.106500 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:02:46.107507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:46.107507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:46.107507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:02:46.107507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:46.107507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:02:46.107507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:46.107507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:46.107507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:46.107507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:46.107507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:46.107507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:46.107507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:46.107507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:46.107507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:46.107507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:46.107507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:46.107507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:46.107507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:46.108490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:46.108490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:46.108490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:02:46.108490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:02:46.108490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:02:46.108490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:02:46.108490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:02:46.108490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:02:46.108490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 12:02:46.108490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:46.108490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 488/979] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 28 12:02:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:46.115303 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930da64-2f63-4228-be5a-5bfe6a022c8a None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:46.138804 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:46.184139 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2557c-8a97-40ba-b40c-3950d5869b75 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:46.220426 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33472e-47f4-45ac-9be2-2ce92d87b689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:46.221109 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33472e-47f4-45ac-9be2-2ce92d87b689 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:46.221886 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33472e-47f4-45ac-9be2-2ce92d87b689 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:46.222167 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33472e-47f4-45ac-9be2-2ce92d87b689 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:46.222812 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33472e-47f4-45ac-9be2-2ce92d87b689 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:46.223121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33472e-47f4-45ac-9be2-2ce92d87b689 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:46.223457 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930da64-2f63-4228-be5a-5bfe6a022c8a None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:46.224577 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33472e-47f4-45ac-9be2-2ce92d87b689 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:46.235018 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 492/980] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 28 12:02:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:46.236047 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33472e-47f4-45ac-9be2-2ce92d87b689 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:46.265010 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2ce49-c9d8-4bf5-83b8-4e298b744dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:46.265683 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2ce49-c9d8-4bf5-83b8-4e298b744dda None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:46.265969 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2ce49-c9d8-4bf5-83b8-4e298b744dda None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:46.266247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2ce49-c9d8-4bf5-83b8-4e298b744dda None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:46.267031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2ce49-c9d8-4bf5-83b8-4e298b744dda None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:46.267342 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2ce49-c9d8-4bf5-83b8-4e298b744dda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:46.269361 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2ce49-c9d8-4bf5-83b8-4e298b744dda None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:46.287323 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 489/981] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Sep 28 12:02:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:46.292653 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2ce49-c9d8-4bf5-83b8-4e298b744dda None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:46.297930 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:46.347465 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33472e-47f4-45ac-9be2-2ce92d87b689 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:46.379613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:46.385444 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ac859-5eb5-46e9-89b5-5bb1500084db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:46.386054 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ac859-5eb5-46e9-89b5-5bb1500084db None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:46.386330 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ac859-5eb5-46e9-89b5-5bb1500084db None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:46.386597 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ac859-5eb5-46e9-89b5-5bb1500084db None admin] PATH_INFO: `/v3/endpoints` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:46.387372 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ac859-5eb5-46e9-89b5-5bb1500084db None admin] RBAC: Adding query filter params (interface=admin, service_id=3f10be4d7e2c4753b93fbcfa58f3fdd0, region_id=RegionOne) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:46.387701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ac859-5eb5-46e9-89b5-5bb1500084db None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:46.389047 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ac859-5eb5-46e9-89b5-5bb1500084db None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:46.401066 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 493/982] 10.222.0.16 () {56 vars in 1249 bytes} [Wed Sep 28 12:02:46 2022] GET /identity/v3/endpoints?service_id=3f10be4d7e2c4753b93fbcfa58f3fdd0&interface=admin®ion_id=RegionOne => generated 193 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:46.402347 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ac859-5eb5-46e9-89b5-5bb1500084db None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:46.407291 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2ce49-c9d8-4bf5-83b8-4e298b744dda None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:46.442850 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769babb-e2d9-4297-83ca-3dfa5a17513d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:46.443480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769babb-e2d9-4297-83ca-3dfa5a17513d None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:46.443752 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769babb-e2d9-4297-83ca-3dfa5a17513d None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:46.444021 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769babb-e2d9-4297-83ca-3dfa5a17513d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:46.510438 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ac859-5eb5-46e9-89b5-5bb1500084db None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:46.515154 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769babb-e2d9-4297-83ca-3dfa5a17513d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:46.516653 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769babb-e2d9-4297-83ca-3dfa5a17513d None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:46.530792 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:46.546220 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8dd335-5e29-49c2-b44d-0c8d5c4e84c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:46.546838 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dd335-5e29-49c2-b44d-0c8d5c4e84c1 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:46.547121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dd335-5e29-49c2-b44d-0c8d5c4e84c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:46.547399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dd335-5e29-49c2-b44d-0c8d5c4e84c1 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:46.548068 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8dd335-5e29-49c2-b44d-0c8d5c4e84c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:46.550191 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8dd335-5e29-49c2-b44d-0c8d5c4e84c1 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:46.567464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 494/983] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Sep 28 12:02:46 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:02:46.614066 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:46.640301 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 490/984] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:02:46 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 28 12:02:46.646349 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8dd335-5e29-49c2-b44d-0c8d5c4e84c1 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:46.760383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8dd335-5e29-49c2-b44d-0c8d5c4e84c1 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:46.796088 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ecb2a-4641-4185-a769-40048428f154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:46.796721 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ecb2a-4641-4185-a769-40048428f154 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:46.796996 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ecb2a-4641-4185-a769-40048428f154 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:46.797263 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ecb2a-4641-4185-a769-40048428f154 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:46.811859 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ecb2a-4641-4185-a769-40048428f154 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:46.813289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ecb2a-4641-4185-a769-40048428f154 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:46.828039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-ba8ecb2a-4641-4185-a769-40048428f154 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:46.828039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:46.828039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:46.828039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:46.828039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:46.828039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:46.828039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:46.828039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:46.828039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:46.828039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:46.828039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:46.828039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:46.828039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:46.828039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:46.828039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:46.828039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:46.829083 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:46.829083 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:46.829083 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:46.829083 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:46.829083 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:46.829083 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:46.829083 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:46.829083 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:46.829083 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:46.829083 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:46.829083 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:46.829083 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:46.829083 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:46.829083 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:46.829083 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:46.829083 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:46.829083 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:46.830026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:46.830026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:46.830026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:46.830026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 495/985] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:46.835007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769babb-e2d9-4297-83ca-3dfa5a17513d None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:46.937771 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769babb-e2d9-4297-83ca-3dfa5a17513d None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:46.972409 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b59c5-3fa7-4d6e-a59e-abd1eed20d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:46.973014 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b59c5-3fa7-4d6e-a59e-abd1eed20d0a None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:46.973294 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b59c5-3fa7-4d6e-a59e-abd1eed20d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:46.973563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b59c5-3fa7-4d6e-a59e-abd1eed20d0a None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:46.974202 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b59c5-3fa7-4d6e-a59e-abd1eed20d0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:46.974505 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b59c5-3fa7-4d6e-a59e-abd1eed20d0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:46.975901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b59c5-3fa7-4d6e-a59e-abd1eed20d0a None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:46.991879 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 491/986] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:46.993412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ecb2a-4641-4185-a769-40048428f154 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:47.031681 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:47.098674 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ecb2a-4641-4185-a769-40048428f154 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:47.133789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b6d56-0d62-4371-b035-a48a21c7f1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:47.134425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b6d56-0d62-4371-b035-a48a21c7f1b3 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:47.134699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b6d56-0d62-4371-b035-a48a21c7f1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:47.134967 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b6d56-0d62-4371-b035-a48a21c7f1b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:47.141664 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b6d56-0d62-4371-b035-a48a21c7f1b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:47.143091 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b6d56-0d62-4371-b035-a48a21c7f1b3 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:47.154774 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-550b6d56-0d62-4371-b035-a48a21c7f1b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:47.154774 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:47.154774 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:47.154774 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:47.154774 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:47.154774 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:47.154774 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:47.154774 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:47.154774 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:47.154774 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:47.154774 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:47.154774 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:47.154774 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:02:47.154774 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:02:47.154774 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:02:47.155746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:02:47.155746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:47.155746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:47.155746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:47.155746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:47.155746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:47.155746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:47.155746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:47.155746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:47.155746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:47.155746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:47.155746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:47.155746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:47.155746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:47.155746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:47.155746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:47.155746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:47.156733 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:02:47.156733 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:02:47.156733 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:02:47.156733 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:02:47.156733 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:02:47.156733 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:02:47.156733 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:47.156733 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:47.158133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 496/987] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:47.162012 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b59c5-3fa7-4d6e-a59e-abd1eed20d0a None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:47.204016 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:47.267175 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b59c5-3fa7-4d6e-a59e-abd1eed20d0a None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:47.301414 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b48cdc-de6f-4bc3-bc7a-424a02f36764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:47.302029 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b48cdc-de6f-4bc3-bc7a-424a02f36764 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:47.302306 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b48cdc-de6f-4bc3-bc7a-424a02f36764 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:47.302576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b48cdc-de6f-4bc3-bc7a-424a02f36764 None admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:47.303266 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b48cdc-de6f-4bc3-bc7a-424a02f36764 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:47.303653 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b48cdc-de6f-4bc3-bc7a-424a02f36764 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:47.305102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b48cdc-de6f-4bc3-bc7a-424a02f36764 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:47.318189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 492/988] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:02:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:47.323962 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b6d56-0d62-4371-b035-a48a21c7f1b3 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:47.420724 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:47.428356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b6d56-0d62-4371-b035-a48a21c7f1b3 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:47.464447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58010ac8-1f51-4d82-ab93-078773aa2004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:47.464961 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58010ac8-1f51-4d82-ab93-078773aa2004 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:47.465234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58010ac8-1f51-4d82-ab93-078773aa2004 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:47.465501 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58010ac8-1f51-4d82-ab93-078773aa2004 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:47.466226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58010ac8-1f51-4d82-ab93-078773aa2004 None admin] RBAC: Adding query filter params (role.id=d36bf69b347c431a8923d10a00d66e1c, scope.project.id=c854d366f35145e8b2fadb9b014d0199, user.id=c0e57ea982d349c1a86b544e9a6e7758) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:47.466536 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58010ac8-1f51-4d82-ab93-078773aa2004 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:47.467978 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58010ac8-1f51-4d82-ab93-078773aa2004 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:47.479524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 497/989] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:02:47 2022] GET /identity/v3/role_assignments?user.id=c0e57ea982d349c1a86b544e9a6e7758&scope.project.id=c854d366f35145e8b2fadb9b014d0199&role.id=d36bf69b347c431a8923d10a00d66e1c => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:48.061040 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da9c08-81cc-4aec-a815-eebf4de99ef8 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:48.061415 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da9c08-81cc-4aec-a815-eebf4de99ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:48.061634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da9c08-81cc-4aec-a815-eebf4de99ef8 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:48.063073 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 493/990] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:48.068130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786211c3-feca-4bf8-9d4b-cccd2b00f41e None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:48.068424 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786211c3-feca-4bf8-9d4b-cccd2b00f41e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:48.068699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786211c3-feca-4bf8-9d4b-cccd2b00f41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:48.087168 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-786211c3-feca-4bf8-9d4b-cccd2b00f41e None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:48.088383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-786211c3-feca-4bf8-9d4b-cccd2b00f41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:48.155550 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 498/991] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:02:48.421463 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da9c08-81cc-4aec-a815-eebf4de99ef8 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:48.518495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:48.524453 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da9c08-81cc-4aec-a815-eebf4de99ef8 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:48.558126 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5499d44-d629-48a9-a4d6-9a4534e71ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:48.558750 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5499d44-d629-48a9-a4d6-9a4534e71ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:48.559026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5499d44-d629-48a9-a4d6-9a4534e71ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:48.559294 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5499d44-d629-48a9-a4d6-9a4534e71ec0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:48.559908 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5499d44-d629-48a9-a4d6-9a4534e71ec0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:48.561261 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5499d44-d629-48a9-a4d6-9a4534e71ec0 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:48.570482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-a5499d44-d629-48a9-a4d6-9a4534e71ec0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 28 12:02:48.570482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:48.570482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:02:48.570482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:02:48.570482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:02:48.570482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:02:48.570482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:02:48.570482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:48.570482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 28 12:02:48.570482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:48.570482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:02:48.570482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:48.570482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:48.570482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:48.570482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:48.570482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:48.570482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:48.571486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:48.571486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:48.571486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:48.571486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:48.571486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:48.571486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:48.571486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:02:48.571486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:02:48.571486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:02:48.571486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:02:48.571486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:48.571486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:48.571486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:48.571486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:48.571486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:48.571486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:48.572375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:48.572375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:48.572375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:48.572375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:48.572375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:48.572375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:48.572375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:48.572375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:48.572375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:48.572375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:48.572375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:02:48.572375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:48.572375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 28 12:02:48.572375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:48.573743 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 494/992] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:48.577372 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786211c3-feca-4bf8-9d4b-cccd2b00f41e None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:48.672226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:48.682863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786211c3-feca-4bf8-9d4b-cccd2b00f41e None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:48.719585 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161c93d-8518-4223-a800-4be80111ce60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:48.720202 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161c93d-8518-4223-a800-4be80111ce60 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:48.720482 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161c93d-8518-4223-a800-4be80111ce60 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:48.720752 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161c93d-8518-4223-a800-4be80111ce60 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:48.721407 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161c93d-8518-4223-a800-4be80111ce60 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:48.721709 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161c93d-8518-4223-a800-4be80111ce60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:48.723091 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161c93d-8518-4223-a800-4be80111ce60 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:48.732665 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 499/993] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 28 12:02:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:48.733875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5499d44-d629-48a9-a4d6-9a4534e71ec0 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:48.737546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefac509-a721-4cc1-b85a-6798c9e54abe None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:48.737829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefac509-a721-4cc1-b85a-6798c9e54abe None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:48.738105 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefac509-a721-4cc1-b85a-6798c9e54abe None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:48.739576 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 500/994] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:02:48.744693 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a300229-ecc7-470b-b39f-9ae4459a8d97 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:48.744978 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a300229-ecc7-470b-b39f-9ae4459a8d97 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:48.745251 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a300229-ecc7-470b-b39f-9ae4459a8d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:48.763854 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-1a300229-ecc7-470b-b39f-9ae4459a8d97 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:48.765268 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-1a300229-ecc7-470b-b39f-9ae4459a8d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:48.840287 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5499d44-d629-48a9-a4d6-9a4534e71ec0 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:48.841065 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 501/995] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:02:48.876596 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafca49a-6e6c-4441-a247-ed5abb13d8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:48.877191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafca49a-6e6c-4441-a247-ed5abb13d8ce None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:48.877464 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafca49a-6e6c-4441-a247-ed5abb13d8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:48.878311 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafca49a-6e6c-4441-a247-ed5abb13d8ce None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:48.878928 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafca49a-6e6c-4441-a247-ed5abb13d8ce None admin] RBAC: Adding query filter params (type=compute) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:48.879228 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafca49a-6e6c-4441-a247-ed5abb13d8ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:48.880647 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafca49a-6e6c-4441-a247-ed5abb13d8ce None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:48.885732 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 495/996] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 28 12:02:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:48.891355 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a300229-ecc7-470b-b39f-9ae4459a8d97 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:48.974617 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:48.991014 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a300229-ecc7-470b-b39f-9ae4459a8d97 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:49.025294 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243bb84a-f233-4471-8e3d-b34492c3bf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:49.025901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bb84a-f233-4471-8e3d-b34492c3bf78 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:49.026176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bb84a-f233-4471-8e3d-b34492c3bf78 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:49.026443 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bb84a-f233-4471-8e3d-b34492c3bf78 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:49.027137 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243bb84a-f233-4471-8e3d-b34492c3bf78 None admin] RBAC: Adding query filter params (interface=public, service_id=e6ccf6aaa797413cbe53bd1c44e25042, region_id=RegionOne) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:49.027463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243bb84a-f233-4471-8e3d-b34492c3bf78 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:49.028823 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243bb84a-f233-4471-8e3d-b34492c3bf78 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:49.038491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 502/997] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Sep 28 12:02:48 2022] GET /identity/v3/endpoints?service_id=e6ccf6aaa797413cbe53bd1c44e25042&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:49.039457 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafca49a-6e6c-4441-a247-ed5abb13d8ce None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:49.068509 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:49.113403 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243bb84a-f233-4471-8e3d-b34492c3bf78 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:49.144080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafca49a-6e6c-4441-a247-ed5abb13d8ce None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:49.181470 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efde76-d1b6-4adb-8c8f-54add3fc81ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:49.182079 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efde76-d1b6-4adb-8c8f-54add3fc81ec None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:49.182355 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efde76-d1b6-4adb-8c8f-54add3fc81ec None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:49.182657 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efde76-d1b6-4adb-8c8f-54add3fc81ec None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:49.183260 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0efde76-d1b6-4adb-8c8f-54add3fc81ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:49.184661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0efde76-d1b6-4adb-8c8f-54add3fc81ec None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:49.191227 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 496/998] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Sep 28 12:02:49 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:02:49.220149 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243bb84a-f233-4471-8e3d-b34492c3bf78 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:49.259986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cd2f7-a8b1-4a2d-a58a-104fdaa41610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:49.260543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cd2f7-a8b1-4a2d-a58a-104fdaa41610 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:49.260819 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cd2f7-a8b1-4a2d-a58a-104fdaa41610 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:49.261086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cd2f7-a8b1-4a2d-a58a-104fdaa41610 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:49.261676 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cd2f7-a8b1-4a2d-a58a-104fdaa41610 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:49.263059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cd2f7-a8b1-4a2d-a58a-104fdaa41610 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:49.272846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-0f3cd2f7-a8b1-4a2d-a58a-104fdaa41610 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:02:49.272846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:49.272846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:02:49.272846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:02:49.272846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:02:49.272846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:02:49.272846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:02:49.272846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:49.272846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:02:49.272846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:49.272846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:02:49.272846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:49.272846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:49.272846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:49.272846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:49.272846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:49.272846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:49.273955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:49.273955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:49.273955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:49.273955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:49.273955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:49.273955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:49.273955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:02:49.273955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:02:49.273955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:02:49.273955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:02:49.273955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:49.273955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:49.273955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:49.273955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:49.273955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:49.273955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:49.274827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:49.274827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:49.274827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:49.274827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:49.274827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:49.274827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:49.274827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:49.274827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:49.274827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:49.274827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:49.274827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:02:49.274827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:49.274827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:02:49.274827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:49.279492 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 503/999] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 28 12:02:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:49.280360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efde76-d1b6-4adb-8c8f-54add3fc81ec None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:49.380625 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:49.390979 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efde76-d1b6-4adb-8c8f-54add3fc81ec None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:49.426059 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f431450-41f3-4f09-8194-ed68d8d02e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:49.426677 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f431450-41f3-4f09-8194-ed68d8d02e0a None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:49.426975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f431450-41f3-4f09-8194-ed68d8d02e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:49.427199 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f431450-41f3-4f09-8194-ed68d8d02e0a None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:49.427858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f431450-41f3-4f09-8194-ed68d8d02e0a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:49.428162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f431450-41f3-4f09-8194-ed68d8d02e0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:49.429527 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f431450-41f3-4f09-8194-ed68d8d02e0a None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:49.439107 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 497/1000] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 28 12:02:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:49.440626 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cd2f7-a8b1-4a2d-a58a-104fdaa41610 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:49.456547 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:49.547089 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cd2f7-a8b1-4a2d-a58a-104fdaa41610 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:49.586267 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196b058-007c-46e3-b14c-c6f923c944fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:49.586913 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196b058-007c-46e3-b14c-c6f923c944fe None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:49.587165 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196b058-007c-46e3-b14c-c6f923c944fe None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:49.587452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196b058-007c-46e3-b14c-c6f923c944fe None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:49.588164 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b196b058-007c-46e3-b14c-c6f923c944fe None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:49.588470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b196b058-007c-46e3-b14c-c6f923c944fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:49.589877 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b196b058-007c-46e3-b14c-c6f923c944fe None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:49.601131 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 504/1001] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 28 12:02:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:49.602328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f431450-41f3-4f09-8194-ed68d8d02e0a None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:49.693871 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acf843-18ae-42cb-8e29-d7c5c12bfbcf None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:49.694381 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acf843-18ae-42cb-8e29-d7c5c12bfbcf None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:49.694865 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acf843-18ae-42cb-8e29-d7c5c12bfbcf None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:49.696252 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 505/1002] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:02:49.701629 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b890b51-c745-4ccb-a80d-23b55ba1807d None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:49.701917 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b890b51-c745-4ccb-a80d-23b55ba1807d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:49.702194 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b890b51-c745-4ccb-a80d-23b55ba1807d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:49.709955 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f431450-41f3-4f09-8194-ed68d8d02e0a None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:49.721314 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-2b890b51-c745-4ccb-a80d-23b55ba1807d None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:49.722510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-2b890b51-c745-4ccb-a80d-23b55ba1807d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:49.755816 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446be16-3338-4984-adfc-e14ae248f51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:49.756423 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446be16-3338-4984-adfc-e14ae248f51c None admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:49.756768 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446be16-3338-4984-adfc-e14ae248f51c None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:49.756973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446be16-3338-4984-adfc-e14ae248f51c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:49.757622 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446be16-3338-4984-adfc-e14ae248f51c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:49.759022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446be16-3338-4984-adfc-e14ae248f51c None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:49.776940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 498/1003] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:02:49 2022] POST /identity/v3/endpoints => generated 325 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:02:49.812902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 506/1004] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:49 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:02:50.083650 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446be16-3338-4984-adfc-e14ae248f51c None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:50.101975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:50.189905 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446be16-3338-4984-adfc-e14ae248f51c None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:50.223099 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f97cef-5743-4ae0-8a16-dc2c80719fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:50.223749 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f97cef-5743-4ae0-8a16-dc2c80719fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:50.224026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f97cef-5743-4ae0-8a16-dc2c80719fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:50.224291 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f97cef-5743-4ae0-8a16-dc2c80719fc5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:50.224863 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f97cef-5743-4ae0-8a16-dc2c80719fc5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:50.226213 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f97cef-5743-4ae0-8a16-dc2c80719fc5 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:50.235031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-d1f97cef-5743-4ae0-8a16-dc2c80719fc5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 28 12:02:50.235031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:50.235031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:02:50.235031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:02:50.235031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:02:50.235031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:02:50.235031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:02:50.235031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:50.235031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 28 12:02:50.235031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:50.235031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:02:50.235031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:50.235031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:50.235031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:50.235031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:50.235031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:50.235031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:50.236229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:50.236229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:50.236229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:50.236229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:50.236229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:50.236229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:50.236229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:02:50.236229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:02:50.236229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:02:50.236229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:02:50.236229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:50.236229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:50.236229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:50.236229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:50.236229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:50.236229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:50.237621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:50.237621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:50.237621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:50.237621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:50.237621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:50.237621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:50.237621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:50.237621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:50.237621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:50.237621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:50.237621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:02:50.237621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:50.237621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 28 12:02:50.237621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:50.237621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 499/1005] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Sep 28 12:02:50 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:50.244817 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b890b51-c745-4ccb-a80d-23b55ba1807d None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:50.247076 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:50.350547 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b890b51-c745-4ccb-a80d-23b55ba1807d None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:50.384775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc23958-7b61-44b4-92fd-08e7f3cb37b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:50.385381 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc23958-7b61-44b4-92fd-08e7f3cb37b4 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:50.385661 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc23958-7b61-44b4-92fd-08e7f3cb37b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:50.385931 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc23958-7b61-44b4-92fd-08e7f3cb37b4 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:50.386559 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc23958-7b61-44b4-92fd-08e7f3cb37b4 None admin] RBAC: Adding query filter params (name=image) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:50.386862 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc23958-7b61-44b4-92fd-08e7f3cb37b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:50.388305 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc23958-7b61-44b4-92fd-08e7f3cb37b4 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:50.398641 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 507/1006] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:50.400200 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f97cef-5743-4ae0-8a16-dc2c80719fc5 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:50.486776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:50.510462 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f97cef-5743-4ae0-8a16-dc2c80719fc5 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:50.546116 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfd886-e428-4b8b-8b4b-dec8cd166af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:50.546720 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfd886-e428-4b8b-8b4b-dec8cd166af8 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:50.546996 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfd886-e428-4b8b-8b4b-dec8cd166af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:50.547266 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfd886-e428-4b8b-8b4b-dec8cd166af8 None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:50.547924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfd886-e428-4b8b-8b4b-dec8cd166af8 None admin] RBAC: Adding query filter params (type=image) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:50.548227 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfd886-e428-4b8b-8b4b-dec8cd166af8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:50.549619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfd886-e428-4b8b-8b4b-dec8cd166af8 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:50.554359 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 500/1007] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:50 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:51.363084 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5561b75-3e01-44fe-bbaa-e93a5c204dc0 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:51.363630 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5561b75-3e01-44fe-bbaa-e93a5c204dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:51.363734 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5561b75-3e01-44fe-bbaa-e93a5c204dc0 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:51.365028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 508/1008] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:51.370468 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a49864-ebdc-450b-8529-db9b222ae4a4 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:51.370759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a49864-ebdc-450b-8529-db9b222ae4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:51.371036 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a49864-ebdc-450b-8529-db9b222ae4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:51.389746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-89a49864-ebdc-450b-8529-db9b222ae4a4 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:51.390932 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-89a49864-ebdc-450b-8529-db9b222ae4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:51.461677 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 501/1009] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:51 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:02:51.730772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5561b75-3e01-44fe-bbaa-e93a5c204dc0 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:51.799030 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:51.838158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5561b75-3e01-44fe-bbaa-e93a5c204dc0 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:51.874613 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8a3b7-bfae-49b0-89bc-9688f1b5695e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:51.875242 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8a3b7-bfae-49b0-89bc-9688f1b5695e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:51.875548 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8a3b7-bfae-49b0-89bc-9688f1b5695e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:51.875822 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8a3b7-bfae-49b0-89bc-9688f1b5695e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:51.876401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8a3b7-bfae-49b0-89bc-9688f1b5695e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:51.877805 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8a3b7-bfae-49b0-89bc-9688f1b5695e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:51.886520 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-52b8a3b7-bfae-49b0-89bc-9688f1b5695e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 28 12:02:51.886520 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:51.886520 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:02:51.886520 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:02:51.886520 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:02:51.886520 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:02:51.886520 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:02:51.886520 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:51.886520 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 28 12:02:51.886520 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:51.886520 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:02:51.886520 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:51.886520 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:51.886520 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:51.886520 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:51.886520 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:51.886520 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:51.887852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:51.887852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:51.887852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:51.887852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:51.887852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:51.887852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:51.887852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:02:51.887852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:02:51.887852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:02:51.887852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:02:51.887852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:51.887852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:51.887852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:51.887852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:51.887852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:51.887852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:51.888748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:51.888748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:51.888748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:51.888748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:51.888748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:51.888748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:51.888748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:51.888748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:51.888748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:51.888748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:51.888748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:02:51.888748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:51.888748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 28 12:02:51.888748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:51.889993 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 509/1010] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:51.893989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a49864-ebdc-450b-8529-db9b222ae4a4 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:51.944501 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786efb3b-154c-4920-bb6b-da11c6607cef None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:51.944822 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786efb3b-154c-4920-bb6b-da11c6607cef None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:51.945052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786efb3b-154c-4920-bb6b-da11c6607cef None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:51.946533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 510/1011] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:02:51.951285 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa4a34-c577-4b74-a632-46eee67d3ae1 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:51.951613 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa4a34-c577-4b74-a632-46eee67d3ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:51.951891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa4a34-c577-4b74-a632-46eee67d3ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:51.965395 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:51.970068 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-35fa4a34-c577-4b74-a632-46eee67d3ae1 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:51.971296 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-35fa4a34-c577-4b74-a632-46eee67d3ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:51.999747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a49864-ebdc-450b-8529-db9b222ae4a4 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:52.036580 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22e955-3fa6-4cf2-b177-b65c7aff5b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:52.037191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22e955-3fa6-4cf2-b177-b65c7aff5b41 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:52.037470 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22e955-3fa6-4cf2-b177-b65c7aff5b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:52.037737 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22e955-3fa6-4cf2-b177-b65c7aff5b41 None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:52.038355 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22e955-3fa6-4cf2-b177-b65c7aff5b41 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:52.038656 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22e955-3fa6-4cf2-b177-b65c7aff5b41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:52.040047 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22e955-3fa6-4cf2-b177-b65c7aff5b41 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:52.044957 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 502/1012] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 28 12:02:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:52.050147 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 511/1013] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:51 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:02:52.051094 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22e955-3fa6-4cf2-b177-b65c7aff5b41 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:52.153649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22e955-3fa6-4cf2-b177-b65c7aff5b41 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:52.186912 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71c3fa-c7a8-47b0-bacf-ad521f3ce208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:52.187554 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71c3fa-c7a8-47b0-bacf-ad521f3ce208 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:52.187840 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71c3fa-c7a8-47b0-bacf-ad521f3ce208 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:52.188113 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71c3fa-c7a8-47b0-bacf-ad521f3ce208 None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:52.188738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71c3fa-c7a8-47b0-bacf-ad521f3ce208 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:52.189044 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71c3fa-c7a8-47b0-bacf-ad521f3ce208 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:52.190957 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71c3fa-c7a8-47b0-bacf-ad521f3ce208 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:52.193002 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:52.196991 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 503/1014] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 28 12:02:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:52.202643 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa4a34-c577-4b74-a632-46eee67d3ae1 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:52.262785 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:52.304969 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa4a34-c577-4b74-a632-46eee67d3ae1 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:52.315393 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71c3fa-c7a8-47b0-bacf-ad521f3ce208 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:52.340287 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a64f41-49b4-4ea7-a668-bd52196f3fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:52.340918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a64f41-49b4-4ea7-a668-bd52196f3fb6 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:52.341198 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a64f41-49b4-4ea7-a668-bd52196f3fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:52.341526 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a64f41-49b4-4ea7-a668-bd52196f3fb6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:52.342177 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a64f41-49b4-4ea7-a668-bd52196f3fb6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:52.343600 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a64f41-49b4-4ea7-a668-bd52196f3fb6 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:52.367467 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 512/1015] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:02:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:02:52.436952 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71c3fa-c7a8-47b0-bacf-ad521f3ce208 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:52.481033 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaaccd4-7d99-4061-85e1-f889ff32f83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:52.481673 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaaccd4-7d99-4061-85e1-f889ff32f83d None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:52.481949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaaccd4-7d99-4061-85e1-f889ff32f83d None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:52.482217 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaaccd4-7d99-4061-85e1-f889ff32f83d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:52.483327 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaaccd4-7d99-4061-85e1-f889ff32f83d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:52.484810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaaccd4-7d99-4061-85e1-f889ff32f83d None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:52.486600 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 504/1016] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:52.492729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a64f41-49b4-4ea7-a668-bd52196f3fb6 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:52.612302 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a64f41-49b4-4ea7-a668-bd52196f3fb6 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:52.632095 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:52.653515 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99279c-0a0d-406c-9441-1a2e059ef88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:52.654135 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99279c-0a0d-406c-9441-1a2e059ef88c None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:52.654415 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99279c-0a0d-406c-9441-1a2e059ef88c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:52.654692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99279c-0a0d-406c-9441-1a2e059ef88c None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:52.655348 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99279c-0a0d-406c-9441-1a2e059ef88c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:52.656810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99279c-0a0d-406c-9441-1a2e059ef88c None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:52.686824 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 513/1017] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 28 12:02:52 2022] POST /identity/v3/projects => generated 311 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:02:52.713760 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c832e2-08f0-468a-bec0-466801b62cb6 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:52.714066 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c832e2-08f0-468a-bec0-466801b62cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:52.714312 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c832e2-08f0-468a-bec0-466801b62cb6 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:52.715814 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 505/1018] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:52.721798 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70f1d8-0c3c-4129-aa4e-d94bbe402888 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:52.722101 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70f1d8-0c3c-4129-aa4e-d94bbe402888 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:52.722338 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70f1d8-0c3c-4129-aa4e-d94bbe402888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:52.742785 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-6a70f1d8-0c3c-4129-aa4e-d94bbe402888 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:52.744037 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6a70f1d8-0c3c-4129-aa4e-d94bbe402888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:52.816785 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 514/1019] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:52 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:02:53.083636 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c832e2-08f0-468a-bec0-466801b62cb6 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:53.148692 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:53.189476 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c832e2-08f0-468a-bec0-466801b62cb6 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:53.225014 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b956e-1e6c-4efe-941a-7dbc8bdf3d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:53.225619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b956e-1e6c-4efe-941a-7dbc8bdf3d34 None admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:53.225895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b956e-1e6c-4efe-941a-7dbc8bdf3d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:53.226160 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b956e-1e6c-4efe-941a-7dbc8bdf3d34 None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:53.226815 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b956e-1e6c-4efe-941a-7dbc8bdf3d34 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:53.228202 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b956e-1e6c-4efe-941a-7dbc8bdf3d34 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:53.244280 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 506/1020] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 28 12:02:53 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:02:54.961957 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2fccc-9fde-4b4e-ae8e-fe9a4b5acd2b None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:54.962480 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2fccc-9fde-4b4e-ae8e-fe9a4b5acd2b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:54.962894 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2fccc-9fde-4b4e-ae8e-fe9a4b5acd2b None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:54.965630 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 515/1021] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:54.971085 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f628e88-1b0f-4eaa-a90c-f8ccead2ccda None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:54.972156 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f628e88-1b0f-4eaa-a90c-f8ccead2ccda None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:54.972238 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f628e88-1b0f-4eaa-a90c-f8ccead2ccda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:54.978782 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed796782-b09b-48f7-87d5-2d11b94a8aca None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:54.979065 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed796782-b09b-48f7-87d5-2d11b94a8aca None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:54.979336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed796782-b09b-48f7-87d5-2d11b94a8aca None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:54.980831 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 516/1022] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:02:54.985751 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c32270-2192-4169-8c8f-5ab0811e732d None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:54.986018 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c32270-2192-4169-8c8f-5ab0811e732d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:54.986294 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c32270-2192-4169-8c8f-5ab0811e732d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:54.990537 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-0f628e88-1b0f-4eaa-a90c-f8ccead2ccda None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:54.992036 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-0f628e88-1b0f-4eaa-a90c-f8ccead2ccda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:55.004539 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-32c32270-2192-4169-8c8f-5ab0811e732d None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:55.005717 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-32c32270-2192-4169-8c8f-5ab0811e732d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:55.075164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 507/1023] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:02:55.075764 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 517/1024] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:02:55.366808 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f628e88-1b0f-4eaa-a90c-f8ccead2ccda None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:55.418815 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:55.426982 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1ecd1-8066-46e9-97cc-0d1691d42111 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:55.427311 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1ecd1-8066-46e9-97cc-0d1691d42111 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:55.427651 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1ecd1-8066-46e9-97cc-0d1691d42111 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:55.429308 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 518/1025] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:02:55.434032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602b6ef-9411-4315-826a-50f600c588e3 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:55.434321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602b6ef-9411-4315-826a-50f600c588e3 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:55.434601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602b6ef-9411-4315-826a-50f600c588e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:55.453954 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-9602b6ef-9411-4315-826a-50f600c588e3 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:55.455505 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9602b6ef-9411-4315-826a-50f600c588e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:55.475332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f628e88-1b0f-4eaa-a90c-f8ccead2ccda None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:55.479636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:55.514607 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfd14f-9ea3-4236-8028-0afd26f5682a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:55.515235 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfd14f-9ea3-4236-8028-0afd26f5682a None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:55.515535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfd14f-9ea3-4236-8028-0afd26f5682a None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:55.515804 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfd14f-9ea3-4236-8028-0afd26f5682a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:55.516892 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dfd14f-9ea3-4236-8028-0afd26f5682a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:55.518332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dfd14f-9ea3-4236-8028-0afd26f5682a None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:55.523163 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 508/1026] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:55.523163 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfd14f-9ea3-4236-8028-0afd26f5682a None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:55.531760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 519/1027] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:02:55.532584 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602b6ef-9411-4315-826a-50f600c588e3 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:55.639548 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfd14f-9ea3-4236-8028-0afd26f5682a None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:55.644448 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602b6ef-9411-4315-826a-50f600c588e3 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:55.657878 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:55.676276 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f521d33-506e-4f6f-800e-17bd1c5113ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:55.677039 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f521d33-506e-4f6f-800e-17bd1c5113ff None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:55.677325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f521d33-506e-4f6f-800e-17bd1c5113ff None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:55.677652 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f521d33-506e-4f6f-800e-17bd1c5113ff None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:55.688011 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299d145-040f-4e20-91ca-662bf0ed70b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:55.688621 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299d145-040f-4e20-91ca-662bf0ed70b8 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:55.688907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299d145-040f-4e20-91ca-662bf0ed70b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:55.689177 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299d145-040f-4e20-91ca-662bf0ed70b8 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:55.689830 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299d145-040f-4e20-91ca-662bf0ed70b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:55.689999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f521d33-506e-4f6f-800e-17bd1c5113ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:02:55.691874 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299d145-040f-4e20-91ca-662bf0ed70b8 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:55.696594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-7f521d33-506e-4f6f-800e-17bd1c5113ff None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 12:02:55.696594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:55.696594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:55.696594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:55.696594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:55.696594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:55.696594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:55.696594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:55.696594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:55.696594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:55.696594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:55.696594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:55.696594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:02:55.696594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:02:55.696594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:02:55.696594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:02:55.697859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:02:55.697859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:02:55.697859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:02:55.697859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:02:55.697859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:55.697859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:55.697859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:55.697859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:55.697859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:55.697859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:55.697859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:55.697859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:55.697859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:55.697859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:55.697859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:55.697859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:55.698941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:55.698941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:55.698941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:55.698941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:55.698941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:02:55.698941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:02:55.698941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:02:55.698941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:02:55.698941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:02:55.698941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:02:55.698941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 12:02:55.698941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:55.701034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 509/1028] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Sep 28 12:02:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:55.708462 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f521d33-506e-4f6f-800e-17bd1c5113ff None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:55.723506 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 520/1029] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 28 12:02:55 2022] POST /identity/v3/users => generated 285 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:02:55.805317 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299d145-040f-4e20-91ca-662bf0ed70b8 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:55.824211 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:55.842152 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f521d33-506e-4f6f-800e-17bd1c5113ff None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:55.884251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271a686-da6b-48c6-af3b-a5f3f6ec2b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:55.884888 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271a686-da6b-48c6-af3b-a5f3f6ec2b84 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:55.885168 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271a686-da6b-48c6-af3b-a5f3f6ec2b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:55.885443 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271a686-da6b-48c6-af3b-a5f3f6ec2b84 None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:55.886134 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271a686-da6b-48c6-af3b-a5f3f6ec2b84 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:55.886443 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271a686-da6b-48c6-af3b-a5f3f6ec2b84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:55.887912 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271a686-da6b-48c6-af3b-a5f3f6ec2b84 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:55.903696 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 510/1030] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Sep 28 12:02:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:55.905267 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271a686-da6b-48c6-af3b-a5f3f6ec2b84 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:55.935888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299d145-040f-4e20-91ca-662bf0ed70b8 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:55.952359 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:55.975009 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bacd8-06f8-46c9-bff3-8035b7c8ed49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:55.975727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bacd8-06f8-46c9-bff3-8035b7c8ed49 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:55.976010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bacd8-06f8-46c9-bff3-8035b7c8ed49 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:55.976286 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bacd8-06f8-46c9-bff3-8035b7c8ed49 None admin] PATH_INFO: `/v3/services/image` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:55.976885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bacd8-06f8-46c9-bff3-8035b7c8ed49 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:55.978257 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bacd8-06f8-46c9-bff3-8035b7c8ed49 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:55.989863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-fb6bacd8-06f8-46c9-bff3-8035b7c8ed49 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 28 12:02:55.989863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:55.989863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:02:55.989863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:02:55.989863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:02:55.989863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:02:55.989863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:02:55.989863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:55.989863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 28 12:02:55.989863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:55.989863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:02:55.989863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:55.989863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:55.989863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:55.989863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:55.989863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:55.989863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:55.991170 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:55.991170 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:55.991170 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:55.991170 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:55.991170 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:55.991170 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:55.991170 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:02:55.991170 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:02:55.991170 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:02:55.991170 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:02:55.991170 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:55.991170 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:55.991170 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:55.991170 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:55.991170 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:55.991170 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:55.992551 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:55.992551 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:55.992551 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:55.992551 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:55.992551 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:55.992551 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:55.992551 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:55.992551 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:55.992551 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:55.992551 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:55.992551 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:02:55.992551 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:55.992551 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 28 12:02:55.992551 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:55.994732 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 521/1031] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Sep 28 12:02:55 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:56.001478 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bacd8-06f8-46c9-bff3-8035b7c8ed49 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:56.027730 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271a686-da6b-48c6-af3b-a5f3f6ec2b84 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:56.070923 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e2b40-77a1-42af-a03a-355b61d05257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:56.071845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e2b40-77a1-42af-a03a-355b61d05257 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:56.072132 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e2b40-77a1-42af-a03a-355b61d05257 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:56.072410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e2b40-77a1-42af-a03a-355b61d05257 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:56.084104 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e2b40-77a1-42af-a03a-355b61d05257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:56.085562 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e2b40-77a1-42af-a03a-355b61d05257 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:56.088341 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:56.100135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-466e2b40-77a1-42af-a03a-355b61d05257 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:56.100135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:56.100135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:56.100135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:56.100135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:56.100135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:56.100135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:56.100135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:56.100135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:56.100135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:56.100135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:56.100135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:56.100135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:56.100135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:56.100135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:56.100135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:56.101172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:56.101172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:56.101172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:56.101172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:56.101172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:56.101172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:56.101172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:56.101172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:56.101172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:56.101172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:56.101172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:56.101172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:56.101172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:56.101172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:56.101172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:56.101172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:56.101172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:56.102096 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:56.102096 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:56.102096 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:56.102096 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 511/1032] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:56.106802 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e2b40-77a1-42af-a03a-355b61d05257 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:56.114662 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bacd8-06f8-46c9-bff3-8035b7c8ed49 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:56.160919 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a8151-771b-4917-a85e-502157a9dbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:56.161447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a8151-771b-4917-a85e-502157a9dbc3 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:56.161725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a8151-771b-4917-a85e-502157a9dbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:56.161996 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a8151-771b-4917-a85e-502157a9dbc3 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:56.162628 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a8151-771b-4917-a85e-502157a9dbc3 None admin] RBAC: Adding query filter params (name=image) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:56.163165 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a8151-771b-4917-a85e-502157a9dbc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:56.164322 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a8151-771b-4917-a85e-502157a9dbc3 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:56.174627 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 522/1033] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:56.175770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a8151-771b-4917-a85e-502157a9dbc3 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:56.204234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:56.215558 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e2b40-77a1-42af-a03a-355b61d05257 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:56.250684 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1084f1-fbec-455f-ac2e-483344a6b9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:56.251296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1084f1-fbec-455f-ac2e-483344a6b9e0 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:56.251609 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1084f1-fbec-455f-ac2e-483344a6b9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:56.251882 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1084f1-fbec-455f-ac2e-483344a6b9e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:56.253097 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1084f1-fbec-455f-ac2e-483344a6b9e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:56.253401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1084f1-fbec-455f-ac2e-483344a6b9e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:56.254776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1084f1-fbec-455f-ac2e-483344a6b9e0 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:56.267668 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 512/1034] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:56.273001 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1084f1-fbec-455f-ac2e-483344a6b9e0 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:56.282211 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a8151-771b-4917-a85e-502157a9dbc3 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:56.320359 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c34d4-7821-41b4-8477-8028446e2406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:56.320968 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c34d4-7821-41b4-8477-8028446e2406 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:56.321249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c34d4-7821-41b4-8477-8028446e2406 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:56.321521 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c34d4-7821-41b4-8477-8028446e2406 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:56.322157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c34d4-7821-41b4-8477-8028446e2406 None admin] RBAC: Adding query filter params (type=image) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:56.322622 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c34d4-7821-41b4-8477-8028446e2406 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:56.324433 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c34d4-7821-41b4-8477-8028446e2406 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:56.334276 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 523/1035] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:56.337051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c34d4-7821-41b4-8477-8028446e2406 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:56.346798 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:56.386242 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1084f1-fbec-455f-ac2e-483344a6b9e0 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:56.424675 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202afe5-c9bf-4b95-82ba-8d77df7e3d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:56.425522 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202afe5-c9bf-4b95-82ba-8d77df7e3d10 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:56.425953 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202afe5-c9bf-4b95-82ba-8d77df7e3d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:56.426352 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202afe5-c9bf-4b95-82ba-8d77df7e3d10 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:56.437103 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202afe5-c9bf-4b95-82ba-8d77df7e3d10 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:56.438569 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202afe5-c9bf-4b95-82ba-8d77df7e3d10 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:56.448205 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c34d4-7821-41b4-8477-8028446e2406 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:56.450387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-2202afe5-c9bf-4b95-82ba-8d77df7e3d10 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:02:56.450387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:56.450387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:56.450387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:56.450387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:56.450387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:56.450387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:56.450387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:56.450387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:56.450387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:56.450387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:56.450387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:56.450387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:02:56.450387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:02:56.450387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:02:56.450387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:02:56.451598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:56.451598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:56.451598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:02:56.451598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:56.451598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:02:56.451598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:02:56.451598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:56.451598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:56.451598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:56.451598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:56.451598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:56.451598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:56.451598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:56.451598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:56.451598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:56.451598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:56.451598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:56.451598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:56.452585 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:56.452585 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:56.452585 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:02:56.452585 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:02:56.452585 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:02:56.452585 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:02:56.452585 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:02:56.452585 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:02:56.452585 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:02:56.452585 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:56.452585 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 513/1036] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Sep 28 12:02:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:56.457562 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202afe5-c9bf-4b95-82ba-8d77df7e3d10 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:56.473957 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:56.493592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6120c6-181e-4028-a914-801ca15c9ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:56.494210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6120c6-181e-4028-a914-801ca15c9ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:56.494487 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6120c6-181e-4028-a914-801ca15c9ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:56.494756 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6120c6-181e-4028-a914-801ca15c9ea9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:56.495656 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6120c6-181e-4028-a914-801ca15c9ea9 None admin] RBAC: Adding query filter params (interface=public, service_id=ec934bf9e50448b094d3adae568f6616, region_id=RegionOne) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:56.496752 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6120c6-181e-4028-a914-801ca15c9ea9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:56.498123 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6120c6-181e-4028-a914-801ca15c9ea9 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:56.507589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 524/1037] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Sep 28 12:02:56 2022] GET /identity/v3/endpoints?service_id=ec934bf9e50448b094d3adae568f6616&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:56.510389 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6120c6-181e-4028-a914-801ca15c9ea9 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:56.567219 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202afe5-c9bf-4b95-82ba-8d77df7e3d10 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:56.589967 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:56.602449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c14f9d-9046-44f1-a5be-96933462cca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:56.603066 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c14f9d-9046-44f1-a5be-96933462cca2 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:56.603347 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c14f9d-9046-44f1-a5be-96933462cca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:56.603654 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c14f9d-9046-44f1-a5be-96933462cca2 None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:56.604385 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c14f9d-9046-44f1-a5be-96933462cca2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:56.604685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c14f9d-9046-44f1-a5be-96933462cca2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:56.606125 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c14f9d-9046-44f1-a5be-96933462cca2 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:56.623864 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 514/1038] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Sep 28 12:02:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:56.629965 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c14f9d-9046-44f1-a5be-96933462cca2 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:56.633075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6120c6-181e-4028-a914-801ca15c9ea9 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:56.672993 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cfee9-1e7d-40f5-be90-603a9cc07f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:56.673943 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cfee9-1e7d-40f5-be90-603a9cc07f80 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:56.674529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cfee9-1e7d-40f5-be90-603a9cc07f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:56.675082 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cfee9-1e7d-40f5-be90-603a9cc07f80 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:56.676035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5cfee9-1e7d-40f5-be90-603a9cc07f80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:56.677601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5cfee9-1e7d-40f5-be90-603a9cc07f80 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:56.684794 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 525/1039] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Sep 28 12:02:56 2022] GET /identity/v3/services => generated 1957 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:02:56.718748 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:56.761182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c14f9d-9046-44f1-a5be-96933462cca2 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:56.800316 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042fec0-fae5-433f-b9de-cf155079e5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:56.800942 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042fec0-fae5-433f-b9de-cf155079e5dc None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:56.801219 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042fec0-fae5-433f-b9de-cf155079e5dc None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:56.801487 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042fec0-fae5-433f-b9de-cf155079e5dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:56.877131 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042fec0-fae5-433f-b9de-cf155079e5dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:56.878609 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042fec0-fae5-433f-b9de-cf155079e5dc None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:56.946691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:56.979293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 515/1040] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:02:56 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:02:56.985197 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cfee9-1e7d-40f5-be90-603a9cc07f80 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:57.094594 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cfee9-1e7d-40f5-be90-603a9cc07f80 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:57.132919 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf498b-d842-4ca6-87b2-53f5f3248dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:57.133560 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf498b-d842-4ca6-87b2-53f5f3248dcf None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:57.133841 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf498b-d842-4ca6-87b2-53f5f3248dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:57.134115 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf498b-d842-4ca6-87b2-53f5f3248dcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:57.136203 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:57.146759 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf498b-d842-4ca6-87b2-53f5f3248dcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:57.148234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf498b-d842-4ca6-87b2-53f5f3248dcf None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:57.163938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-e9bf498b-d842-4ca6-87b2-53f5f3248dcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:57.163938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:57.163938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:57.163938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:57.163938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:57.163938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:57.163938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:57.163938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:57.163938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:57.163938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:57.163938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:57.163938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:57.163938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:02:57.163938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:02:57.163938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:02:57.163938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:02:57.164937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:57.164937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:57.164937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:57.164937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:57.164937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:57.164937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:57.164937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:57.164937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:57.164937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:57.164937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:57.164937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:57.164937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:57.164937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:57.164937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:57.164937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:57.164937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:57.164937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:02:57.165889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:02:57.165889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:02:57.165889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:57.165889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 526/1041] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:57.171810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042fec0-fae5-433f-b9de-cf155079e5dc None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:57.276200 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042fec0-fae5-433f-b9de-cf155079e5dc None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:57.310005 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb558357-a408-4765-b60a-b5ae3912997c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:57.310608 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb558357-a408-4765-b60a-b5ae3912997c None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:57.311141 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb558357-a408-4765-b60a-b5ae3912997c None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:57.311420 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb558357-a408-4765-b60a-b5ae3912997c None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:57.312083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb558357-a408-4765-b60a-b5ae3912997c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:57.312389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb558357-a408-4765-b60a-b5ae3912997c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:57.313752 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb558357-a408-4765-b60a-b5ae3912997c None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:57.329322 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 516/1042] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:57.331075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf498b-d842-4ca6-87b2-53f5f3248dcf None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:57.439672 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf498b-d842-4ca6-87b2-53f5f3248dcf None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:57.473673 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9d9b0-90a4-45e6-b3b3-0cafc5ca1a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:57.474302 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9d9b0-90a4-45e6-b3b3-0cafc5ca1a14 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:57.474577 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9d9b0-90a4-45e6-b3b3-0cafc5ca1a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:57.474841 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9d9b0-90a4-45e6-b3b3-0cafc5ca1a14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:57.481489 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9d9b0-90a4-45e6-b3b3-0cafc5ca1a14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:57.482910 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9d9b0-90a4-45e6-b3b3-0cafc5ca1a14 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:57.494763 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-abe9d9b0-90a4-45e6-b3b3-0cafc5ca1a14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:57.494763 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:57.494763 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:57.494763 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:57.494763 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:57.494763 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:57.494763 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:57.494763 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:57.494763 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:57.494763 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:57.494763 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:57.494763 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:57.494763 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:02:57.494763 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:02:57.494763 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:02:57.500707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:02:57.500707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:57.500707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:57.500707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:57.500707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:57.500707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:57.500707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:57.500707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:57.500707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:57.500707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:57.500707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:57.500707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:57.500707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:57.500707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:57.500707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:57.500707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:57.500707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:57.501650 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:02:57.501650 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:02:57.501650 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:02:57.501650 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:02:57.501650 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:02:57.501650 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:02:57.501650 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:02:57.501650 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:57.501650 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 527/1043] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:02:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:57.502151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb558357-a408-4765-b60a-b5ae3912997c None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:57.532684 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:57.612367 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb558357-a408-4765-b60a-b5ae3912997c None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:57.646686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4815b6-37e0-4ec5-adca-6f6ce9ce2c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:57.647294 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4815b6-37e0-4ec5-adca-6f6ce9ce2c97 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:57.647598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4815b6-37e0-4ec5-adca-6f6ce9ce2c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:57.647869 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4815b6-37e0-4ec5-adca-6f6ce9ce2c97 None admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:57.648554 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4815b6-37e0-4ec5-adca-6f6ce9ce2c97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:57.648856 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4815b6-37e0-4ec5-adca-6f6ce9ce2c97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:57.650270 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4815b6-37e0-4ec5-adca-6f6ce9ce2c97 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:57.663029 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 517/1044] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:02:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:57.668821 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9d9b0-90a4-45e6-b3b3-0cafc5ca1a14 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:57.723553 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:57.781822 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9d9b0-90a4-45e6-b3b3-0cafc5ca1a14 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:57.815765 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a099ce4-fe6a-4373-9bee-10b5c1f1ffaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:57.816301 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a099ce4-fe6a-4373-9bee-10b5c1f1ffaa None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:57.816576 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a099ce4-fe6a-4373-9bee-10b5c1f1ffaa None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:57.816845 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a099ce4-fe6a-4373-9bee-10b5c1f1ffaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:57.817567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a099ce4-fe6a-4373-9bee-10b5c1f1ffaa None admin] RBAC: Adding query filter params (role.id=d36bf69b347c431a8923d10a00d66e1c, scope.project.id=c854d366f35145e8b2fadb9b014d0199, user.id=0e81804e04514ae882a1fd93789db025) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:57.817875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a099ce4-fe6a-4373-9bee-10b5c1f1ffaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:57.819301 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a099ce4-fe6a-4373-9bee-10b5c1f1ffaa None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:57.831463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 528/1045] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:02:57 2022] GET /identity/v3/role_assignments?user.id=0e81804e04514ae882a1fd93789db025&scope.project.id=c854d366f35145e8b2fadb9b014d0199&role.id=d36bf69b347c431a8923d10a00d66e1c => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:58.016325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d8a2d-3650-4dd6-8672-d51d8aace446 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:58.016652 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d8a2d-3650-4dd6-8672-d51d8aace446 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:58.016954 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d8a2d-3650-4dd6-8672-d51d8aace446 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:58.018833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 518/1046] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:58.024331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782c922-5708-4146-8816-2f289e597782 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:58.024790 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782c922-5708-4146-8816-2f289e597782 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:58.024868 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782c922-5708-4146-8816-2f289e597782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:58.046245 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-c782c922-5708-4146-8816-2f289e597782 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:58.047442 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c782c922-5708-4146-8816-2f289e597782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:58.121196 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 529/1047] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:02:58.387507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d8a2d-3650-4dd6-8672-d51d8aace446 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:58.480758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:58.492555 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d8a2d-3650-4dd6-8672-d51d8aace446 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:58.526889 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7212b9-7a8a-429a-8e5e-6f6d3937d1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:58.527546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7212b9-7a8a-429a-8e5e-6f6d3937d1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:58.527826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7212b9-7a8a-429a-8e5e-6f6d3937d1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:58.528088 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7212b9-7a8a-429a-8e5e-6f6d3937d1e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:58.538838 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7212b9-7a8a-429a-8e5e-6f6d3937d1e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:02:58.543640 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-0f7212b9-7a8a-429a-8e5e-6f6d3937d1e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:02:58.543640 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:58.543640 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:58.543640 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:58.543640 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:58.543640 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:58.543640 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:58.543640 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:58.543640 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:58.543640 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:58.543640 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:58.543640 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:58.543640 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:02:58.543640 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:02:58.543640 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:02:58.543640 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:02:58.544575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:02:58.544575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:02:58.544575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:02:58.544575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:02:58.544575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:58.544575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:58.544575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:58.544575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:58.544575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:58.544575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:58.544575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:58.544575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:58.544575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:58.544575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:58.544575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:58.544575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:58.545454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:58.545454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:58.545454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:58.545454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:58.545454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:02:58.545454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:02:58.545454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:02:58.545454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:02:58.545454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:02:58.545454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:02:58.545454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:02:58.545454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:02:58.548495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 519/1048] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:02:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:02:58.550705 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782c922-5708-4146-8816-2f289e597782 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:58.591461 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:58.650638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782c922-5708-4146-8816-2f289e597782 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:58.685223 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76604175-3667-439f-9ac6-8d8887c92edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:58.686012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76604175-3667-439f-9ac6-8d8887c92edd None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:58.686404 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76604175-3667-439f-9ac6-8d8887c92edd None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:58.686768 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76604175-3667-439f-9ac6-8d8887c92edd None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:58.687594 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76604175-3667-439f-9ac6-8d8887c92edd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:58.688017 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76604175-3667-439f-9ac6-8d8887c92edd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:58.689492 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76604175-3667-439f-9ac6-8d8887c92edd None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:58.704383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 530/1049] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:02:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:58.705521 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7212b9-7a8a-429a-8e5e-6f6d3937d1e6 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:58.816810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7212b9-7a8a-429a-8e5e-6f6d3937d1e6 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:58.851366 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a002e31-0d8f-41af-9f50-10aaefd01244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:58.852075 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a002e31-0d8f-41af-9f50-10aaefd01244 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:58.852353 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a002e31-0d8f-41af-9f50-10aaefd01244 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:58.852619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a002e31-0d8f-41af-9f50-10aaefd01244 None admin] PATH_INFO: `/v3/users/ecc5e86ca93349c1802035d91b6351a6` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:58.866711 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a002e31-0d8f-41af-9f50-10aaefd01244 None admin] RBAC: Authorizing `identity:get_user(user_id=ecc5e86ca93349c1802035d91b6351a6)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:58.868176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a002e31-0d8f-41af-9f50-10aaefd01244 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:58.874263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 520/1050] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:02:58 2022] GET /identity/v3/users/ecc5e86ca93349c1802035d91b6351a6 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:58.875524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76604175-3667-439f-9ac6-8d8887c92edd None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:58.901094 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ea84e-3a61-4abf-9e49-f821099886f3 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:58.901896 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ea84e-3a61-4abf-9e49-f821099886f3 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:58.902173 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ea84e-3a61-4abf-9e49-f821099886f3 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:58.903553 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 521/1051] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:02:58.909474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c0cc8-c513-47d0-88d9-50b2ee7b7ac1 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:58.909849 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c0cc8-c513-47d0-88d9-50b2ee7b7ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:58.910209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c0cc8-c513-47d0-88d9-50b2ee7b7ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:58.929901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-6c4c0cc8-c513-47d0-88d9-50b2ee7b7ac1 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:02:58.931103 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-6c4c0cc8-c513-47d0-88d9-50b2ee7b7ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:02:58.933320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:58.983319 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76604175-3667-439f-9ac6-8d8887c92edd None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:58.985255 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:59.004833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 522/1052] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:02:59.022514 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377e8d1-b862-4a6d-863a-776163be15ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:59.023207 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377e8d1-b862-4a6d-863a-776163be15ff None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:59.023581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377e8d1-b862-4a6d-863a-776163be15ff None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:59.023927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377e8d1-b862-4a6d-863a-776163be15ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:59.092763 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377e8d1-b862-4a6d-863a-776163be15ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:59.094205 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377e8d1-b862-4a6d-863a-776163be15ff None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:59.195946 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 531/1053] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:02:58 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:02:59.197384 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c0cc8-c513-47d0-88d9-50b2ee7b7ac1 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:59.273441 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377e8d1-b862-4a6d-863a-776163be15ff None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:59.276147 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:59.301982 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c0cc8-c513-47d0-88d9-50b2ee7b7ac1 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:59.336090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af550cc-5061-4d8e-a5f5-c5d4d0b730f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:59.336716 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af550cc-5061-4d8e-a5f5-c5d4d0b730f1 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:59.336994 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af550cc-5061-4d8e-a5f5-c5d4d0b730f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:59.337263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af550cc-5061-4d8e-a5f5-c5d4d0b730f1 None admin] PATH_INFO: `/v3/projects/2472ae76a0e84195adaa076faba9d34d` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:59.338391 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af550cc-5061-4d8e-a5f5-c5d4d0b730f1 None admin] RBAC: Authorizing `identity:get_project(project_id=2472ae76a0e84195adaa076faba9d34d)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:59.339855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af550cc-5061-4d8e-a5f5-c5d4d0b730f1 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:59.347238 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 523/1054] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:02:59 2022] GET /identity/v3/projects/2472ae76a0e84195adaa076faba9d34d => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:59.348377 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af550cc-5061-4d8e-a5f5-c5d4d0b730f1 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:59.357373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:59.389963 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377e8d1-b862-4a6d-863a-776163be15ff None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:59.431678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae155a7-9374-4e21-9302-91c5b2a3bbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:59.432548 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae155a7-9374-4e21-9302-91c5b2a3bbd3 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:59.432823 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae155a7-9374-4e21-9302-91c5b2a3bbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:59.433089 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae155a7-9374-4e21-9302-91c5b2a3bbd3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:59.433784 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae155a7-9374-4e21-9302-91c5b2a3bbd3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:59.435271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae155a7-9374-4e21-9302-91c5b2a3bbd3 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:59.445384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-dae155a7-9374-4e21-9302-91c5b2a3bbd3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 28 12:02:59.445384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:59.445384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:02:59.445384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:02:59.445384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:02:59.445384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:02:59.445384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:02:59.445384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:59.445384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 28 12:02:59.445384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:59.445384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:02:59.445384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:59.445384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:02:59.445384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:02:59.445384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:02:59.445384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:02:59.445384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:02:59.446937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:02:59.446937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:02:59.446937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:02:59.446937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:02:59.446937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:02:59.446937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:02:59.446937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:02:59.446937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:02:59.446937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:02:59.446937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:02:59.446937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:02:59.446937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:02:59.446937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:02:59.446937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:02:59.446937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:02:59.446937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:02:59.448649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:02:59.448649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:02:59.448649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:02:59.448649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:02:59.448649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:02:59.448649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:02:59.448649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:02:59.448649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:02:59.448649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:02:59.448649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:02:59.448649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:02:59.448649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:02:59.448649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 28 12:02:59.448649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:02:59.451871 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 532/1055] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Sep 28 12:02:59 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:02:59.452665 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae155a7-9374-4e21-9302-91c5b2a3bbd3 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:59.462579 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af550cc-5061-4d8e-a5f5-c5d4d0b730f1 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:59.497581 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19998e0-3810-4b4e-bcbb-3d902323e93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:59.498187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19998e0-3810-4b4e-bcbb-3d902323e93a None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:59.498461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19998e0-3810-4b4e-bcbb-3d902323e93a None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:59.498734 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19998e0-3810-4b4e-bcbb-3d902323e93a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:59.499483 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19998e0-3810-4b4e-bcbb-3d902323e93a None admin] RBAC: Adding query filter params (role.id=66456d39fc0c496c8f290a436b726216, scope.project.id=2472ae76a0e84195adaa076faba9d34d, user.id=ecc5e86ca93349c1802035d91b6351a6) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:59.499797 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19998e0-3810-4b4e-bcbb-3d902323e93a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:59.501223 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19998e0-3810-4b4e-bcbb-3d902323e93a None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:59.506860 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 524/1056] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:02:59 2022] GET /identity/v3/role_assignments?user.id=ecc5e86ca93349c1802035d91b6351a6&scope.project.id=2472ae76a0e84195adaa076faba9d34d&role.id=66456d39fc0c496c8f290a436b726216 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:59.539544 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:59.582985 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae155a7-9374-4e21-9302-91c5b2a3bbd3 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:59.622616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44e004-c206-4936-823f-63df385e54d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:59.623270 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44e004-c206-4936-823f-63df385e54d8 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:59.623546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44e004-c206-4936-823f-63df385e54d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:59.623815 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44e004-c206-4936-823f-63df385e54d8 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:59.624453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44e004-c206-4936-823f-63df385e54d8 None admin] RBAC: Adding query filter params (name=image) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:59.624757 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44e004-c206-4936-823f-63df385e54d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:59.626137 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44e004-c206-4936-823f-63df385e54d8 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:59.636697 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 533/1057] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:02:59.638656 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19998e0-3810-4b4e-bcbb-3d902323e93a None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:59.714094 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:59.753918 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19998e0-3810-4b4e-bcbb-3d902323e93a None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:59.788469 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a75d0-a29b-4b1a-b0d5-f915e161181f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:59.791247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a75d0-a29b-4b1a-b0d5-f915e161181f None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:59.791247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a75d0-a29b-4b1a-b0d5-f915e161181f None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:59.791247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a75d0-a29b-4b1a-b0d5-f915e161181f None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:59.791676 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a75d0-a29b-4b1a-b0d5-f915e161181f None admin] RBAC: Adding query filter params (type=image) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:02:59.791976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a75d0-a29b-4b1a-b0d5-f915e161181f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:59.793347 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a75d0-a29b-4b1a-b0d5-f915e161181f None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:59.801555 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 525/1058] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:02:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:02:59.806526 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44e004-c206-4936-823f-63df385e54d8 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:02:59.924897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44e004-c206-4936-823f-63df385e54d8 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:02:59.960201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:02:59.967556 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a55b91-93ed-4bf4-8d8c-c9a59e4a761e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:02:59.968819 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a55b91-93ed-4bf4-8d8c-c9a59e4a761e None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:59.969323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a55b91-93ed-4bf4-8d8c-c9a59e4a761e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:59.969810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a55b91-93ed-4bf4-8d8c-c9a59e4a761e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:59.970706 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a55b91-93ed-4bf4-8d8c-c9a59e4a761e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:02:59.972345 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a55b91-93ed-4bf4-8d8c-c9a59e4a761e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:02:59.977618 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317add1-cfe1-41dc-b911-d93d304d2d90 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:59.978164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317add1-cfe1-41dc-b911-d93d304d2d90 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:59.978641 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317add1-cfe1-41dc-b911-d93d304d2d90 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:02:59.980609 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 526/1059] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:02:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:02:59.987497 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c09e3-2525-4afb-a43c-fa82901bda18 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:02:59.987788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c09e3-2525-4afb-a43c-fa82901bda18 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:02:59.988059 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c09e3-2525-4afb-a43c-fa82901bda18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:00.010482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-865c09e3-2525-4afb-a43c-fa82901bda18 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:03:00.011705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-865c09e3-2525-4afb-a43c-fa82901bda18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:03:00.018723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 534/1060] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:02:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:03:00.132503 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 527/1061] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:02:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:03:00.403688 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a55b91-93ed-4bf4-8d8c-c9a59e4a761e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:00.507005 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a55b91-93ed-4bf4-8d8c-c9a59e4a761e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:00.541211 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8c25a-7d2a-4fa8-a4c4-d91b5274d734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:00.541844 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8c25a-7d2a-4fa8-a4c4-d91b5274d734 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:00.542124 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8c25a-7d2a-4fa8-a4c4-d91b5274d734 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:00.542398 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8c25a-7d2a-4fa8-a4c4-d91b5274d734 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:00.553739 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8c25a-7d2a-4fa8-a4c4-d91b5274d734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:03:00.558529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-d2a8c25a-7d2a-4fa8-a4c4-d91b5274d734 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 12:03:00.558529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:03:00.558529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:03:00.558529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:03:00.558529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:03:00.558529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:03:00.558529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:03:00.558529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:03:00.558529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:03:00.558529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:03:00.558529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:03:00.558529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:03:00.558529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:03:00.558529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:03:00.558529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:03:00.558529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:03:00.559502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:03:00.559502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:03:00.559502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:03:00.559502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:03:00.559502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:03:00.559502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:03:00.559502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:03:00.559502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:03:00.559502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:03:00.559502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:03:00.559502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:03:00.559502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:03:00.559502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:03:00.559502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:03:00.559502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:03:00.559502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:03:00.561041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:03:00.561041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:03:00.561041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:03:00.561041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:03:00.561041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:03:00.561041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:03:00.561041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:03:00.561041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:03:00.561041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:03:00.561041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:03:00.561041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 12:03:00.561041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:03:00.561041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 535/1062] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Sep 28 12:03:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:03:00.568663 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c09e3-2525-4afb-a43c-fa82901bda18 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:00.629656 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:00.672040 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c09e3-2525-4afb-a43c-fa82901bda18 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:00.711066 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ac814-be77-45fa-8469-f9e9d30826bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:00.711713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ac814-be77-45fa-8469-f9e9d30826bb None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:00.711997 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ac814-be77-45fa-8469-f9e9d30826bb None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:00.712271 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ac814-be77-45fa-8469-f9e9d30826bb None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:00.712943 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ac814-be77-45fa-8469-f9e9d30826bb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:00.713241 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ac814-be77-45fa-8469-f9e9d30826bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:00.714623 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ac814-be77-45fa-8469-f9e9d30826bb None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:00.723859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 528/1063] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Sep 28 12:03:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:03:00.731793 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8c25a-7d2a-4fa8-a4c4-d91b5274d734 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:00.781596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:00.839399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8c25a-7d2a-4fa8-a4c4-d91b5274d734 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:00.874020 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5dc058-0d2b-4559-a7b1-cd9831360377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:00.874661 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dc058-0d2b-4559-a7b1-cd9831360377 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:00.874929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dc058-0d2b-4559-a7b1-cd9831360377 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:00.875202 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dc058-0d2b-4559-a7b1-cd9831360377 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:00.885786 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5dc058-0d2b-4559-a7b1-cd9831360377 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:00.887223 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5dc058-0d2b-4559-a7b1-cd9831360377 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:00.911337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-ad5dc058-0d2b-4559-a7b1-cd9831360377 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:03:00.911337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:03:00.911337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:03:00.911337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:03:00.911337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:03:00.911337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:03:00.911337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:03:00.911337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:03:00.911337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:03:00.911337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:03:00.911337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:03:00.911337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:03:00.911337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:03:00.911337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:03:00.911337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:03:00.911337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:03:00.912356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:03:00.912356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:03:00.912356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:03:00.912356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:03:00.912356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:03:00.912356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:03:00.912356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:03:00.912356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:03:00.912356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:03:00.912356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:03:00.912356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:03:00.912356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:03:00.912356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:03:00.912356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:03:00.912356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:03:00.912356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:03:00.912356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:03:00.918257 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:03:00.918257 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:03:00.918257 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:03:00.918257 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 536/1064] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:03:00.918504 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ac814-be77-45fa-8469-f9e9d30826bb None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:01.020749 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ac814-be77-45fa-8469-f9e9d30826bb None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:01.042974 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:01.055590 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd835d9-462d-4e7a-8ed5-c940de2a9227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:01.056199 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd835d9-462d-4e7a-8ed5-c940de2a9227 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:01.056479 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd835d9-462d-4e7a-8ed5-c940de2a9227 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:01.056751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd835d9-462d-4e7a-8ed5-c940de2a9227 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:01.057395 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd835d9-462d-4e7a-8ed5-c940de2a9227 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:01.057703 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd835d9-462d-4e7a-8ed5-c940de2a9227 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:01.059153 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd835d9-462d-4e7a-8ed5-c940de2a9227 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:01.075425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 529/1065] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:01.076621 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5dc058-0d2b-4559-a7b1-cd9831360377 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:01.174238 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:01.179350 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5dc058-0d2b-4559-a7b1-cd9831360377 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:01.214554 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b193fe-6812-44c7-88a7-e05be801bb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:01.215188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b193fe-6812-44c7-88a7-e05be801bb9f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:01.215492 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b193fe-6812-44c7-88a7-e05be801bb9f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:01.215771 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b193fe-6812-44c7-88a7-e05be801bb9f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:01.223523 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b193fe-6812-44c7-88a7-e05be801bb9f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:01.224970 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b193fe-6812-44c7-88a7-e05be801bb9f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:01.236169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-50b193fe-6812-44c7-88a7-e05be801bb9f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:03:01.236169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:03:01.236169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:03:01.236169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:03:01.236169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:03:01.236169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:03:01.236169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:03:01.236169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:03:01.236169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:03:01.236169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:03:01.236169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:03:01.236169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:03:01.236169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:03:01.236169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:03:01.236169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:03:01.236169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:03:01.237113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:03:01.237113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:03:01.237113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:03:01.237113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:03:01.237113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:03:01.237113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:03:01.237113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:03:01.237113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:03:01.237113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:03:01.237113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:03:01.237113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:03:01.237113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:03:01.237113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:03:01.237113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:03:01.237113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:03:01.237113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:03:01.237113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:03:01.237113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:03:01.244906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:03:01.244906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:03:01.244906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:03:01.244906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:03:01.244906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:03:01.244906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:03:01.244906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:03:01.244906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:03:01.244906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:03:01.244906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:03:01.244906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 537/1066] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Sep 28 12:03:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:03:01.245656 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd835d9-462d-4e7a-8ed5-c940de2a9227 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:01.350141 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd835d9-462d-4e7a-8ed5-c940de2a9227 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:01.385225 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31aca31-124e-4b23-8972-48fb077e422e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:01.386063 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31aca31-124e-4b23-8972-48fb077e422e None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:01.386492 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31aca31-124e-4b23-8972-48fb077e422e None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:01.386910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31aca31-124e-4b23-8972-48fb077e422e None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:01.387839 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31aca31-124e-4b23-8972-48fb077e422e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:01.388295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31aca31-124e-4b23-8972-48fb077e422e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:01.389879 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31aca31-124e-4b23-8972-48fb077e422e None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:01.412836 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 530/1067] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Sep 28 12:03:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:01.414258 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b193fe-6812-44c7-88a7-e05be801bb9f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:01.524230 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b193fe-6812-44c7-88a7-e05be801bb9f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:01.559618 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c32cc2-82f5-45a4-b6c5-08b4d8ef8702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:01.560278 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c32cc2-82f5-45a4-b6c5-08b4d8ef8702 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:01.560565 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c32cc2-82f5-45a4-b6c5-08b4d8ef8702 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:01.560830 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c32cc2-82f5-45a4-b6c5-08b4d8ef8702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:01.573589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c32cc2-82f5-45a4-b6c5-08b4d8ef8702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:01.575060 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c32cc2-82f5-45a4-b6c5-08b4d8ef8702 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:01.593425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-c7c32cc2-82f5-45a4-b6c5-08b4d8ef8702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:03:01.593425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:03:01.593425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:03:01.593425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:03:01.593425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:03:01.593425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:03:01.593425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:03:01.593425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:03:01.593425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:03:01.593425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:03:01.593425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:03:01.593425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:03:01.593425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:03:01.593425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:03:01.593425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:03:01.593425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:03:01.594470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:03:01.594470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:03:01.594470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:03:01.594470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:03:01.594470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:03:01.594470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:03:01.594470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:03:01.594470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:03:01.594470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:03:01.594470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:03:01.594470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:03:01.594470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:03:01.594470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:03:01.594470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:03:01.594470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:03:01.594470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:03:01.594470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:03:01.600374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:03:01.600374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:03:01.600374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:03:01.600374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 538/1068] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:03:01.600631 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31aca31-124e-4b23-8972-48fb077e422e None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:01.645370 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:01.666318 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bbc63-4b6d-40bb-bea3-8f6b43bb0edb None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:01.666818 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bbc63-4b6d-40bb-bea3-8f6b43bb0edb None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:01.667284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bbc63-4b6d-40bb-bea3-8f6b43bb0edb None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:01.668663 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 539/1069] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:03:01.676172 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a67f2-8223-4027-a200-0ed254664003 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:01.676457 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a67f2-8223-4027-a200-0ed254664003 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:01.676734 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a67f2-8223-4027-a200-0ed254664003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:01.697244 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-fa8a67f2-8223-4027-a200-0ed254664003 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:03:01.698435 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-fa8a67f2-8223-4027-a200-0ed254664003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:03:01.705300 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:01.710578 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31aca31-124e-4b23-8972-48fb077e422e None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:01.747230 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cf04f-59c8-42d1-b2f2-4984d6df54ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:01.747866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cf04f-59c8-42d1-b2f2-4984d6df54ac None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:01.748144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cf04f-59c8-42d1-b2f2-4984d6df54ac None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:01.748413 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cf04f-59c8-42d1-b2f2-4984d6df54ac None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:01.749055 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08cf04f-59c8-42d1-b2f2-4984d6df54ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:01.749357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08cf04f-59c8-42d1-b2f2-4984d6df54ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:01.750724 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08cf04f-59c8-42d1-b2f2-4984d6df54ac None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:01.762363 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 531/1070] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:01.768414 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cf04f-59c8-42d1-b2f2-4984d6df54ac None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:01.783466 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 540/1071] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:03:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:03:01.873381 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:01.877007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cf04f-59c8-42d1-b2f2-4984d6df54ac None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:01.912328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bbf58-b391-45d8-8ec4-2fa20e2f2b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:01.912953 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bbf58-b391-45d8-8ec4-2fa20e2f2b78 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:01.913232 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bbf58-b391-45d8-8ec4-2fa20e2f2b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:01.913506 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bbf58-b391-45d8-8ec4-2fa20e2f2b78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:01.920178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5bbf58-b391-45d8-8ec4-2fa20e2f2b78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:01.921611 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5bbf58-b391-45d8-8ec4-2fa20e2f2b78 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:01.938140 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-6c5bbf58-b391-45d8-8ec4-2fa20e2f2b78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:03:01.938140 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:03:01.938140 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:03:01.938140 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:03:01.938140 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:03:01.938140 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:03:01.938140 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:03:01.938140 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:03:01.938140 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:03:01.938140 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:03:01.938140 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:03:01.938140 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:03:01.938140 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:03:01.938140 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:03:01.938140 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:03:01.939061 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:03:01.939061 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:03:01.939061 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:03:01.939061 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:03:01.939061 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:03:01.939061 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:03:01.939061 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:03:01.939061 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:03:01.939061 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:03:01.939061 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:03:01.939061 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:03:01.939061 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:03:01.939061 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:03:01.939061 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:03:01.939061 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:03:01.939061 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:03:01.939061 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:03:01.940550 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:03:01.940550 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:03:01.940550 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:03:01.940550 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:03:01.940550 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:03:01.940550 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:03:01.940550 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:03:01.940550 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:03:01.941557 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 532/1072] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:03:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:03:01.945597 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a67f2-8223-4027-a200-0ed254664003 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:02.046188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a67f2-8223-4027-a200-0ed254664003 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:02.049861 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bbf58-b391-45d8-8ec4-2fa20e2f2b78 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:02.085056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd894463-1364-4d86-89f6-78f75acf9b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:02.085673 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd894463-1364-4d86-89f6-78f75acf9b18 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:02.085954 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd894463-1364-4d86-89f6-78f75acf9b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:02.086226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd894463-1364-4d86-89f6-78f75acf9b18 None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:02.086985 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd894463-1364-4d86-89f6-78f75acf9b18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:02.087386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd894463-1364-4d86-89f6-78f75acf9b18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:02.088803 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd894463-1364-4d86-89f6-78f75acf9b18 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:02.097915 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:02.103587 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 541/1073] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:03:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:02.108242 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd894463-1364-4d86-89f6-78f75acf9b18 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:02.168035 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bbf58-b391-45d8-8ec4-2fa20e2f2b78 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:02.204213 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407309f-cacc-4a5e-828e-881a2a9f80c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:02.204959 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407309f-cacc-4a5e-828e-881a2a9f80c8 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:02.205242 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407309f-cacc-4a5e-828e-881a2a9f80c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:02.206167 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407309f-cacc-4a5e-828e-881a2a9f80c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:02.214935 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd894463-1364-4d86-89f6-78f75acf9b18 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:02.217516 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407309f-cacc-4a5e-828e-881a2a9f80c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:03:02.223182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-4407309f-cacc-4a5e-828e-881a2a9f80c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:03:02.223182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:03:02.223182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:03:02.223182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:03:02.223182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:03:02.223182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:03:02.223182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:03:02.223182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:03:02.223182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:03:02.223182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:03:02.223182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:03:02.223182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:03:02.223182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:03:02.223182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:03:02.223182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:03:02.223182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:03:02.224215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:03:02.224215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:03:02.224215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:03:02.224215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:03:02.224215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:03:02.224215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:03:02.224215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:03:02.224215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:03:02.224215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:03:02.224215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:03:02.224215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:03:02.224215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:03:02.224215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:03:02.224215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:03:02.224215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:03:02.224215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:03:02.228519 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:03:02.228519 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:03:02.228519 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:03:02.228519 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:03:02.228519 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:03:02.228519 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:03:02.228519 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:03:02.228519 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:03:02.228519 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:03:02.228519 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:03:02.228519 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:03:02.228519 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:03:02.228519 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 533/1074] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:03:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:03:02.230293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407309f-cacc-4a5e-828e-881a2a9f80c8 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:02.252906 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:02.253472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3cd61-8d46-46b4-b048-f41b15d76687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:02.254135 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3cd61-8d46-46b4-b048-f41b15d76687 None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:02.254413 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3cd61-8d46-46b4-b048-f41b15d76687 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:02.254689 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3cd61-8d46-46b4-b048-f41b15d76687 None admin] PATH_INFO: `/v3/projects/c854d366f35145e8b2fadb9b014d0199/users/0e81804e04514ae882a1fd93789db025/roles/d36bf69b347c431a8923d10a00d66e1c` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:02.257227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3cd61-8d46-46b4-b048-f41b15d76687 None admin] RBAC: Authorizing `identity:create_grant(project_id=c854d366f35145e8b2fadb9b014d0199, user_id=0e81804e04514ae882a1fd93789db025, role_id=d36bf69b347c431a8923d10a00d66e1c)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:02.258453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3cd61-8d46-46b4-b048-f41b15d76687 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:02.271920 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 542/1075] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 28 12:03:02 2022] PUT /identity/v3/projects/c854d366f35145e8b2fadb9b014d0199/users/0e81804e04514ae882a1fd93789db025/roles/d36bf69b347c431a8923d10a00d66e1c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:03:02.276930 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36761a91-b849-41d6-9d1c-4cccd3601d52 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:02.277271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36761a91-b849-41d6-9d1c-4cccd3601d52 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:02.277499 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36761a91-b849-41d6-9d1c-4cccd3601d52 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:02.279282 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 543/1076] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:03:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:03:02.286044 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47311f6c-1348-42b7-85c1-ea3145d78eb2 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:02.286356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47311f6c-1348-42b7-85c1-ea3145d78eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:02.286598 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47311f6c-1348-42b7-85c1-ea3145d78eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:02.305860 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-47311f6c-1348-42b7-85c1-ea3145d78eb2 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:03:02.307109 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-47311f6c-1348-42b7-85c1-ea3145d78eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:03:02.353299 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407309f-cacc-4a5e-828e-881a2a9f80c8 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:02.377538 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:02.394101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f60bc8-9164-48d3-b84f-ed26f6e786fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:02.394513 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 544/1077] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:03:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:03:02.396086 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f60bc8-9164-48d3-b84f-ed26f6e786fc None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:02.396376 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f60bc8-9164-48d3-b84f-ed26f6e786fc None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:02.396654 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f60bc8-9164-48d3-b84f-ed26f6e786fc None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:02.397349 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f60bc8-9164-48d3-b84f-ed26f6e786fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:02.397657 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f60bc8-9164-48d3-b84f-ed26f6e786fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:02.399060 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f60bc8-9164-48d3-b84f-ed26f6e786fc None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:02.414355 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 534/1078] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:03:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:03:02.415361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47311f6c-1348-42b7-85c1-ea3145d78eb2 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:02.523727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47311f6c-1348-42b7-85c1-ea3145d78eb2 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:02.557892 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858134eb-2a19-4301-869a-93fd5b9c4df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:02.558537 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858134eb-2a19-4301-869a-93fd5b9c4df5 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:02.558817 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858134eb-2a19-4301-869a-93fd5b9c4df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:02.559089 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858134eb-2a19-4301-869a-93fd5b9c4df5 None admin] PATH_INFO: `/v3/users/ecc5e86ca93349c1802035d91b6351a6` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:02.560259 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858134eb-2a19-4301-869a-93fd5b9c4df5 None admin] RBAC: Authorizing `identity:get_user(user_id=ecc5e86ca93349c1802035d91b6351a6)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:02.561689 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858134eb-2a19-4301-869a-93fd5b9c4df5 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:02.567500 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 545/1079] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:03:02 2022] GET /identity/v3/users/ecc5e86ca93349c1802035d91b6351a6 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:03:02.569315 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f60bc8-9164-48d3-b84f-ed26f6e786fc None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:02.652815 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:02.672666 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f60bc8-9164-48d3-b84f-ed26f6e786fc None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:02.673627 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858134eb-2a19-4301-869a-93fd5b9c4df5 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:02.712407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befeed7-edc4-4d7e-a26d-e1e3b7e84edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:02.713142 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befeed7-edc4-4d7e-a26d-e1e3b7e84edf None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:02.713329 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befeed7-edc4-4d7e-a26d-e1e3b7e84edf None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:02.713606 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befeed7-edc4-4d7e-a26d-e1e3b7e84edf None admin] PATH_INFO: `/v3/projects/2472ae76a0e84195adaa076faba9d34d` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:02.714738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2befeed7-edc4-4d7e-a26d-e1e3b7e84edf None admin] RBAC: Authorizing `identity:get_project(project_id=2472ae76a0e84195adaa076faba9d34d)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:02.716310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2befeed7-edc4-4d7e-a26d-e1e3b7e84edf None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:02.723470 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 535/1080] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:03:02 2022] GET /identity/v3/projects/2472ae76a0e84195adaa076faba9d34d => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:02.724236 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befeed7-edc4-4d7e-a26d-e1e3b7e84edf None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:02.747253 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:02.791046 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858134eb-2a19-4301-869a-93fd5b9c4df5 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:02.828713 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a2697-b887-4724-a9d6-557a3a6a2b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:02.829406 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a2697-b887-4724-a9d6-557a3a6a2b9d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:02.829697 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a2697-b887-4724-a9d6-557a3a6a2b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:02.829974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a2697-b887-4724-a9d6-557a3a6a2b9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:02.833531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befeed7-edc4-4d7e-a26d-e1e3b7e84edf None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:02.870128 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e7505-6921-4919-9525-10995023b114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:02.870791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e7505-6921-4919-9525-10995023b114 None admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:02.871073 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e7505-6921-4919-9525-10995023b114 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:02.871346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e7505-6921-4919-9525-10995023b114 None admin] PATH_INFO: `/v3/projects/2472ae76a0e84195adaa076faba9d34d/users/ecc5e86ca93349c1802035d91b6351a6/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:02.873305 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e7505-6921-4919-9525-10995023b114 None admin] RBAC: Authorizing `identity:create_grant(project_id=2472ae76a0e84195adaa076faba9d34d, user_id=ecc5e86ca93349c1802035d91b6351a6, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:02.874767 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e7505-6921-4919-9525-10995023b114 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:02.888829 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 536/1081] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 28 12:03:02 2022] PUT /identity/v3/projects/2472ae76a0e84195adaa076faba9d34d/users/ecc5e86ca93349c1802035d91b6351a6/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:03:02.905032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a2697-b887-4724-a9d6-557a3a6a2b9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:02.906508 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a2697-b887-4724-a9d6-557a3a6a2b9d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:02.972222 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:03.024477 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 546/1082] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:03:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 28 12:03:03.030328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e7505-6921-4919-9525-10995023b114 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:03.043735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:03.145066 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e7505-6921-4919-9525-10995023b114 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:03.182359 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cace4-aae2-45af-94b2-16375d286870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:03.183546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cace4-aae2-45af-94b2-16375d286870 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:03.184049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cace4-aae2-45af-94b2-16375d286870 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:03.184550 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cace4-aae2-45af-94b2-16375d286870 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:03.195624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6cace4-aae2-45af-94b2-16375d286870 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:03.197353 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6cace4-aae2-45af-94b2-16375d286870 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:03.211977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-9f6cace4-aae2-45af-94b2-16375d286870 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:03:03.211977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:03:03.211977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:03:03.211977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:03:03.211977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:03:03.211977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:03:03.211977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:03:03.211977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:03:03.211977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:03:03.211977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:03:03.211977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:03:03.211977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:03:03.211977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:03:03.211977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:03:03.211977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:03:03.211977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:03:03.213080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:03:03.213080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:03:03.213080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:03:03.213080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:03:03.213080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:03:03.213080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:03:03.213080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:03:03.213080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:03:03.213080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:03:03.213080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:03:03.213080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:03:03.213080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:03:03.213080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:03:03.213080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:03:03.213080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:03:03.213080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:03:03.213080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:03:03.214066 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:03:03.214066 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:03:03.214066 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:03:03.215506 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 537/1083] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:03:03.220291 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a2697-b887-4724-a9d6-557a3a6a2b9d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:03.319043 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a2697-b887-4724-a9d6-557a3a6a2b9d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:03.354025 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b72bd2-ba79-4bff-9f06-a77a70be49f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:03.354626 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b72bd2-ba79-4bff-9f06-a77a70be49f2 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:03.354898 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b72bd2-ba79-4bff-9f06-a77a70be49f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:03.355165 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b72bd2-ba79-4bff-9f06-a77a70be49f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:03.355830 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b72bd2-ba79-4bff-9f06-a77a70be49f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:03.356133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b72bd2-ba79-4bff-9f06-a77a70be49f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:03.357475 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b72bd2-ba79-4bff-9f06-a77a70be49f2 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:03.369848 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 547/1084] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:03:04.443028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1c4a0-355c-4625-a17e-6432e814c8c4 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:04.443578 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1c4a0-355c-4625-a17e-6432e814c8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:04.443675 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1c4a0-355c-4625-a17e-6432e814c8c4 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:04.444953 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 538/1085] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:03:04.450308 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d56ef-f41f-466b-90bc-21e0a985f0f7 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:04.450721 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d56ef-f41f-466b-90bc-21e0a985f0f7 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:04.450855 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d56ef-f41f-466b-90bc-21e0a985f0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:04.469634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-9a4d56ef-f41f-466b-90bc-21e0a985f0f7 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:03:04.470802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9a4d56ef-f41f-466b-90bc-21e0a985f0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:03:04.484328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:04.538390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 548/1086] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:03:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:03:04.804838 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1c4a0-355c-4625-a17e-6432e814c8c4 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:04.866715 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:04.907370 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1c4a0-355c-4625-a17e-6432e814c8c4 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:04.944215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78673dd2-0c41-4dd7-b1db-d9edd05eecd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:04.944843 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78673dd2-0c41-4dd7-b1db-d9edd05eecd6 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:04.945120 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78673dd2-0c41-4dd7-b1db-d9edd05eecd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:04.945390 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78673dd2-0c41-4dd7-b1db-d9edd05eecd6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:04.956714 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78673dd2-0c41-4dd7-b1db-d9edd05eecd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:03:04.961376 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-78673dd2-0c41-4dd7-b1db-d9edd05eecd6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 12:03:04.961376 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:03:04.961376 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:03:04.961376 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:03:04.961376 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:03:04.961376 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:03:04.961376 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:03:04.961376 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:03:04.961376 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:03:04.961376 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:03:04.961376 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:03:04.961376 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:03:04.961376 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:03:04.961376 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:03:04.961376 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:03:04.961376 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:03:04.962374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:03:04.962374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:03:04.962374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:03:04.962374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:03:04.962374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:03:04.962374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:03:04.962374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:03:04.962374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:03:04.962374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:03:04.962374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:03:04.962374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:03:04.962374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:03:04.962374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:03:04.962374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:03:04.962374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:03:04.962374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:03:04.963274 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:03:04.963274 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:03:04.963274 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:03:04.963274 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:03:04.963274 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:03:04.963274 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:03:04.963274 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:03:04.963274 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:03:04.963274 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:03:04.963274 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:03:04.963274 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 12:03:04.963274 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:03:04.963274 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 539/1087] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Sep 28 12:03:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:03:04.968555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d56ef-f41f-466b-90bc-21e0a985f0f7 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:05.023803 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdfac5-cb55-4586-8622-d87d70620f76 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:05.024094 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdfac5-cb55-4586-8622-d87d70620f76 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:05.024423 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdfac5-cb55-4586-8622-d87d70620f76 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:05.025766 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 540/1088] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:03:05.030679 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12377db4-9dd7-40df-b4e9-b5af472ab6e2 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:05.030959 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12377db4-9dd7-40df-b4e9-b5af472ab6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:05.031224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12377db4-9dd7-40df-b4e9-b5af472ab6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:05.052724 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-12377db4-9dd7-40df-b4e9-b5af472ab6e2 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:03:05.053922 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-12377db4-9dd7-40df-b4e9-b5af472ab6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:03:05.069471 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d56ef-f41f-466b-90bc-21e0a985f0f7 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:05.106749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4f3af-1f6d-4921-8446-4df54caec294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:05.107350 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4f3af-1f6d-4921-8446-4df54caec294 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:05.107667 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4f3af-1f6d-4921-8446-4df54caec294 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:05.107940 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4f3af-1f6d-4921-8446-4df54caec294 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:05.108600 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4f3af-1f6d-4921-8446-4df54caec294 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:05.108898 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4f3af-1f6d-4921-8446-4df54caec294 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:05.110266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4f3af-1f6d-4921-8446-4df54caec294 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:05.118572 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 549/1089] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Sep 28 12:03:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:05.119284 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 541/1090] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:03:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:03:05.124508 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4f3af-1f6d-4921-8446-4df54caec294 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:05.137652 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:05.224672 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4f3af-1f6d-4921-8446-4df54caec294 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:05.258154 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432fc8b-7cdd-431f-9dd3-d7a4d52d5795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:05.258769 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432fc8b-7cdd-431f-9dd3-d7a4d52d5795 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:05.259047 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432fc8b-7cdd-431f-9dd3-d7a4d52d5795 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:05.259321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432fc8b-7cdd-431f-9dd3-d7a4d52d5795 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:05.269636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432fc8b-7cdd-431f-9dd3-d7a4d52d5795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:05.271064 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432fc8b-7cdd-431f-9dd3-d7a4d52d5795 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:05.284851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-d432fc8b-7cdd-431f-9dd3-d7a4d52d5795 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:03:05.284851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:03:05.284851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:03:05.284851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:03:05.284851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:03:05.284851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:03:05.284851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:03:05.284851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:03:05.284851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:03:05.284851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:03:05.284851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:03:05.284851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:03:05.284851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:03:05.284851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:03:05.284851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:03:05.284851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:03:05.285986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:03:05.285986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:03:05.285986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:03:05.285986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:03:05.285986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:03:05.285986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:03:05.285986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:03:05.285986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:03:05.285986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:03:05.285986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:03:05.285986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:03:05.285986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:03:05.285986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:03:05.285986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:03:05.285986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:03:05.285986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:03:05.285986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:03:05.287123 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:03:05.287123 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:03:05.287123 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:03:05.290554 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 550/1091] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:03:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:03:05.291782 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12377db4-9dd7-40df-b4e9-b5af472ab6e2 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:05.343540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:05.384907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432fc8b-7cdd-431f-9dd3-d7a4d52d5795 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:05.389705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12377db4-9dd7-40df-b4e9-b5af472ab6e2 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:05.425174 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546cd17-5012-4f64-9b78-c84ca88e64fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:05.425775 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546cd17-5012-4f64-9b78-c84ca88e64fe None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:05.426051 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546cd17-5012-4f64-9b78-c84ca88e64fe None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:05.426322 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546cd17-5012-4f64-9b78-c84ca88e64fe None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:05.426957 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546cd17-5012-4f64-9b78-c84ca88e64fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:05.427253 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546cd17-5012-4f64-9b78-c84ca88e64fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:05.428663 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546cd17-5012-4f64-9b78-c84ca88e64fe None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:05.444941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 542/1092] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:05.445909 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546cd17-5012-4f64-9b78-c84ca88e64fe None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:05.449304 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:05.489192 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432fc8b-7cdd-431f-9dd3-d7a4d52d5795 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:05.523740 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833bf7e-9043-45ce-b036-4a3a6d1af8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:05.524361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833bf7e-9043-45ce-b036-4a3a6d1af8ab None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:05.524639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833bf7e-9043-45ce-b036-4a3a6d1af8ab None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:05.524907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833bf7e-9043-45ce-b036-4a3a6d1af8ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:05.535541 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833bf7e-9043-45ce-b036-4a3a6d1af8ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:03:05.540370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-4833bf7e-9043-45ce-b036-4a3a6d1af8ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:03:05.540370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:03:05.540370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:03:05.540370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:03:05.540370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:03:05.540370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:03:05.540370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:03:05.540370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:03:05.540370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:03:05.540370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:03:05.540370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:03:05.540370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:03:05.540370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:03:05.540370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:03:05.540370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:03:05.540370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:03:05.541324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:03:05.541324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:03:05.541324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:03:05.541324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:03:05.541324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:03:05.541324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:03:05.541324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:03:05.541324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:03:05.541324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:03:05.541324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:03:05.541324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:03:05.541324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:03:05.541324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:03:05.541324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:03:05.541324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:03:05.541324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:03:05.542260 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:03:05.542260 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:03:05.542260 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:03:05.542260 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:03:05.542260 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:03:05.542260 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:03:05.542260 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:03:05.542260 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:03:05.542260 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:03:05.542260 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:03:05.542260 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:03:05.542260 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:03:05.542260 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 551/1093] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:03:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:03:05.544616 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546cd17-5012-4f64-9b78-c84ca88e64fe None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:05.547346 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833bf7e-9043-45ce-b036-4a3a6d1af8ab None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:05.557945 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:05.579684 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25486c-375b-4302-a531-e50f66a56323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:05.580325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25486c-375b-4302-a531-e50f66a56323 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:05.580608 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25486c-375b-4302-a531-e50f66a56323 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:05.580875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25486c-375b-4302-a531-e50f66a56323 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:05.589174 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25486c-375b-4302-a531-e50f66a56323 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:05.590603 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25486c-375b-4302-a531-e50f66a56323 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:05.602176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-bf25486c-375b-4302-a531-e50f66a56323 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:03:05.602176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:03:05.602176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:03:05.602176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:03:05.602176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:03:05.602176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:03:05.602176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:03:05.602176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:03:05.602176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:03:05.602176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:03:05.602176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:03:05.602176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:03:05.602176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:03:05.602176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:03:05.602176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:03:05.602176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:03:05.603282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:03:05.603282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:03:05.603282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:03:05.603282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:03:05.603282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:03:05.603282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:03:05.603282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:03:05.603282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:03:05.603282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:03:05.603282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:03:05.603282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:03:05.603282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:03:05.603282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:03:05.603282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:03:05.603282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:03:05.603282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:03:05.603282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:03:05.603282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:03:05.604325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:03:05.604325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:03:05.604325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:03:05.604325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:03:05.604325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:03:05.604325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:03:05.604325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:03:05.604325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:03:05.604325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:03:05.604325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:03:05.604325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 543/1094] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Sep 28 12:03:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:03:05.608834 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25486c-375b-4302-a531-e50f66a56323 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:05.647498 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833bf7e-9043-45ce-b036-4a3a6d1af8ab None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:05.669577 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:05.682993 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af91283-646c-4d26-ab32-188281ad17b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:05.683640 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af91283-646c-4d26-ab32-188281ad17b3 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:05.683923 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af91283-646c-4d26-ab32-188281ad17b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:05.684197 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af91283-646c-4d26-ab32-188281ad17b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:05.684859 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af91283-646c-4d26-ab32-188281ad17b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:05.685166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af91283-646c-4d26-ab32-188281ad17b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:05.686550 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af91283-646c-4d26-ab32-188281ad17b3 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:05.694976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 552/1095] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:03:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:03:05.700925 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af91283-646c-4d26-ab32-188281ad17b3 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:05.710191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25486c-375b-4302-a531-e50f66a56323 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:05.749667 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34eabd8-6a0f-49ca-96bc-b0ea8a1cb449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:05.750228 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34eabd8-6a0f-49ca-96bc-b0ea8a1cb449 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:05.750589 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34eabd8-6a0f-49ca-96bc-b0ea8a1cb449 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:05.750872 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34eabd8-6a0f-49ca-96bc-b0ea8a1cb449 None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:05.751727 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34eabd8-6a0f-49ca-96bc-b0ea8a1cb449 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:05.752030 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34eabd8-6a0f-49ca-96bc-b0ea8a1cb449 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:05.753477 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34eabd8-6a0f-49ca-96bc-b0ea8a1cb449 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:05.770308 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 544/1096] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Sep 28 12:03:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:03:05.776027 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34eabd8-6a0f-49ca-96bc-b0ea8a1cb449 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:05.802604 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af91283-646c-4d26-ab32-188281ad17b3 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:05.805516 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:05.836773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d504870-6de2-4615-a640-8ef76e13bf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:05.837400 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d504870-6de2-4615-a640-8ef76e13bf93 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:05.837677 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d504870-6de2-4615-a640-8ef76e13bf93 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:05.837953 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d504870-6de2-4615-a640-8ef76e13bf93 None admin] PATH_INFO: `/v3/users/ecc5e86ca93349c1802035d91b6351a6` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:05.839071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d504870-6de2-4615-a640-8ef76e13bf93 None admin] RBAC: Authorizing `identity:get_user(user_id=ecc5e86ca93349c1802035d91b6351a6)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:05.840529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d504870-6de2-4615-a640-8ef76e13bf93 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:05.842138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 553/1097] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:03:05 2022] GET /identity/v3/users/ecc5e86ca93349c1802035d91b6351a6 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:03:05.848591 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d504870-6de2-4615-a640-8ef76e13bf93 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:05.879788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34eabd8-6a0f-49ca-96bc-b0ea8a1cb449 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:05.900373 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:05.913574 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdffefd-3bac-4f75-9701-7b3069524b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:05.914263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdffefd-3bac-4f75-9701-7b3069524b59 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:05.914547 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdffefd-3bac-4f75-9701-7b3069524b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:05.914822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdffefd-3bac-4f75-9701-7b3069524b59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:05.947704 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d504870-6de2-4615-a640-8ef76e13bf93 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:05.980848 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdffefd-3bac-4f75-9701-7b3069524b59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:05.981678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec69370-eaf4-41d8-8c57-968bee1e5dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:05.982279 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdffefd-3bac-4f75-9701-7b3069524b59 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:05.982416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec69370-eaf4-41d8-8c57-968bee1e5dda None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:05.982555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec69370-eaf4-41d8-8c57-968bee1e5dda None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:05.982827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec69370-eaf4-41d8-8c57-968bee1e5dda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:06.010809 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:06.048427 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec69370-eaf4-41d8-8c57-968bee1e5dda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:06.049874 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec69370-eaf4-41d8-8c57-968bee1e5dda None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:06.081325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 545/1098] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:03:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:03:06.086962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdffefd-3bac-4f75-9701-7b3069524b59 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:06.099848 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:06.149034 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 554/1099] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:03:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 28 12:03:06.154872 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec69370-eaf4-41d8-8c57-968bee1e5dda None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:06.185560 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdffefd-3bac-4f75-9701-7b3069524b59 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:06.213867 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:06.219795 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca317a-062b-4fe1-9f51-25ec86beee6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:06.220418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca317a-062b-4fe1-9f51-25ec86beee6c None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:06.220692 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca317a-062b-4fe1-9f51-25ec86beee6c None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:06.221544 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca317a-062b-4fe1-9f51-25ec86beee6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:06.231785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca317a-062b-4fe1-9f51-25ec86beee6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:06.233229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca317a-062b-4fe1-9f51-25ec86beee6c None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:06.248189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-05ca317a-062b-4fe1-9f51-25ec86beee6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:03:06.248189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:03:06.248189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:03:06.248189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:03:06.248189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:03:06.248189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:03:06.248189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:03:06.248189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:03:06.248189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:03:06.248189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:03:06.248189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:03:06.248189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:03:06.248189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:03:06.248189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:03:06.248189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:03:06.248189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:03:06.249214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:03:06.249214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:03:06.249214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:03:06.249214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:03:06.249214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:03:06.249214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:03:06.249214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:03:06.249214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:03:06.249214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:03:06.249214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:03:06.249214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:03:06.249214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:03:06.249214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:03:06.249214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:03:06.249214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:03:06.249214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:03:06.249214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:03:06.250580 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:03:06.250580 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:03:06.250580 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:03:06.250580 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 546/1100] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:03:06.250881 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec69370-eaf4-41d8-8c57-968bee1e5dda None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:06.254943 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca317a-062b-4fe1-9f51-25ec86beee6c None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:06.284326 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25593f-bf28-4026-b83d-05002bc978d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:06.284945 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25593f-bf28-4026-b83d-05002bc978d8 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:06.285219 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25593f-bf28-4026-b83d-05002bc978d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:06.285484 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25593f-bf28-4026-b83d-05002bc978d8 None admin] PATH_INFO: `/v3/projects/2472ae76a0e84195adaa076faba9d34d` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:06.286583 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25593f-bf28-4026-b83d-05002bc978d8 None admin] RBAC: Authorizing `identity:get_project(project_id=2472ae76a0e84195adaa076faba9d34d)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:06.288022 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25593f-bf28-4026-b83d-05002bc978d8 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:06.294580 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 555/1101] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:03:06 2022] GET /identity/v3/projects/2472ae76a0e84195adaa076faba9d34d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:03:06.295626 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25593f-bf28-4026-b83d-05002bc978d8 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:06.316483 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:06.355404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca317a-062b-4fe1-9f51-25ec86beee6c None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:06.388433 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d5b9d-cb77-4178-95be-b0e1e104f366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:06.389021 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d5b9d-cb77-4178-95be-b0e1e104f366 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:06.389300 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d5b9d-cb77-4178-95be-b0e1e104f366 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:06.389567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d5b9d-cb77-4178-95be-b0e1e104f366 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:06.390197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d5b9d-cb77-4178-95be-b0e1e104f366 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:06.390492 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d5b9d-cb77-4178-95be-b0e1e104f366 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:06.391885 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d5b9d-cb77-4178-95be-b0e1e104f366 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:06.394888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25593f-bf28-4026-b83d-05002bc978d8 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:06.403863 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 547/1102] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:03:06.409359 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d5b9d-cb77-4178-95be-b0e1e104f366 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:06.432291 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a46a1-1583-429d-85ea-17cf8b0f7dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:06.433100 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a46a1-1583-429d-85ea-17cf8b0f7dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:06.433558 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a46a1-1583-429d-85ea-17cf8b0f7dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:06.433830 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a46a1-1583-429d-85ea-17cf8b0f7dd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:06.434547 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a46a1-1583-429d-85ea-17cf8b0f7dd3 None admin] RBAC: Adding query filter params (role.id=66456d39fc0c496c8f290a436b726216, scope.project.id=2472ae76a0e84195adaa076faba9d34d, user.id=ecc5e86ca93349c1802035d91b6351a6) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:06.434854 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a46a1-1583-429d-85ea-17cf8b0f7dd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:06.436301 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a46a1-1583-429d-85ea-17cf8b0f7dd3 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:06.442624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 556/1103] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:03:06 2022] GET /identity/v3/role_assignments?user.id=ecc5e86ca93349c1802035d91b6351a6&scope.project.id=2472ae76a0e84195adaa076faba9d34d&role.id=66456d39fc0c496c8f290a436b726216 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:03:06.452029 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:06.513610 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d5b9d-cb77-4178-95be-b0e1e104f366 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:06.550166 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735102b-54dd-4272-b306-aaec6dcbb4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:06.550728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735102b-54dd-4272-b306-aaec6dcbb4bb None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:06.551044 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735102b-54dd-4272-b306-aaec6dcbb4bb None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:06.551322 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735102b-54dd-4272-b306-aaec6dcbb4bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:06.558733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735102b-54dd-4272-b306-aaec6dcbb4bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:06.560233 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735102b-54dd-4272-b306-aaec6dcbb4bb None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:06.573006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-e735102b-54dd-4272-b306-aaec6dcbb4bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:03:06.573006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:03:06.573006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:03:06.573006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:03:06.573006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:03:06.573006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:03:06.573006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:03:06.573006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:03:06.573006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:03:06.573006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:03:06.573006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:03:06.573006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:03:06.573006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:03:06.573006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:03:06.573006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:03:06.574151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:03:06.574151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:03:06.574151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:03:06.574151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:03:06.574151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:03:06.574151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:03:06.574151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:03:06.574151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:03:06.574151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:03:06.574151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:03:06.574151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:03:06.574151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:03:06.574151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:03:06.574151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:03:06.574151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:03:06.574151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:03:06.574151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:03:06.575477 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:03:06.575477 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:03:06.575477 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:03:06.575477 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:03:06.575477 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:03:06.575477 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:03:06.575477 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:03:06.575477 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:03:06.575477 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 548/1104] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:03:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:03:06.580390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a46a1-1583-429d-85ea-17cf8b0f7dd3 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:06.669296 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:06.685062 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a46a1-1583-429d-85ea-17cf8b0f7dd3 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:06.719520 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93528d2a-9949-477a-8700-c444b99f8bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:06.720126 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93528d2a-9949-477a-8700-c444b99f8bae None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:06.720405 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93528d2a-9949-477a-8700-c444b99f8bae None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:06.720675 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93528d2a-9949-477a-8700-c444b99f8bae None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:06.721366 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93528d2a-9949-477a-8700-c444b99f8bae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:06.721672 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93528d2a-9949-477a-8700-c444b99f8bae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:06.723083 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93528d2a-9949-477a-8700-c444b99f8bae None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:06.735903 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 557/1105] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:03:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:06.742645 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735102b-54dd-4272-b306-aaec6dcbb4bb None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:06.841676 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735102b-54dd-4272-b306-aaec6dcbb4bb None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:06.843148 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:06.876225 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d608420-c397-4b8d-a4d9-ac4bcac95b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:06.876822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d608420-c397-4b8d-a4d9-ac4bcac95b7d None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:06.877102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d608420-c397-4b8d-a4d9-ac4bcac95b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:06.878261 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d608420-c397-4b8d-a4d9-ac4bcac95b7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:06.878989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d608420-c397-4b8d-a4d9-ac4bcac95b7d None admin] RBAC: Adding query filter params (role.id=d36bf69b347c431a8923d10a00d66e1c, scope.project.id=c854d366f35145e8b2fadb9b014d0199, user.id=0e81804e04514ae882a1fd93789db025) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:06.879299 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d608420-c397-4b8d-a4d9-ac4bcac95b7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:06.880768 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d608420-c397-4b8d-a4d9-ac4bcac95b7d None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:06.886439 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 549/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:03:06 2022] GET /identity/v3/role_assignments?user.id=0e81804e04514ae882a1fd93789db025&scope.project.id=c854d366f35145e8b2fadb9b014d0199&role.id=d36bf69b347c431a8923d10a00d66e1c => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:08.629473 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585eb39-5fed-486b-b308-63040dfe078b None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:08.631376 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585eb39-5fed-486b-b308-63040dfe078b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:08.631376 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585eb39-5fed-486b-b308-63040dfe078b None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:08.631376 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 558/1107] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:03:08.636695 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72398bef-70b0-4012-8315-d559b7b318c1 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:08.637094 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72398bef-70b0-4012-8315-d559b7b318c1 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:08.637236 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72398bef-70b0-4012-8315-d559b7b318c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:08.655578 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-72398bef-70b0-4012-8315-d559b7b318c1 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:03:08.656755 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-72398bef-70b0-4012-8315-d559b7b318c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:03:08.721565 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 550/1108] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:03:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:03:08.991143 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585eb39-5fed-486b-b308-63040dfe078b None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:09.089348 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585eb39-5fed-486b-b308-63040dfe078b None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:09.121929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0dbb45-d722-4e35-a0e8-bc4037e99b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:09.122542 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0dbb45-d722-4e35-a0e8-bc4037e99b41 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:09.122827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0dbb45-d722-4e35-a0e8-bc4037e99b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:09.123093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0dbb45-d722-4e35-a0e8-bc4037e99b41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:09.124216 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0dbb45-d722-4e35-a0e8-bc4037e99b41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:09.125631 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0dbb45-d722-4e35-a0e8-bc4037e99b41 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:09.127864 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 559/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:03:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:09.133155 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72398bef-70b0-4012-8315-d559b7b318c1 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:09.222748 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:09.228935 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72398bef-70b0-4012-8315-d559b7b318c1 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:09.262427 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca845c-1668-49c4-bbf7-c9614aa28855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:09.262966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca845c-1668-49c4-bbf7-c9614aa28855 None admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:09.263244 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca845c-1668-49c4-bbf7-c9614aa28855 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:09.263542 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca845c-1668-49c4-bbf7-c9614aa28855 None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:09.264181 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca845c-1668-49c4-bbf7-c9614aa28855 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:09.265597 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca845c-1668-49c4-bbf7-c9614aa28855 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:09.285201 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 551/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 28 12:03:09 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:03:11.441351 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96420f2a-1bc4-43cb-8fdc-bd9a7e1345bf None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:11.441910 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96420f2a-1bc4-43cb-8fdc-bd9a7e1345bf None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:11.441910 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96420f2a-1bc4-43cb-8fdc-bd9a7e1345bf None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:11.443222 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 560/1111] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:03:11.448436 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45b5cb-a5cf-49b9-8a44-86e4df46df52 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:11.448819 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45b5cb-a5cf-49b9-8a44-86e4df46df52 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:11.448979 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45b5cb-a5cf-49b9-8a44-86e4df46df52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:11.468374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-2d45b5cb-a5cf-49b9-8a44-86e4df46df52 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:03:11.469540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-2d45b5cb-a5cf-49b9-8a44-86e4df46df52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:03:11.534818 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 552/1112] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:03:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:03:11.797902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96420f2a-1bc4-43cb-8fdc-bd9a7e1345bf None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:11.812671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:11.901766 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96420f2a-1bc4-43cb-8fdc-bd9a7e1345bf None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:11.934738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf0b53-420c-44a7-bb15-322b629bc970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:11.935359 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf0b53-420c-44a7-bb15-322b629bc970 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:11.935674 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf0b53-420c-44a7-bb15-322b629bc970 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:11.935948 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf0b53-420c-44a7-bb15-322b629bc970 None admin] PATH_INFO: `/v3/roles/67ed180941fd45af996b858232628221` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:11.937341 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf0b53-420c-44a7-bb15-322b629bc970 None admin] RBAC: Authorizing `identity:get_role(role_id=67ed180941fd45af996b858232628221)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:11.938697 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf0b53-420c-44a7-bb15-322b629bc970 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:11.940602 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 561/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:03:11 2022] GET /identity/v3/roles/67ed180941fd45af996b858232628221 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:11.946370 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45b5cb-a5cf-49b9-8a44-86e4df46df52 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:12.024450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:12.042053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45b5cb-a5cf-49b9-8a44-86e4df46df52 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:12.075126 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ab285-f405-4eb1-a65e-f895fba46b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:12.075762 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ab285-f405-4eb1-a65e-f895fba46b9f None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:12.076038 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ab285-f405-4eb1-a65e-f895fba46b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:12.076305 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ab285-f405-4eb1-a65e-f895fba46b9f None admin] PATH_INFO: `/v3/users/13297d6b9cca4d68aa8a4a0b801b9ec9` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:12.088745 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ab285-f405-4eb1-a65e-f895fba46b9f None admin] RBAC: Authorizing `identity:get_user(user_id=13297d6b9cca4d68aa8a4a0b801b9ec9)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:12.090165 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ab285-f405-4eb1-a65e-f895fba46b9f None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:12.091754 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 553/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:03:11 2022] GET /identity/v3/users/13297d6b9cca4d68aa8a4a0b801b9ec9 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:12.097381 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf0b53-420c-44a7-bb15-322b629bc970 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:12.178110 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:12.197211 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf0b53-420c-44a7-bb15-322b629bc970 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:12.231959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b204143-3ae5-44d2-abee-44a261a399de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:12.232559 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b204143-3ae5-44d2-abee-44a261a399de None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:12.232838 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b204143-3ae5-44d2-abee-44a261a399de None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:12.233109 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b204143-3ae5-44d2-abee-44a261a399de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:12.298736 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b204143-3ae5-44d2-abee-44a261a399de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:12.300668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b204143-3ae5-44d2-abee-44a261a399de None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:12.377289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:12.396425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 562/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:03:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:03:12.402384 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ab285-f405-4eb1-a65e-f895fba46b9f None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:12.499253 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ab285-f405-4eb1-a65e-f895fba46b9f None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:12.536819 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc9e75-aec3-4385-a5ea-345ce4f86797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:12.537436 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc9e75-aec3-4385-a5ea-345ce4f86797 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:12.537712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc9e75-aec3-4385-a5ea-345ce4f86797 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:12.537981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc9e75-aec3-4385-a5ea-345ce4f86797 None admin] PATH_INFO: `/v3/projects/2472ae76a0e84195adaa076faba9d34d` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:12.539077 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc9e75-aec3-4385-a5ea-345ce4f86797 None admin] RBAC: Authorizing `identity:get_project(project_id=2472ae76a0e84195adaa076faba9d34d)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:12.540530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc9e75-aec3-4385-a5ea-345ce4f86797 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:12.542159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 554/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:03:12 2022] GET /identity/v3/projects/2472ae76a0e84195adaa076faba9d34d => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:12.548309 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b204143-3ae5-44d2-abee-44a261a399de None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:12.646300 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b204143-3ae5-44d2-abee-44a261a399de None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:12.679390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c536c-5495-4a6a-ad07-1e4c1f5ff82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:12.680006 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c536c-5495-4a6a-ad07-1e4c1f5ff82b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:12.680280 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c536c-5495-4a6a-ad07-1e4c1f5ff82b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:12.680546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c536c-5495-4a6a-ad07-1e4c1f5ff82b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:12.681259 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c536c-5495-4a6a-ad07-1e4c1f5ff82b None admin] RBAC: Adding query filter params (role.id=67ed180941fd45af996b858232628221, scope.project.id=2472ae76a0e84195adaa076faba9d34d, user.id=13297d6b9cca4d68aa8a4a0b801b9ec9) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:12.681563 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c536c-5495-4a6a-ad07-1e4c1f5ff82b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:12.682956 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c536c-5495-4a6a-ad07-1e4c1f5ff82b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:12.688178 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 563/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:03:12 2022] GET /identity/v3/role_assignments?user.id=13297d6b9cca4d68aa8a4a0b801b9ec9&scope.project.id=2472ae76a0e84195adaa076faba9d34d&role.id=67ed180941fd45af996b858232628221 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:14.828791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220c7e8-439c-47b1-bf38-7c142f0fa929 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:14.829351 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220c7e8-439c-47b1-bf38-7c142f0fa929 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:14.829351 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220c7e8-439c-47b1-bf38-7c142f0fa929 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:14.830670 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 555/1118] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:03:14.835705 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af3b9a-7de9-447d-acf7-1be5f4ad341f None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:14.836095 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af3b9a-7de9-447d-acf7-1be5f4ad341f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:14.836253 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af3b9a-7de9-447d-acf7-1be5f4ad341f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:14.855010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-e3af3b9a-7de9-447d-acf7-1be5f4ad341f None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:03:14.856230 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e3af3b9a-7de9-447d-acf7-1be5f4ad341f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:03:14.896285 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:14.922721 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 564/1119] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:03:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:03:15.189349 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220c7e8-439c-47b1-bf38-7c142f0fa929 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:15.200792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:15.289087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220c7e8-439c-47b1-bf38-7c142f0fa929 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:15.322503 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31bbff-cadb-49e2-b2aa-c8c7f02faf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:15.323115 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31bbff-cadb-49e2-b2aa-c8c7f02faf70 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:15.323394 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31bbff-cadb-49e2-b2aa-c8c7f02faf70 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:15.323695 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31bbff-cadb-49e2-b2aa-c8c7f02faf70 None admin] PATH_INFO: `/v3/roles/67ed180941fd45af996b858232628221` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:15.325071 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31bbff-cadb-49e2-b2aa-c8c7f02faf70 None admin] RBAC: Authorizing `identity:get_role(role_id=67ed180941fd45af996b858232628221)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:15.326428 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31bbff-cadb-49e2-b2aa-c8c7f02faf70 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:15.327756 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 556/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:03:15 2022] GET /identity/v3/roles/67ed180941fd45af996b858232628221 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:15.333465 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af3b9a-7de9-447d-acf7-1be5f4ad341f None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:15.427842 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af3b9a-7de9-447d-acf7-1be5f4ad341f None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:15.463133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a97d6-e601-4f4d-8277-53ab7d9b1aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:15.463706 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a97d6-e601-4f4d-8277-53ab7d9b1aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:15.463981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a97d6-e601-4f4d-8277-53ab7d9b1aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:15.464249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a97d6-e601-4f4d-8277-53ab7d9b1aa9 None admin] PATH_INFO: `/v3/users/13297d6b9cca4d68aa8a4a0b801b9ec9` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:15.465343 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a97d6-e601-4f4d-8277-53ab7d9b1aa9 None admin] RBAC: Authorizing `identity:get_user(user_id=13297d6b9cca4d68aa8a4a0b801b9ec9)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:15.466753 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a97d6-e601-4f4d-8277-53ab7d9b1aa9 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:15.468344 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 565/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:03:15 2022] GET /identity/v3/users/13297d6b9cca4d68aa8a4a0b801b9ec9 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:15.474819 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31bbff-cadb-49e2-b2aa-c8c7f02faf70 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:15.550052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:15.572205 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31bbff-cadb-49e2-b2aa-c8c7f02faf70 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:15.604831 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9461f2-e2da-4613-8659-9896725144d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:15.605444 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9461f2-e2da-4613-8659-9896725144d9 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:15.605721 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9461f2-e2da-4613-8659-9896725144d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:15.605991 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9461f2-e2da-4613-8659-9896725144d9 None admin] PATH_INFO: `/v3/projects/2472ae76a0e84195adaa076faba9d34d` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:15.607080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9461f2-e2da-4613-8659-9896725144d9 None admin] RBAC: Authorizing `identity:get_project(project_id=2472ae76a0e84195adaa076faba9d34d)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:15.608532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9461f2-e2da-4613-8659-9896725144d9 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:15.610131 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 557/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:03:15 2022] GET /identity/v3/projects/2472ae76a0e84195adaa076faba9d34d => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:15.616870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a97d6-e601-4f4d-8277-53ab7d9b1aa9 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:15.661241 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:15.716447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a97d6-e601-4f4d-8277-53ab7d9b1aa9 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:15.750521 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d982b-9257-490b-ba1b-5740acc7f54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:15.751165 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d982b-9257-490b-ba1b-5740acc7f54a None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:15.751450 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d982b-9257-490b-ba1b-5740acc7f54a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:15.751728 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d982b-9257-490b-ba1b-5740acc7f54a None admin] PATH_INFO: `/v3/projects/2472ae76a0e84195adaa076faba9d34d/users/13297d6b9cca4d68aa8a4a0b801b9ec9/roles/67ed180941fd45af996b858232628221` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:15.753826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d982b-9257-490b-ba1b-5740acc7f54a None admin] RBAC: Authorizing `identity:create_grant(project_id=2472ae76a0e84195adaa076faba9d34d, user_id=13297d6b9cca4d68aa8a4a0b801b9ec9, role_id=67ed180941fd45af996b858232628221)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:15.755227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d982b-9257-490b-ba1b-5740acc7f54a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:15.767370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 566/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 28 12:03:15 2022] PUT /identity/v3/projects/2472ae76a0e84195adaa076faba9d34d/users/13297d6b9cca4d68aa8a4a0b801b9ec9/roles/67ed180941fd45af996b858232628221 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:03:17.875033 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0bbe4-883f-4dfe-9c33-a5ce31bc4ffe None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:17.875616 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0bbe4-883f-4dfe-9c33-a5ce31bc4ffe None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:17.875616 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0bbe4-883f-4dfe-9c33-a5ce31bc4ffe None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:17.876922 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 558/1124] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:03:17.882669 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b3417-74cf-4f4a-a209-12974bdb15d2 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:17.883049 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b3417-74cf-4f4a-a209-12974bdb15d2 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:17.883227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b3417-74cf-4f4a-a209-12974bdb15d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:17.901430 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-438b3417-74cf-4f4a-a209-12974bdb15d2 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:03:17.902607 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-438b3417-74cf-4f4a-a209-12974bdb15d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:03:17.967068 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 567/1125] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:03:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:03:18.231010 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0bbe4-883f-4dfe-9c33-a5ce31bc4ffe None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:18.328412 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0bbe4-883f-4dfe-9c33-a5ce31bc4ffe None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:18.361685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ef15a-330c-4dbf-8773-9cdf4e09958c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:18.362292 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ef15a-330c-4dbf-8773-9cdf4e09958c None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:18.362563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ef15a-330c-4dbf-8773-9cdf4e09958c None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:18.362828 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ef15a-330c-4dbf-8773-9cdf4e09958c None admin] PATH_INFO: `/v3/roles/67ed180941fd45af996b858232628221` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:18.364205 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ef15a-330c-4dbf-8773-9cdf4e09958c None admin] RBAC: Authorizing `identity:get_role(role_id=67ed180941fd45af996b858232628221)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:18.365560 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ef15a-330c-4dbf-8773-9cdf4e09958c None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:18.367126 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 559/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:03:18 2022] GET /identity/v3/roles/67ed180941fd45af996b858232628221 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:18.372815 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b3417-74cf-4f4a-a209-12974bdb15d2 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:18.403099 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:18.469087 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b3417-74cf-4f4a-a209-12974bdb15d2 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:18.509460 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c8e1b-ff79-4a01-ae3a-9f6b3119d6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:18.510019 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c8e1b-ff79-4a01-ae3a-9f6b3119d6ec None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:18.510298 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c8e1b-ff79-4a01-ae3a-9f6b3119d6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:18.510566 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c8e1b-ff79-4a01-ae3a-9f6b3119d6ec None admin] PATH_INFO: `/v3/users/13297d6b9cca4d68aa8a4a0b801b9ec9` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:18.511698 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c8e1b-ff79-4a01-ae3a-9f6b3119d6ec None admin] RBAC: Authorizing `identity:get_user(user_id=13297d6b9cca4d68aa8a4a0b801b9ec9)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:18.513146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c8e1b-ff79-4a01-ae3a-9f6b3119d6ec None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:18.514725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 568/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:03:18 2022] GET /identity/v3/users/13297d6b9cca4d68aa8a4a0b801b9ec9 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:18.521073 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ef15a-330c-4dbf-8773-9cdf4e09958c None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:18.535510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:18.617584 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ef15a-330c-4dbf-8773-9cdf4e09958c None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:18.650354 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e53ed-97a2-4af4-b3a2-c35a021054fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:18.650939 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e53ed-97a2-4af4-b3a2-c35a021054fb None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:18.651212 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e53ed-97a2-4af4-b3a2-c35a021054fb None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:18.651499 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e53ed-97a2-4af4-b3a2-c35a021054fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:18.716381 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e53ed-97a2-4af4-b3a2-c35a021054fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:18.717807 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e53ed-97a2-4af4-b3a2-c35a021054fb None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:18.731333 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:18.812879 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 560/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:03:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:03:18.819507 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c8e1b-ff79-4a01-ae3a-9f6b3119d6ec None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:18.912583 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:18.915503 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c8e1b-ff79-4a01-ae3a-9f6b3119d6ec None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:18.948822 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1a1cd-3643-406b-b2d3-fd5bcd54ed2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:18.949436 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1a1cd-3643-406b-b2d3-fd5bcd54ed2d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:18.949712 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1a1cd-3643-406b-b2d3-fd5bcd54ed2d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:18.949982 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1a1cd-3643-406b-b2d3-fd5bcd54ed2d None admin] PATH_INFO: `/v3/projects/2472ae76a0e84195adaa076faba9d34d` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:18.951075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1a1cd-3643-406b-b2d3-fd5bcd54ed2d None admin] RBAC: Authorizing `identity:get_project(project_id=2472ae76a0e84195adaa076faba9d34d)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:18.952518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1a1cd-3643-406b-b2d3-fd5bcd54ed2d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:18.954120 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 569/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:03:18 2022] GET /identity/v3/projects/2472ae76a0e84195adaa076faba9d34d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:18.960188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e53ed-97a2-4af4-b3a2-c35a021054fb None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:19.056567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e53ed-97a2-4af4-b3a2-c35a021054fb None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:19.069923 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:19.090928 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95926e8b-2ebf-48cc-9db6-300f527c46cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:19.091551 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95926e8b-2ebf-48cc-9db6-300f527c46cb None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:19.091841 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95926e8b-2ebf-48cc-9db6-300f527c46cb None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:19.092113 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95926e8b-2ebf-48cc-9db6-300f527c46cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:19.092834 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95926e8b-2ebf-48cc-9db6-300f527c46cb None admin] RBAC: Adding query filter params (role.id=67ed180941fd45af996b858232628221, scope.project.id=2472ae76a0e84195adaa076faba9d34d, user.id=13297d6b9cca4d68aa8a4a0b801b9ec9) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:19.093141 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95926e8b-2ebf-48cc-9db6-300f527c46cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:19.094672 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95926e8b-2ebf-48cc-9db6-300f527c46cb None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:19.100888 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 561/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:03:18 2022] GET /identity/v3/role_assignments?user.id=13297d6b9cca4d68aa8a4a0b801b9ec9&scope.project.id=2472ae76a0e84195adaa076faba9d34d&role.id=67ed180941fd45af996b858232628221 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:21.251264 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5416c10-d75d-44f4-8bae-c131fb8281c6 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:21.251839 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5416c10-d75d-44f4-8bae-c131fb8281c6 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:21.251839 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5416c10-d75d-44f4-8bae-c131fb8281c6 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:21.253718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 570/1131] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:03:21.258904 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7e472-ab5b-4cff-9a54-69e41ffae0b7 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:21.259316 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7e472-ab5b-4cff-9a54-69e41ffae0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:21.259482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7e472-ab5b-4cff-9a54-69e41ffae0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:21.277491 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-51f7e472-ab5b-4cff-9a54-69e41ffae0b7 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:03:21.278681 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-51f7e472-ab5b-4cff-9a54-69e41ffae0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:03:21.343999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 562/1132] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:03:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:03:21.636088 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5416c10-d75d-44f4-8bae-c131fb8281c6 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:21.743952 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5416c10-d75d-44f4-8bae-c131fb8281c6 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:21.778656 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981623a6-bb39-4517-80f8-0a393f76b531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:21.779276 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981623a6-bb39-4517-80f8-0a393f76b531 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:21.779579 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981623a6-bb39-4517-80f8-0a393f76b531 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:21.779905 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981623a6-bb39-4517-80f8-0a393f76b531 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:21.780943 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981623a6-bb39-4517-80f8-0a393f76b531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:21.782373 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981623a6-bb39-4517-80f8-0a393f76b531 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:21.784516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 571/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:03:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:21.790546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7e472-ab5b-4cff-9a54-69e41ffae0b7 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:21.887208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7e472-ab5b-4cff-9a54-69e41ffae0b7 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:21.895055 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:21.922305 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce99ba-a14f-4ace-a1ee-dda4363a08dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:21.922910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce99ba-a14f-4ace-a1ee-dda4363a08dc None admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:21.923191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce99ba-a14f-4ace-a1ee-dda4363a08dc None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:21.923488 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce99ba-a14f-4ace-a1ee-dda4363a08dc None admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:21.924171 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce99ba-a14f-4ace-a1ee-dda4363a08dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:21.925602 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce99ba-a14f-4ace-a1ee-dda4363a08dc None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:21.952197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 563/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 28 12:03:21 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:03:24.102827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9556c-84ca-4c19-a0c4-bcee062ec35c None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:24.103377 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9556c-84ca-4c19-a0c4-bcee062ec35c None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:24.103377 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9556c-84ca-4c19-a0c4-bcee062ec35c None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:24.104708 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 572/1135] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:03:24.110019 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffb9d8-c517-4e41-877d-9e9b914a7324 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:24.110396 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffb9d8-c517-4e41-877d-9e9b914a7324 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:24.110568 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffb9d8-c517-4e41-877d-9e9b914a7324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:24.130508 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-78ffb9d8-c517-4e41-877d-9e9b914a7324 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:03:24.131735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-78ffb9d8-c517-4e41-877d-9e9b914a7324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:03:24.196339 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 564/1136] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:03:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:03:24.464075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9556c-84ca-4c19-a0c4-bcee062ec35c None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:24.500143 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:24.563072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9556c-84ca-4c19-a0c4-bcee062ec35c None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:24.595069 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad659ee-6c7d-4ab3-a6af-effb225d961e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:24.596225 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad659ee-6c7d-4ab3-a6af-effb225d961e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:24.596503 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad659ee-6c7d-4ab3-a6af-effb225d961e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:24.596768 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad659ee-6c7d-4ab3-a6af-effb225d961e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:24.597864 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad659ee-6c7d-4ab3-a6af-effb225d961e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:24.599283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad659ee-6c7d-4ab3-a6af-effb225d961e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:24.600860 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 573/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:03:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:24.606522 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffb9d8-c517-4e41-877d-9e9b914a7324 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:24.691082 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:24.703613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffb9d8-c517-4e41-877d-9e9b914a7324 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:24.737250 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3160e-e777-40a4-a40f-b66f702ad425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:24.737783 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3160e-e777-40a4-a40f-b66f702ad425 None admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:24.738060 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3160e-e777-40a4-a40f-b66f702ad425 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:24.738329 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3160e-e777-40a4-a40f-b66f702ad425 None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:24.738978 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3160e-e777-40a4-a40f-b66f702ad425 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:24.740427 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3160e-e777-40a4-a40f-b66f702ad425 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:24.760842 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 565/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 28 12:03:24 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:03:26.917562 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c2276-b541-4332-b3a1-a86245452ea7 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:26.918110 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c2276-b541-4332-b3a1-a86245452ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:26.918110 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c2276-b541-4332-b3a1-a86245452ea7 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:26.919454 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 574/1139] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:03:26.925280 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb303d-c88d-41ff-befc-8350ca08cc35 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:26.925677 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb303d-c88d-41ff-befc-8350ca08cc35 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:26.925830 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb303d-c88d-41ff-befc-8350ca08cc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:26.943616 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-30fb303d-c88d-41ff-befc-8350ca08cc35 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:03:26.944800 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-30fb303d-c88d-41ff-befc-8350ca08cc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:03:27.011878 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 566/1140] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:03:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:03:27.279932 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c2276-b541-4332-b3a1-a86245452ea7 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:27.379988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c2276-b541-4332-b3a1-a86245452ea7 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:27.382226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:27.413746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091968f8-6080-4ba8-9e48-8e5763d7a507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:27.414360 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091968f8-6080-4ba8-9e48-8e5763d7a507 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:27.414637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091968f8-6080-4ba8-9e48-8e5763d7a507 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:27.414905 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091968f8-6080-4ba8-9e48-8e5763d7a507 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:27.424648 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091968f8-6080-4ba8-9e48-8e5763d7a507 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:03:27.429388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-091968f8-6080-4ba8-9e48-8e5763d7a507 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:03:27.429388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:03:27.429388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:03:27.429388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:03:27.429388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:03:27.429388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:03:27.429388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:03:27.429388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:03:27.429388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:03:27.429388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:03:27.429388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:03:27.429388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:03:27.429388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:03:27.429388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:03:27.429388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:03:27.429388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:03:27.430555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:03:27.430555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:03:27.430555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:03:27.430555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:03:27.430555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:03:27.430555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:03:27.430555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:03:27.430555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:03:27.430555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:03:27.430555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:03:27.430555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:03:27.430555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:03:27.430555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:03:27.430555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:03:27.430555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:03:27.430555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:03:27.431669 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:03:27.431669 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:03:27.431669 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:03:27.431669 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:03:27.431669 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:03:27.431669 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:03:27.431669 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:03:27.431669 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:03:27.431669 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:03:27.431669 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:03:27.431669 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:03:27.431669 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:03:27.431669 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 575/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:03:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:03:27.436394 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb303d-c88d-41ff-befc-8350ca08cc35 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:27.508181 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:27.533147 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb303d-c88d-41ff-befc-8350ca08cc35 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:27.566995 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a53e4-6c40-4ff4-afbc-df37c7075091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:27.567628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a53e4-6c40-4ff4-afbc-df37c7075091 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:27.567909 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a53e4-6c40-4ff4-afbc-df37c7075091 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:27.568180 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a53e4-6c40-4ff4-afbc-df37c7075091 None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:27.569298 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a53e4-6c40-4ff4-afbc-df37c7075091 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:27.569853 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a53e4-6c40-4ff4-afbc-df37c7075091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:27.571947 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a53e4-6c40-4ff4-afbc-df37c7075091 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:27.582173 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 567/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:03:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:27.588121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091968f8-6080-4ba8-9e48-8e5763d7a507 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:27.684520 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091968f8-6080-4ba8-9e48-8e5763d7a507 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:27.722398 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52789008-44f4-4be2-8dcb-7302b8d42a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:27.723024 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52789008-44f4-4be2-8dcb-7302b8d42a8d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:27.723301 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52789008-44f4-4be2-8dcb-7302b8d42a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:27.723620 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52789008-44f4-4be2-8dcb-7302b8d42a8d None admin] PATH_INFO: `/v3/users/ec900708c0a849a39f0c27aba527b4cc` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:27.737074 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52789008-44f4-4be2-8dcb-7302b8d42a8d None admin] RBAC: Authorizing `identity:get_user(user_id=ec900708c0a849a39f0c27aba527b4cc)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:27.738483 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52789008-44f4-4be2-8dcb-7302b8d42a8d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:27.740124 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 576/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:03:27 2022] GET /identity/v3/users/ec900708c0a849a39f0c27aba527b4cc => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:27.746055 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a53e4-6c40-4ff4-afbc-df37c7075091 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:27.842047 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a53e4-6c40-4ff4-afbc-df37c7075091 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:27.874383 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956ddbf-66b5-42e1-97e9-c31f644cf382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:27.874971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956ddbf-66b5-42e1-97e9-c31f644cf382 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:27.875251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956ddbf-66b5-42e1-97e9-c31f644cf382 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:27.875544 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956ddbf-66b5-42e1-97e9-c31f644cf382 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:27.879746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:27.945159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956ddbf-66b5-42e1-97e9-c31f644cf382 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:27.946597 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956ddbf-66b5-42e1-97e9-c31f644cf382 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:28.041267 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 568/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:03:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:03:28.047186 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52789008-44f4-4be2-8dcb-7302b8d42a8d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:28.071843 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:28.145414 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52789008-44f4-4be2-8dcb-7302b8d42a8d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:28.178370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075817d6-3433-4236-a8af-8c30d6e761c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:28.178985 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075817d6-3433-4236-a8af-8c30d6e761c4 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:28.179263 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075817d6-3433-4236-a8af-8c30d6e761c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:28.179559 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075817d6-3433-4236-a8af-8c30d6e761c4 None admin] PATH_INFO: `/v3/projects/1ef4d66004264e87b99d6ad2ed0b86f7` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:28.180690 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075817d6-3433-4236-a8af-8c30d6e761c4 None admin] RBAC: Authorizing `identity:get_project(project_id=1ef4d66004264e87b99d6ad2ed0b86f7)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:28.182107 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075817d6-3433-4236-a8af-8c30d6e761c4 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:28.183749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 577/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:03:28 2022] GET /identity/v3/projects/1ef4d66004264e87b99d6ad2ed0b86f7 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:28.189780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956ddbf-66b5-42e1-97e9-c31f644cf382 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:28.223619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:28.288465 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956ddbf-66b5-42e1-97e9-c31f644cf382 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:28.321155 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9997ea9-ae2a-4eaf-b857-cf50afac5960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:28.321746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9997ea9-ae2a-4eaf-b857-cf50afac5960 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:28.322022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9997ea9-ae2a-4eaf-b857-cf50afac5960 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:28.322290 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9997ea9-ae2a-4eaf-b857-cf50afac5960 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:28.323005 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9997ea9-ae2a-4eaf-b857-cf50afac5960 None admin] RBAC: Adding query filter params (role.id=66456d39fc0c496c8f290a436b726216, scope.project.id=1ef4d66004264e87b99d6ad2ed0b86f7, user.id=ec900708c0a849a39f0c27aba527b4cc) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:28.323308 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9997ea9-ae2a-4eaf-b857-cf50afac5960 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:28.324765 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9997ea9-ae2a-4eaf-b857-cf50afac5960 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:28.329954 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 569/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:03:28 2022] GET /identity/v3/role_assignments?user.id=ec900708c0a849a39f0c27aba527b4cc&scope.project.id=1ef4d66004264e87b99d6ad2ed0b86f7&role.id=66456d39fc0c496c8f290a436b726216 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:30.427070 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdc082-c3a3-462f-8bd5-0a6886ffd867 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:30.427627 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdc082-c3a3-462f-8bd5-0a6886ffd867 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:30.427627 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdc082-c3a3-462f-8bd5-0a6886ffd867 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:30.428954 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 578/1147] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:03:30.434067 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df939f22-89d7-4987-9bc8-1a24dd342003 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:30.434487 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df939f22-89d7-4987-9bc8-1a24dd342003 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:30.434610 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df939f22-89d7-4987-9bc8-1a24dd342003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:30.452708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-df939f22-89d7-4987-9bc8-1a24dd342003 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:03:30.453876 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-df939f22-89d7-4987-9bc8-1a24dd342003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:03:30.518121 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 570/1148] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:03:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:03:30.784184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fdc082-c3a3-462f-8bd5-0a6886ffd867 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:30.873997 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:30.885128 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fdc082-c3a3-462f-8bd5-0a6886ffd867 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:30.917233 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4a0ed-fef9-46b5-b415-21a7be802dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:30.917848 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4a0ed-fef9-46b5-b415-21a7be802dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:30.918126 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4a0ed-fef9-46b5-b415-21a7be802dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:30.918397 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4a0ed-fef9-46b5-b415-21a7be802dd5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:30.929023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4a0ed-fef9-46b5-b415-21a7be802dd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:03:30.933737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-f9a4a0ed-fef9-46b5-b415-21a7be802dd5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:03:30.933737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:03:30.933737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:03:30.933737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:03:30.933737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:03:30.933737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:03:30.933737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:03:30.933737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:03:30.933737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:03:30.933737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:03:30.933737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:03:30.933737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:03:30.933737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:03:30.933737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:03:30.933737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:03:30.933737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:03:30.934842 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:03:30.934842 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:03:30.934842 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:03:30.934842 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:03:30.934842 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:03:30.934842 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:03:30.934842 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:03:30.934842 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:03:30.934842 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:03:30.934842 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:03:30.934842 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:03:30.934842 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:03:30.934842 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:03:30.934842 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:03:30.934842 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:03:30.934842 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:03:30.935888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:03:30.935888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:03:30.935888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:03:30.935888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:03:30.935888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:03:30.935888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:03:30.935888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:03:30.935888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:03:30.935888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:03:30.935888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:03:30.935888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:03:30.935888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:03:30.935888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 579/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:03:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:03:30.941463 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df939f22-89d7-4987-9bc8-1a24dd342003 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:30.969852 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:31.037004 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df939f22-89d7-4987-9bc8-1a24dd342003 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:31.070127 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e2883-6154-4a22-bd57-3afa11cb36ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:31.070715 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e2883-6154-4a22-bd57-3afa11cb36ed None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:31.070993 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e2883-6154-4a22-bd57-3afa11cb36ed None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:31.071262 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e2883-6154-4a22-bd57-3afa11cb36ed None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:31.071944 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e2883-6154-4a22-bd57-3afa11cb36ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:31.072247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e2883-6154-4a22-bd57-3afa11cb36ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:31.073604 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e2883-6154-4a22-bd57-3afa11cb36ed None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:31.081366 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 571/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:03:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:31.087038 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4a0ed-fef9-46b5-b415-21a7be802dd5 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:31.185736 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4a0ed-fef9-46b5-b415-21a7be802dd5 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:31.217621 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4adc2-efab-4958-84b4-18960ccc7c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:31.218231 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4adc2-efab-4958-84b4-18960ccc7c70 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:31.218503 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4adc2-efab-4958-84b4-18960ccc7c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:31.218773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4adc2-efab-4958-84b4-18960ccc7c70 None admin] PATH_INFO: `/v3/users/ec900708c0a849a39f0c27aba527b4cc` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:31.219942 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4adc2-efab-4958-84b4-18960ccc7c70 None admin] RBAC: Authorizing `identity:get_user(user_id=ec900708c0a849a39f0c27aba527b4cc)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:31.221821 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4adc2-efab-4958-84b4-18960ccc7c70 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:31.223374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 580/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:03:31 2022] GET /identity/v3/users/ec900708c0a849a39f0c27aba527b4cc => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:31.229180 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e2883-6154-4a22-bd57-3afa11cb36ed None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:31.317748 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:31.326729 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e2883-6154-4a22-bd57-3afa11cb36ed None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:31.359190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9928cbd-aef9-41b5-af00-30f2af601621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:31.359905 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9928cbd-aef9-41b5-af00-30f2af601621 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:31.360189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9928cbd-aef9-41b5-af00-30f2af601621 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:31.360460 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9928cbd-aef9-41b5-af00-30f2af601621 None admin] PATH_INFO: `/v3/projects/1ef4d66004264e87b99d6ad2ed0b86f7` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:31.362113 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9928cbd-aef9-41b5-af00-30f2af601621 None admin] RBAC: Authorizing `identity:get_project(project_id=1ef4d66004264e87b99d6ad2ed0b86f7)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:31.363572 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9928cbd-aef9-41b5-af00-30f2af601621 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:31.365171 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 572/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:03:31 2022] GET /identity/v3/projects/1ef4d66004264e87b99d6ad2ed0b86f7 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:31.371202 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4adc2-efab-4958-84b4-18960ccc7c70 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:31.389606 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:31.468103 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4adc2-efab-4958-84b4-18960ccc7c70 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:31.501906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c26666-2ef0-43dd-8902-96cdde0ec226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:31.502502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c26666-2ef0-43dd-8902-96cdde0ec226 None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:31.502783 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c26666-2ef0-43dd-8902-96cdde0ec226 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:31.503057 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c26666-2ef0-43dd-8902-96cdde0ec226 None admin] PATH_INFO: `/v3/projects/1ef4d66004264e87b99d6ad2ed0b86f7/users/ec900708c0a849a39f0c27aba527b4cc/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:31.504966 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c26666-2ef0-43dd-8902-96cdde0ec226 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ef4d66004264e87b99d6ad2ed0b86f7, user_id=ec900708c0a849a39f0c27aba527b4cc, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:31.506391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c26666-2ef0-43dd-8902-96cdde0ec226 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:31.519311 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 581/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 28 12:03:31 2022] PUT /identity/v3/projects/1ef4d66004264e87b99d6ad2ed0b86f7/users/ec900708c0a849a39f0c27aba527b4cc/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:03:33.631206 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c965159-720a-4cc2-83c5-dbb7e5dbde66 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:33.631869 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c965159-720a-4cc2-83c5-dbb7e5dbde66 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:33.631869 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c965159-720a-4cc2-83c5-dbb7e5dbde66 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:33.633098 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 573/1154] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:03:33.638215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a07681-65b5-47a1-a52d-d4333e08b2cb None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:33.638644 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a07681-65b5-47a1-a52d-d4333e08b2cb None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:33.638754 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a07681-65b5-47a1-a52d-d4333e08b2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:33.657089 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-65a07681-65b5-47a1-a52d-d4333e08b2cb None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:03:33.658263 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-65a07681-65b5-47a1-a52d-d4333e08b2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:03:33.725193 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 582/1155] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:03:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:03:33.997689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c965159-720a-4cc2-83c5-dbb7e5dbde66 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:34.095014 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c965159-720a-4cc2-83c5-dbb7e5dbde66 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:34.127828 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2abfab6-6c34-4d9b-bb6e-421ae522bb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:34.128431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abfab6-6c34-4d9b-bb6e-421ae522bb0b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:34.128706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abfab6-6c34-4d9b-bb6e-421ae522bb0b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:34.128972 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abfab6-6c34-4d9b-bb6e-421ae522bb0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:34.139022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2abfab6-6c34-4d9b-bb6e-421ae522bb0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:03:34.143776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-d2abfab6-6c34-4d9b-bb6e-421ae522bb0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:03:34.143776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:03:34.143776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:03:34.143776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:03:34.143776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:03:34.143776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:03:34.143776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:03:34.143776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:03:34.143776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:03:34.143776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:03:34.143776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:03:34.143776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:03:34.143776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:03:34.143776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:03:34.143776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:03:34.143776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:03:34.144951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:03:34.144951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:03:34.144951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:03:34.144951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:03:34.144951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:03:34.144951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:03:34.144951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:03:34.144951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:03:34.144951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:03:34.144951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:03:34.144951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:03:34.144951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:03:34.144951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:03:34.144951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:03:34.144951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:03:34.144951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:03:34.145875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:03:34.145875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:03:34.145875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:03:34.145875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:03:34.145875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:03:34.145875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:03:34.145875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:03:34.145875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:03:34.145875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:03:34.145875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:03:34.145875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:03:34.145875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:03:34.145875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 574/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:03:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:03:34.150651 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a07681-65b5-47a1-a52d-d4333e08b2cb None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:34.161068 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:34.248898 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a07681-65b5-47a1-a52d-d4333e08b2cb None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:34.287949 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30b34b-d4cb-4a70-86c7-8343d480a001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:34.288551 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30b34b-d4cb-4a70-86c7-8343d480a001 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:34.288831 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30b34b-d4cb-4a70-86c7-8343d480a001 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:34.289099 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30b34b-d4cb-4a70-86c7-8343d480a001 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:34.289753 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30b34b-d4cb-4a70-86c7-8343d480a001 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:34.290053 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30b34b-d4cb-4a70-86c7-8343d480a001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:34.291412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30b34b-d4cb-4a70-86c7-8343d480a001 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:34.299860 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 583/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:03:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:34.305761 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2abfab6-6c34-4d9b-bb6e-421ae522bb0b None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:34.328079 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:34.404884 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2abfab6-6c34-4d9b-bb6e-421ae522bb0b None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:34.436538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbf10b-986f-4111-8542-c90d94d20583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:34.437148 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbf10b-986f-4111-8542-c90d94d20583 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:34.437422 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbf10b-986f-4111-8542-c90d94d20583 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:34.437689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbf10b-986f-4111-8542-c90d94d20583 None admin] PATH_INFO: `/v3/users/ec900708c0a849a39f0c27aba527b4cc` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:34.438780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacbf10b-986f-4111-8542-c90d94d20583 None admin] RBAC: Authorizing `identity:get_user(user_id=ec900708c0a849a39f0c27aba527b4cc)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:34.440755 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacbf10b-986f-4111-8542-c90d94d20583 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:34.442294 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 575/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:03:34 2022] GET /identity/v3/users/ec900708c0a849a39f0c27aba527b4cc => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:34.448184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30b34b-d4cb-4a70-86c7-8343d480a001 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:34.515513 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:34.545800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30b34b-d4cb-4a70-86c7-8343d480a001 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:34.578829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e085e-0059-4aff-8f3b-a1674212bcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:34.579417 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e085e-0059-4aff-8f3b-a1674212bcd9 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:34.579727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e085e-0059-4aff-8f3b-a1674212bcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:34.580024 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e085e-0059-4aff-8f3b-a1674212bcd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:34.644370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e085e-0059-4aff-8f3b-a1674212bcd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:34.645783 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e085e-0059-4aff-8f3b-a1674212bcd9 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:34.709990 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:34.741441 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 584/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:03:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:03:34.747567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbf10b-986f-4111-8542-c90d94d20583 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:34.832965 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:34.844741 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbf10b-986f-4111-8542-c90d94d20583 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:34.877830 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359d07b-bdec-4ae8-b47f-7e5bab71830a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:34.878438 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359d07b-bdec-4ae8-b47f-7e5bab71830a None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:34.878715 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359d07b-bdec-4ae8-b47f-7e5bab71830a None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:34.878984 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359d07b-bdec-4ae8-b47f-7e5bab71830a None admin] PATH_INFO: `/v3/projects/1ef4d66004264e87b99d6ad2ed0b86f7` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:34.880096 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359d07b-bdec-4ae8-b47f-7e5bab71830a None admin] RBAC: Authorizing `identity:get_project(project_id=1ef4d66004264e87b99d6ad2ed0b86f7)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:34.881527 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359d07b-bdec-4ae8-b47f-7e5bab71830a None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:34.883112 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 576/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:03:34 2022] GET /identity/v3/projects/1ef4d66004264e87b99d6ad2ed0b86f7 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:34.889198 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e085e-0059-4aff-8f3b-a1674212bcd9 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:34.984453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e085e-0059-4aff-8f3b-a1674212bcd9 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:35.018107 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d2d21-6511-4380-a7a2-7ce40d00c128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:35.018697 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d2d21-6511-4380-a7a2-7ce40d00c128 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:35.018969 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d2d21-6511-4380-a7a2-7ce40d00c128 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:35.019234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d2d21-6511-4380-a7a2-7ce40d00c128 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:35.019982 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d2d21-6511-4380-a7a2-7ce40d00c128 None admin] RBAC: Adding query filter params (role.id=66456d39fc0c496c8f290a436b726216, scope.project.id=1ef4d66004264e87b99d6ad2ed0b86f7, user.id=ec900708c0a849a39f0c27aba527b4cc) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:35.020288 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d2d21-6511-4380-a7a2-7ce40d00c128 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:35.021692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d2d21-6511-4380-a7a2-7ce40d00c128 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:35.027210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 585/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:03:34 2022] GET /identity/v3/role_assignments?user.id=ec900708c0a849a39f0c27aba527b4cc&scope.project.id=1ef4d66004264e87b99d6ad2ed0b86f7&role.id=66456d39fc0c496c8f290a436b726216 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:37.155800 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e71f3-6549-4561-a787-9a7e554dcecc None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:37.156309 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e71f3-6549-4561-a787-9a7e554dcecc None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:37.156449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e71f3-6549-4561-a787-9a7e554dcecc None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:37.157662 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 577/1162] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:03:37.163401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa744a5-a910-47f3-ac34-fda7b852efab None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:37.163828 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa744a5-a910-47f3-ac34-fda7b852efab None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:37.163969 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa744a5-a910-47f3-ac34-fda7b852efab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:37.182875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-9aa744a5-a910-47f3-ac34-fda7b852efab None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:03:37.184075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9aa744a5-a910-47f3-ac34-fda7b852efab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:03:37.210197 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:37.248825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 586/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:03:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:03:37.516322 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e71f3-6549-4561-a787-9a7e554dcecc None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:37.615149 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e71f3-6549-4561-a787-9a7e554dcecc None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:37.647821 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bbb64-8c67-4506-a5b8-2147a5255d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:37.648410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bbb64-8c67-4506-a5b8-2147a5255d23 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:37.648688 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bbb64-8c67-4506-a5b8-2147a5255d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:37.648961 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bbb64-8c67-4506-a5b8-2147a5255d23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:37.672573 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:37.714644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8bbb64-8c67-4506-a5b8-2147a5255d23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:37.716115 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8bbb64-8c67-4506-a5b8-2147a5255d23 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:37.815050 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 578/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:03:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:03:37.820638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa744a5-a910-47f3-ac34-fda7b852efab None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:37.915796 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa744a5-a910-47f3-ac34-fda7b852efab None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:37.948484 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ebb7d-11f7-45f0-bcc9-154540896ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:37.949106 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ebb7d-11f7-45f0-bcc9-154540896ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:37.949386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ebb7d-11f7-45f0-bcc9-154540896ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:37.949662 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ebb7d-11f7-45f0-bcc9-154540896ed7 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:37.956719 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ebb7d-11f7-45f0-bcc9-154540896ed7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:37.958143 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ebb7d-11f7-45f0-bcc9-154540896ed7 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:37.969262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-927ebb7d-11f7-45f0-bcc9-154540896ed7 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 28 12:03:37.969262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:03:37.969262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 28 12:03:37.969262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 28 12:03:37.969262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:03:37.969262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:03:37.969262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:03:37.969262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:03:37.969262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 28 12:03:37.969262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:03:37.969262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:03:37.969262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:03:37.969262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:03:37.969262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:03:37.969262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:03:37.969262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:03:37.969262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:03:37.970323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:03:37.970323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:03:37.970323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:03:37.970323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:03:37.970323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:03:37.970323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:03:37.970323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:03:37.970323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:03:37.970323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:03:37.970323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:03:37.970323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:03:37.970323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:03:37.970323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:03:37.970323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:03:37.970323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:03:37.970323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:03:37.971624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:03:37.971624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:03:37.971624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:03:37.971624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:03:37.971624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:03:37.971624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:03:37.971624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:03:37.971624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:03:37.971624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:03:37.971624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:03:37.971624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 28 12:03:37.971624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:03:37.971624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 28 12:03:37.971624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:03:37.971624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 587/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 28 12:03:37 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:03:37.976309 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bbb64-8c67-4506-a5b8-2147a5255d23 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:38.031415 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:38.074188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bbb64-8c67-4506-a5b8-2147a5255d23 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:38.107115 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207cb98-fef7-4824-a398-c77bc5fa34bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:38.107756 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207cb98-fef7-4824-a398-c77bc5fa34bb None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:38.108036 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207cb98-fef7-4824-a398-c77bc5fa34bb None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:38.108309 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207cb98-fef7-4824-a398-c77bc5fa34bb None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:38.108943 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207cb98-fef7-4824-a398-c77bc5fa34bb None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:38.109248 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207cb98-fef7-4824-a398-c77bc5fa34bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:38.110607 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207cb98-fef7-4824-a398-c77bc5fa34bb None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:38.117908 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 579/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Sep 28 12:03:37 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:40.234681 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332a6d7-653f-4685-99bf-c51bf4144265 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:40.235323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332a6d7-653f-4685-99bf-c51bf4144265 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:40.235323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332a6d7-653f-4685-99bf-c51bf4144265 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:40.236688 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 588/1167] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:03:40.241904 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5000a4-b55e-467d-be7e-c68d02b5812c None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:40.242603 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5000a4-b55e-467d-be7e-c68d02b5812c None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:40.242718 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5000a4-b55e-467d-be7e-c68d02b5812c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:40.261043 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-6b5000a4-b55e-467d-be7e-c68d02b5812c None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:03:40.262219 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-6b5000a4-b55e-467d-be7e-c68d02b5812c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:03:40.326874 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 580/1168] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:03:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:03:40.594668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332a6d7-653f-4685-99bf-c51bf4144265 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:40.620048 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:40.695101 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332a6d7-653f-4685-99bf-c51bf4144265 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:40.727634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c45ee-facc-4bdd-bc58-7f770d7b0633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:40.728239 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c45ee-facc-4bdd-bc58-7f770d7b0633 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:40.728518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c45ee-facc-4bdd-bc58-7f770d7b0633 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:40.728791 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c45ee-facc-4bdd-bc58-7f770d7b0633 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:40.729458 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c45ee-facc-4bdd-bc58-7f770d7b0633 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:40.730807 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c45ee-facc-4bdd-bc58-7f770d7b0633 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:40.746899 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 589/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Wed Sep 28 12:03:40 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:03:42.872268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8de8e9-0141-422a-b20f-68672db89b65 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:42.872812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8de8e9-0141-422a-b20f-68672db89b65 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:42.872812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8de8e9-0141-422a-b20f-68672db89b65 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:42.874158 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 581/1170] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:03:42.880080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67186d3e-c16d-4683-8e8e-d59cba4cc119 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:42.880493 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67186d3e-c16d-4683-8e8e-d59cba4cc119 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:42.880649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67186d3e-c16d-4683-8e8e-d59cba4cc119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:42.898326 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-67186d3e-c16d-4683-8e8e-d59cba4cc119 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:03:42.899542 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-67186d3e-c16d-4683-8e8e-d59cba4cc119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:03:42.968083 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 590/1171] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:03:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:03:43.232901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8de8e9-0141-422a-b20f-68672db89b65 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:43.284222 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:43.334354 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8de8e9-0141-422a-b20f-68672db89b65 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:43.368243 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b305fa8-57a6-4e7b-a61c-a16ac3107c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:43.368857 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b305fa8-57a6-4e7b-a61c-a16ac3107c65 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:43.369135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b305fa8-57a6-4e7b-a61c-a16ac3107c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:43.369400 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b305fa8-57a6-4e7b-a61c-a16ac3107c65 None admin] PATH_INFO: `/v3/domains/e1db7fb45c4946cfa3bdd9085509f44b` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:43.379574 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b305fa8-57a6-4e7b-a61c-a16ac3107c65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e1db7fb45c4946cfa3bdd9085509f44b)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:43.381047 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b305fa8-57a6-4e7b-a61c-a16ac3107c65 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:43.382632 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 582/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Wed Sep 28 12:03:43 2022] GET /identity/v3/domains/e1db7fb45c4946cfa3bdd9085509f44b => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:43.388598 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67186d3e-c16d-4683-8e8e-d59cba4cc119 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:43.403236 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:43.486651 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67186d3e-c16d-4683-8e8e-d59cba4cc119 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:43.519888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c2a79-32e2-46a6-abce-fbd32af75075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:43.520489 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c2a79-32e2-46a6-abce-fbd32af75075 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:43.520766 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c2a79-32e2-46a6-abce-fbd32af75075 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:43.521034 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c2a79-32e2-46a6-abce-fbd32af75075 None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:43.521683 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c2a79-32e2-46a6-abce-fbd32af75075 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:43.523088 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c2a79-32e2-46a6-abce-fbd32af75075 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:43.547844 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 591/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 28 12:03:43 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:03:45.732924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb2e62-bda0-4015-b586-8ee5b635adde None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:45.733441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb2e62-bda0-4015-b586-8ee5b635adde None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:45.733441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb2e62-bda0-4015-b586-8ee5b635adde None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:45.734799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 583/1174] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:03:45.741785 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3fea9-5e6c-4436-9dcf-c4d28a844d4b None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:45.742456 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3fea9-5e6c-4436-9dcf-c4d28a844d4b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:45.742791 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3fea9-5e6c-4436-9dcf-c4d28a844d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:45.762548 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-dbe3fea9-5e6c-4436-9dcf-c4d28a844d4b None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:03:45.763759 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-dbe3fea9-5e6c-4436-9dcf-c4d28a844d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:03:45.823424 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:45.832513 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 592/1175] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:03:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:03:46.108566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb2e62-bda0-4015-b586-8ee5b635adde None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:46.207171 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb2e62-bda0-4015-b586-8ee5b635adde None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:46.217000 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:46.240955 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9cdd2-822c-420f-9063-9545682bc029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:46.241565 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9cdd2-822c-420f-9063-9545682bc029 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:46.241840 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9cdd2-822c-420f-9063-9545682bc029 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:46.242107 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9cdd2-822c-420f-9063-9545682bc029 None admin] PATH_INFO: `/v3/domains/e1db7fb45c4946cfa3bdd9085509f44b` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:46.243463 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9cdd2-822c-420f-9063-9545682bc029 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e1db7fb45c4946cfa3bdd9085509f44b)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:46.244887 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9cdd2-822c-420f-9063-9545682bc029 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:46.246407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 584/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Wed Sep 28 12:03:46 2022] GET /identity/v3/domains/e1db7fb45c4946cfa3bdd9085509f44b => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:03:46.252246 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3fea9-5e6c-4436-9dcf-c4d28a844d4b None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:46.352870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3fea9-5e6c-4436-9dcf-c4d28a844d4b None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:46.386685 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22ab63-b2df-4d05-9c38-380ca561f9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:46.387223 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22ab63-b2df-4d05-9c38-380ca561f9d4 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:46.387536 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22ab63-b2df-4d05-9c38-380ca561f9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:46.387809 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22ab63-b2df-4d05-9c38-380ca561f9d4 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:46.388448 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22ab63-b2df-4d05-9c38-380ca561f9d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:46.389888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22ab63-b2df-4d05-9c38-380ca561f9d4 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:46.409770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 593/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 28 12:03:46 2022] POST /identity/v3/users => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:03:48.574551 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf71b5-72c2-460e-b087-70f9ac902bf8 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:48.575076 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf71b5-72c2-460e-b087-70f9ac902bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:48.575076 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf71b5-72c2-460e-b087-70f9ac902bf8 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:48.576467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 585/1178] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:03:48.582479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb620f16-c1bf-4b11-8ec9-0a8bff11830a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:48.582852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb620f16-c1bf-4b11-8ec9-0a8bff11830a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:48.583022 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb620f16-c1bf-4b11-8ec9-0a8bff11830a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:48.600623 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-bb620f16-c1bf-4b11-8ec9-0a8bff11830a None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:03:48.601782 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-bb620f16-c1bf-4b11-8ec9-0a8bff11830a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:03:48.647169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:48.666784 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 594/1179] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:03:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:03:48.932680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf71b5-72c2-460e-b087-70f9ac902bf8 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:49.031635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf71b5-72c2-460e-b087-70f9ac902bf8 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:49.063904 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3eb92-c629-4e3d-a554-b55194ba2cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:49.064542 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3eb92-c629-4e3d-a554-b55194ba2cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:49.064821 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3eb92-c629-4e3d-a554-b55194ba2cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:49.065091 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3eb92-c629-4e3d-a554-b55194ba2cd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:49.075231 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3eb92-c629-4e3d-a554-b55194ba2cd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:03:49.080546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-13e3eb92-c629-4e3d-a554-b55194ba2cd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:03:49.080546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:03:49.080546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:03:49.080546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:03:49.080546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:03:49.080546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:03:49.080546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:03:49.080546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:03:49.080546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:03:49.080546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:03:49.080546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:03:49.080546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:03:49.080546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:03:49.080546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:03:49.080546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:03:49.080546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:03:49.081644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:03:49.081644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:03:49.081644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:03:49.081644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:03:49.081644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:03:49.081644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:03:49.081644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:03:49.081644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:03:49.081644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:03:49.081644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:03:49.081644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:03:49.081644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:03:49.081644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:03:49.081644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:03:49.081644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:03:49.081644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:03:49.082538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:03:49.082538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:03:49.082538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:03:49.082538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:03:49.082538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:03:49.082538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:03:49.082538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:03:49.082538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:03:49.082538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:03:49.082538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:03:49.082538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:03:49.082538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:03:49.082538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 586/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:03:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:03:49.087518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb620f16-c1bf-4b11-8ec9-0a8bff11830a None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:49.182405 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb620f16-c1bf-4b11-8ec9-0a8bff11830a None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:49.214994 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718d787-bc61-40d3-9cfd-4217197f1d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:49.215561 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718d787-bc61-40d3-9cfd-4217197f1d23 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:49.215842 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718d787-bc61-40d3-9cfd-4217197f1d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:49.216113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718d787-bc61-40d3-9cfd-4217197f1d23 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:49.216767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718d787-bc61-40d3-9cfd-4217197f1d23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:49.217067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718d787-bc61-40d3-9cfd-4217197f1d23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:49.218415 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718d787-bc61-40d3-9cfd-4217197f1d23 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:49.226648 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 595/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:03:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:03:49.232511 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3eb92-c629-4e3d-a554-b55194ba2cd9 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:49.271327 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:49.329541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3eb92-c629-4e3d-a554-b55194ba2cd9 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:49.365602 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957515a-61dd-497b-b694-1286ea0b29ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:49.366223 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957515a-61dd-497b-b694-1286ea0b29ff None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:49.366497 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957515a-61dd-497b-b694-1286ea0b29ff None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:49.366765 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957515a-61dd-497b-b694-1286ea0b29ff None admin] PATH_INFO: `/v3/users/27cd2270717f4167a7d93206a5dfda4c` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:49.380092 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957515a-61dd-497b-b694-1286ea0b29ff None admin] RBAC: Authorizing `identity:get_user(user_id=27cd2270717f4167a7d93206a5dfda4c)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:49.381521 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957515a-61dd-497b-b694-1286ea0b29ff None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:49.383098 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 587/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:03:49 2022] GET /identity/v3/users/27cd2270717f4167a7d93206a5dfda4c => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:49.388892 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718d787-bc61-40d3-9cfd-4217197f1d23 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:49.433081 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:49.485672 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718d787-bc61-40d3-9cfd-4217197f1d23 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:49.518001 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb2437-cadf-4ed2-b6bc-df66c621623d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:49.518588 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb2437-cadf-4ed2-b6bc-df66c621623d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:49.518861 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb2437-cadf-4ed2-b6bc-df66c621623d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:49.519125 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb2437-cadf-4ed2-b6bc-df66c621623d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:49.583279 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb2437-cadf-4ed2-b6bc-df66c621623d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:49.584729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb2437-cadf-4ed2-b6bc-df66c621623d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:49.627582 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:49.680480 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 596/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:03:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:03:49.686433 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957515a-61dd-497b-b694-1286ea0b29ff None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:49.777452 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:49.784215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957515a-61dd-497b-b694-1286ea0b29ff None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:49.818055 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a479ef4-f846-4f14-a11c-e3a603314ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:49.818667 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a479ef4-f846-4f14-a11c-e3a603314ecc None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:49.818939 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a479ef4-f846-4f14-a11c-e3a603314ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:49.819207 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a479ef4-f846-4f14-a11c-e3a603314ecc None admin] PATH_INFO: `/v3/projects/477cfc3d519d4c8e8f6dcaf25154ec06` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:49.820320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a479ef4-f846-4f14-a11c-e3a603314ecc None admin] RBAC: Authorizing `identity:get_project(project_id=477cfc3d519d4c8e8f6dcaf25154ec06)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:49.821730 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a479ef4-f846-4f14-a11c-e3a603314ecc None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:49.823322 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 588/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:03:49 2022] GET /identity/v3/projects/477cfc3d519d4c8e8f6dcaf25154ec06 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:49.829549 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb2437-cadf-4ed2-b6bc-df66c621623d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:49.926727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb2437-cadf-4ed2-b6bc-df66c621623d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:49.959987 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b6f89-01e1-49ad-a20d-1998361d33d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:49.960568 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b6f89-01e1-49ad-a20d-1998361d33d9 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:49.960838 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b6f89-01e1-49ad-a20d-1998361d33d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:49.961102 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b6f89-01e1-49ad-a20d-1998361d33d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:49.961810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b6f89-01e1-49ad-a20d-1998361d33d9 None admin] RBAC: Adding query filter params (role.id=66456d39fc0c496c8f290a436b726216, scope.project.id=477cfc3d519d4c8e8f6dcaf25154ec06, user.id=27cd2270717f4167a7d93206a5dfda4c) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:49.962113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b6f89-01e1-49ad-a20d-1998361d33d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:49.963555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b6f89-01e1-49ad-a20d-1998361d33d9 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:49.968691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 597/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:03:49 2022] GET /identity/v3/role_assignments?user.id=27cd2270717f4167a7d93206a5dfda4c&scope.project.id=477cfc3d519d4c8e8f6dcaf25154ec06&role.id=66456d39fc0c496c8f290a436b726216 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:52.055421 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981e9d8-a89c-49c0-8d64-e1020e0e9337 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:52.055954 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981e9d8-a89c-49c0-8d64-e1020e0e9337 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:52.055954 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981e9d8-a89c-49c0-8d64-e1020e0e9337 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:52.057309 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 589/1186] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:03:52.062506 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7594915-2801-4eea-848f-ae8e3e509ba7 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:52.062901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7594915-2801-4eea-848f-ae8e3e509ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:52.063051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7594915-2801-4eea-848f-ae8e3e509ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:52.081262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-f7594915-2801-4eea-848f-ae8e3e509ba7 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:03:52.082444 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f7594915-2801-4eea-848f-ae8e3e509ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:03:52.084392 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:52.148555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 598/1187] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:03:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:03:52.416480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981e9d8-a89c-49c0-8d64-e1020e0e9337 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:52.515951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981e9d8-a89c-49c0-8d64-e1020e0e9337 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:52.549547 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51290e5-f76e-4af5-9e05-f9f95599265b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:52.550160 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51290e5-f76e-4af5-9e05-f9f95599265b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:52.550440 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51290e5-f76e-4af5-9e05-f9f95599265b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:52.550712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51290e5-f76e-4af5-9e05-f9f95599265b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:52.560672 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51290e5-f76e-4af5-9e05-f9f95599265b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:03:52.566012 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-c51290e5-f76e-4af5-9e05-f9f95599265b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:03:52.566012 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:03:52.566012 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:03:52.566012 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:03:52.566012 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:03:52.566012 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:03:52.566012 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:03:52.566012 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:03:52.566012 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:03:52.566012 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:03:52.566012 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:03:52.566012 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:03:52.566012 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:03:52.566012 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:03:52.566012 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:03:52.566012 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:03:52.567143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:03:52.567143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:03:52.567143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:03:52.567143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:03:52.567143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:03:52.567143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:03:52.567143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:03:52.567143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:03:52.567143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:03:52.567143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:03:52.567143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:03:52.567143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:03:52.567143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:03:52.567143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:03:52.567143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:03:52.567143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:03:52.568215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:03:52.568215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:03:52.568215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:03:52.568215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:03:52.568215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:03:52.568215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:03:52.568215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:03:52.568215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:03:52.568215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:03:52.568215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:03:52.568215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:03:52.568215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:03:52.568215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 590/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:03:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:03:52.573040 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7594915-2801-4eea-848f-ae8e3e509ba7 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:52.668008 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7594915-2801-4eea-848f-ae8e3e509ba7 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:52.701057 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8808b0-1f59-4704-9253-2b1713ca91d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:52.701657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8808b0-1f59-4704-9253-2b1713ca91d8 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:52.701931 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8808b0-1f59-4704-9253-2b1713ca91d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:52.702204 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8808b0-1f59-4704-9253-2b1713ca91d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:52.702855 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8808b0-1f59-4704-9253-2b1713ca91d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:52.703153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8808b0-1f59-4704-9253-2b1713ca91d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:52.704542 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8808b0-1f59-4704-9253-2b1713ca91d8 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:52.709633 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:52.715325 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 599/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:03:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:52.718928 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51290e5-f76e-4af5-9e05-f9f95599265b None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:52.745017 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:52.817245 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51290e5-f76e-4af5-9e05-f9f95599265b None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:52.850052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1b067-fea6-4b8a-a8e0-58a02ca419f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:52.850672 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1b067-fea6-4b8a-a8e0-58a02ca419f2 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:52.850947 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1b067-fea6-4b8a-a8e0-58a02ca419f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:52.851217 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1b067-fea6-4b8a-a8e0-58a02ca419f2 None admin] PATH_INFO: `/v3/users/27cd2270717f4167a7d93206a5dfda4c` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:52.852352 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1b067-fea6-4b8a-a8e0-58a02ca419f2 None admin] RBAC: Authorizing `identity:get_user(user_id=27cd2270717f4167a7d93206a5dfda4c)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:52.853783 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1b067-fea6-4b8a-a8e0-58a02ca419f2 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:52.855381 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 591/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:03:52 2022] GET /identity/v3/users/27cd2270717f4167a7d93206a5dfda4c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:52.861661 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8808b0-1f59-4704-9253-2b1713ca91d8 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:52.956960 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8808b0-1f59-4704-9253-2b1713ca91d8 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:52.989346 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a50e5-2fef-41c7-be3d-a1b80390fbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:52.989950 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a50e5-2fef-41c7-be3d-a1b80390fbb2 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:52.990226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a50e5-2fef-41c7-be3d-a1b80390fbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:52.990494 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a50e5-2fef-41c7-be3d-a1b80390fbb2 None admin] PATH_INFO: `/v3/projects/477cfc3d519d4c8e8f6dcaf25154ec06` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:52.991601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a50e5-2fef-41c7-be3d-a1b80390fbb2 None admin] RBAC: Authorizing `identity:get_project(project_id=477cfc3d519d4c8e8f6dcaf25154ec06)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:52.993256 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a50e5-2fef-41c7-be3d-a1b80390fbb2 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:52.994839 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 600/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:03:52 2022] GET /identity/v3/projects/477cfc3d519d4c8e8f6dcaf25154ec06 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:53.000534 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1b067-fea6-4b8a-a8e0-58a02ca419f2 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:53.094944 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:53.104266 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1b067-fea6-4b8a-a8e0-58a02ca419f2 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:53.137269 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d906b0d-11d0-4ce1-b72c-57afb639ef5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:53.137909 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d906b0d-11d0-4ce1-b72c-57afb639ef5a None admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:53.138184 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d906b0d-11d0-4ce1-b72c-57afb639ef5a None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:53.138454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d906b0d-11d0-4ce1-b72c-57afb639ef5a None admin] PATH_INFO: `/v3/projects/477cfc3d519d4c8e8f6dcaf25154ec06/users/27cd2270717f4167a7d93206a5dfda4c/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:53.140337 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d906b0d-11d0-4ce1-b72c-57afb639ef5a None admin] RBAC: Authorizing `identity:create_grant(project_id=477cfc3d519d4c8e8f6dcaf25154ec06, user_id=27cd2270717f4167a7d93206a5dfda4c, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:53.141740 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d906b0d-11d0-4ce1-b72c-57afb639ef5a None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:53.153417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 592/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 28 12:03:52 2022] PUT /identity/v3/projects/477cfc3d519d4c8e8f6dcaf25154ec06/users/27cd2270717f4167a7d93206a5dfda4c/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:03:55.242666 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c9db0-b71e-4d82-ad07-ec4d1f7f0e14 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:55.243197 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c9db0-b71e-4d82-ad07-ec4d1f7f0e14 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:55.243197 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c9db0-b71e-4d82-ad07-ec4d1f7f0e14 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:55.244566 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 601/1193] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:03:55.249701 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d298b-e209-4f8f-8cf3-76b7fb09a000 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:55.250075 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d298b-e209-4f8f-8cf3-76b7fb09a000 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:55.250248 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d298b-e209-4f8f-8cf3-76b7fb09a000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:55.269081 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-c52d298b-e209-4f8f-8cf3-76b7fb09a000 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:03:55.270248 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-c52d298b-e209-4f8f-8cf3-76b7fb09a000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:03:55.335055 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 593/1194] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:03:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:03:55.601283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c9db0-b71e-4d82-ad07-ec4d1f7f0e14 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:55.668168 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:55.701403 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c9db0-b71e-4d82-ad07-ec4d1f7f0e14 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:55.735534 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c461c-4f52-4885-9df9-b21d9c64b89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:55.736213 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c461c-4f52-4885-9df9-b21d9c64b89e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:55.736482 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c461c-4f52-4885-9df9-b21d9c64b89e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:55.736753 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c461c-4f52-4885-9df9-b21d9c64b89e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:55.747382 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c461c-4f52-4885-9df9-b21d9c64b89e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:03:55.752122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-a87c461c-4f52-4885-9df9-b21d9c64b89e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:03:55.752122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:03:55.752122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:03:55.752122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:03:55.752122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:03:55.752122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:03:55.752122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:03:55.752122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:03:55.752122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:03:55.752122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:03:55.752122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:03:55.752122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:03:55.752122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:03:55.752122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:03:55.752122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:03:55.752122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:03:55.753210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:03:55.753210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:03:55.753210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:03:55.753210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:03:55.753210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:03:55.753210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:03:55.753210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:03:55.753210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:03:55.753210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:03:55.753210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:03:55.753210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:03:55.753210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:03:55.753210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:03:55.753210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:03:55.753210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:03:55.753210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:03:55.754263 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:03:55.754263 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:03:55.754263 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:03:55.754263 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:03:55.754263 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:03:55.754263 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:03:55.754263 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:03:55.754263 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:03:55.754263 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:03:55.754263 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:03:55.754263 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:03:55.754263 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:03:55.754263 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 602/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:03:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:03:55.759274 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d298b-e209-4f8f-8cf3-76b7fb09a000 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:55.839014 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:55.858015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d298b-e209-4f8f-8cf3-76b7fb09a000 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:55.890917 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75045e-9c43-496a-9e5e-2d39981fbfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:55.891539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75045e-9c43-496a-9e5e-2d39981fbfee None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:55.891814 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75045e-9c43-496a-9e5e-2d39981fbfee None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:55.892083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75045e-9c43-496a-9e5e-2d39981fbfee None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:55.893297 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75045e-9c43-496a-9e5e-2d39981fbfee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:55.893595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75045e-9c43-496a-9e5e-2d39981fbfee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:55.894941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75045e-9c43-496a-9e5e-2d39981fbfee None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:55.902764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 594/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:03:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:55.908859 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c461c-4f52-4885-9df9-b21d9c64b89e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:56.004546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c461c-4f52-4885-9df9-b21d9c64b89e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:56.029451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:56.037535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23110eee-e5a4-4d59-950e-e66b5e8c3dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:56.038157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23110eee-e5a4-4d59-950e-e66b5e8c3dae None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:56.038452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23110eee-e5a4-4d59-950e-e66b5e8c3dae None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:56.038725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23110eee-e5a4-4d59-950e-e66b5e8c3dae None admin] PATH_INFO: `/v3/users/27cd2270717f4167a7d93206a5dfda4c` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:56.039857 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23110eee-e5a4-4d59-950e-e66b5e8c3dae None admin] RBAC: Authorizing `identity:get_user(user_id=27cd2270717f4167a7d93206a5dfda4c)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:56.041274 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23110eee-e5a4-4d59-950e-e66b5e8c3dae None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:56.042844 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 603/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 28 12:03:55 2022] GET /identity/v3/users/27cd2270717f4167a7d93206a5dfda4c => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:56.048617 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75045e-9c43-496a-9e5e-2d39981fbfee None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:56.149396 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75045e-9c43-496a-9e5e-2d39981fbfee None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:56.181996 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf10c70-4ca5-42ba-b1a7-5bf422ec172f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:56.182709 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf10c70-4ca5-42ba-b1a7-5bf422ec172f None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:56.182989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf10c70-4ca5-42ba-b1a7-5bf422ec172f None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:56.183256 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf10c70-4ca5-42ba-b1a7-5bf422ec172f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:56.197828 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:56.250378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf10c70-4ca5-42ba-b1a7-5bf422ec172f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:56.252413 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf10c70-4ca5-42ba-b1a7-5bf422ec172f None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:56.346419 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 595/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:03:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:03:56.352506 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23110eee-e5a4-4d59-950e-e66b5e8c3dae None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:56.450059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23110eee-e5a4-4d59-950e-e66b5e8c3dae None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:56.482122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065583dc-13a8-47b4-ade8-81d04e6ce0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:56.482736 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065583dc-13a8-47b4-ade8-81d04e6ce0b4 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:56.483014 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065583dc-13a8-47b4-ade8-81d04e6ce0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:56.483290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065583dc-13a8-47b4-ade8-81d04e6ce0b4 None admin] PATH_INFO: `/v3/projects/477cfc3d519d4c8e8f6dcaf25154ec06` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:56.484408 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065583dc-13a8-47b4-ade8-81d04e6ce0b4 None admin] RBAC: Authorizing `identity:get_project(project_id=477cfc3d519d4c8e8f6dcaf25154ec06)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:56.485817 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065583dc-13a8-47b4-ade8-81d04e6ce0b4 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:56.487988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 604/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 28 12:03:56 2022] GET /identity/v3/projects/477cfc3d519d4c8e8f6dcaf25154ec06 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:03:56.494304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf10c70-4ca5-42ba-b1a7-5bf422ec172f None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:03:56.538104 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:03:56.591062 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf10c70-4ca5-42ba-b1a7-5bf422ec172f None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:03:56.624382 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973f2e4-4de4-48a4-a74b-2c8d9fa40e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:03:56.624968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973f2e4-4de4-48a4-a74b-2c8d9fa40e17 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:03:56.625246 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973f2e4-4de4-48a4-a74b-2c8d9fa40e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:03:56.625515 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973f2e4-4de4-48a4-a74b-2c8d9fa40e17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:03:56.626227 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973f2e4-4de4-48a4-a74b-2c8d9fa40e17 None admin] RBAC: Adding query filter params (role.id=66456d39fc0c496c8f290a436b726216, scope.project.id=477cfc3d519d4c8e8f6dcaf25154ec06, user.id=27cd2270717f4167a7d93206a5dfda4c) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:03:56.627058 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973f2e4-4de4-48a4-a74b-2c8d9fa40e17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:03:56.628498 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973f2e4-4de4-48a4-a74b-2c8d9fa40e17 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:03:56.634082 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 596/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:03:56 2022] GET /identity/v3/role_assignments?user.id=27cd2270717f4167a7d93206a5dfda4c&scope.project.id=477cfc3d519d4c8e8f6dcaf25154ec06&role.id=66456d39fc0c496c8f290a436b726216 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:04:06.478125 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=68 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:04:06.631534 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=46 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:04:51.888211 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bb801-d184-4157-9e08-3d592c671172 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:04:51.888812 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bb801-d184-4157-9e08-3d592c671172 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:04:51.888812 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bb801-d184-4157-9e08-3d592c671172 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:04:51.890137 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 605/1201] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:04:51.895983 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a756c02-09c4-4687-ac94-1d079bd3a0e2 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:04:51.896481 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a756c02-09c4-4687-ac94-1d079bd3a0e2 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:04:51.896589 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a756c02-09c4-4687-ac94-1d079bd3a0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:04:51.916812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-0a756c02-09c4-4687-ac94-1d079bd3a0e2 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:04:51.917962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-0a756c02-09c4-4687-ac94-1d079bd3a0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:04:51.999734 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 597/1202] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:04:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:04:52.286985 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bb801-d184-4157-9e08-3d592c671172 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:04:52.419905 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bb801-d184-4157-9e08-3d592c671172 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:04:52.464865 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f52521-6467-4022-9923-bbd12a4fb6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:04:52.465506 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f52521-6467-4022-9923-bbd12a4fb6af None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:04:52.465791 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f52521-6467-4022-9923-bbd12a4fb6af None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:04:52.466561 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f52521-6467-4022-9923-bbd12a4fb6af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:04:52.479453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f52521-6467-4022-9923-bbd12a4fb6af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:04:52.480914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f52521-6467-4022-9923-bbd12a4fb6af None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:04:52.500218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-28f52521-6467-4022-9923-bbd12a4fb6af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:04:52.500218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:04:52.500218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:04:52.500218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:04:52.500218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:04:52.500218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:04:52.500218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:04:52.500218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:04:52.500218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:04:52.500218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:04:52.500218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:04:52.500218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:04:52.500218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:04:52.500218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:04:52.500218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:04:52.500218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:04:52.501502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:04:52.501502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:04:52.501502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:04:52.501502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:04:52.501502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:04:52.501502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:04:52.501502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:04:52.501502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:04:52.501502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:04:52.501502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:04:52.501502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:04:52.501502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:04:52.501502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:04:52.501502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:04:52.501502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:04:52.501502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:04:52.501502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:04:52.502508 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:04:52.502508 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:04:52.502508 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:04:52.502508 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 606/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:04:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:04:52.507926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a756c02-09c4-4687-ac94-1d079bd3a0e2 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:04:52.627777 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a756c02-09c4-4687-ac94-1d079bd3a0e2 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:04:52.668797 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:04:52.678782 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e0bcd-76c0-4b22-828f-b1595f800d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:04:52.679870 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e0bcd-76c0-4b22-828f-b1595f800d92 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:04:52.680198 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e0bcd-76c0-4b22-828f-b1595f800d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:04:52.680453 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e0bcd-76c0-4b22-828f-b1595f800d92 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:04:52.681108 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e0bcd-76c0-4b22-828f-b1595f800d92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:04:52.681414 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e0bcd-76c0-4b22-828f-b1595f800d92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:04:52.682927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e0bcd-76c0-4b22-828f-b1595f800d92 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:04:52.695486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 598/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:04:52.712082 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f52521-6467-4022-9923-bbd12a4fb6af None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:04:52.780037 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:04:52.834153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f52521-6467-4022-9923-bbd12a4fb6af None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:04:52.880780 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ebc6d9-c0a0-456c-bdc5-eacb9bffbc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:04:52.881409 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebc6d9-c0a0-456c-bdc5-eacb9bffbc99 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:04:52.881691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebc6d9-c0a0-456c-bdc5-eacb9bffbc99 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:04:52.881979 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebc6d9-c0a0-456c-bdc5-eacb9bffbc99 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:04:52.882715 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ebc6d9-c0a0-456c-bdc5-eacb9bffbc99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:04:52.884313 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ebc6d9-c0a0-456c-bdc5-eacb9bffbc99 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:04:52.914978 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 607/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 28 12:04:52 2022] POST /identity/v3/users => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:04:55.515422 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387da3ef-c503-44bb-84c7-983ea2b71eb9 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:04:55.516004 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387da3ef-c503-44bb-84c7-983ea2b71eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:04:55.516004 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387da3ef-c503-44bb-84c7-983ea2b71eb9 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:04:55.517849 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 599/1206] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:04:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:04:55.526296 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9b835-c96a-4815-a913-c5bdcfbb8db1 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:04:55.526783 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9b835-c96a-4815-a913-c5bdcfbb8db1 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:04:55.526887 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9b835-c96a-4815-a913-c5bdcfbb8db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:04:55.552170 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-43a9b835-c96a-4815-a913-c5bdcfbb8db1 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:04:55.553394 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-43a9b835-c96a-4815-a913-c5bdcfbb8db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:04:55.630808 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 608/1207] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:04:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:04:55.910152 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387da3ef-c503-44bb-84c7-983ea2b71eb9 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:04:56.036311 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387da3ef-c503-44bb-84c7-983ea2b71eb9 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:04:56.085209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4309e50-e2c1-48d4-9a75-812836bac1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:04:56.085959 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4309e50-e2c1-48d4-9a75-812836bac1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:04:56.086340 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4309e50-e2c1-48d4-9a75-812836bac1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:04:56.086763 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4309e50-e2c1-48d4-9a75-812836bac1d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:04:56.104284 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4309e50-e2c1-48d4-9a75-812836bac1d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:04:56.109461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-e4309e50-e2c1-48d4-9a75-812836bac1d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:04:56.109461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:04:56.109461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:04:56.109461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:04:56.109461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:04:56.109461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:04:56.109461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:04:56.109461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:04:56.109461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:04:56.109461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:04:56.109461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:04:56.109461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:04:56.109461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:04:56.109461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:04:56.109461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:04:56.109461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:04:56.111053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:04:56.111053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:04:56.111053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:04:56.111053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:04:56.111053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:04:56.111053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:04:56.111053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:04:56.111053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:04:56.111053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:04:56.111053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:04:56.111053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:04:56.111053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:04:56.111053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:04:56.111053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:04:56.111053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:04:56.111053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:04:56.112418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:04:56.112418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:04:56.112418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:04:56.112418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:04:56.112418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:04:56.112418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:04:56.112418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:04:56.112418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:04:56.112418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:04:56.112418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:04:56.112418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:04:56.112418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:04:56.115570 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 600/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 28 12:04:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:04:56.120172 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9b835-c96a-4815-a913-c5bdcfbb8db1 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:04:56.171430 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:04:56.243593 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9b835-c96a-4815-a913-c5bdcfbb8db1 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:04:56.293445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75db95-e3cb-475b-8c69-54ce94f2a5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:04:56.294113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75db95-e3cb-475b-8c69-54ce94f2a5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:04:56.294559 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75db95-e3cb-475b-8c69-54ce94f2a5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:04:56.294762 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75db95-e3cb-475b-8c69-54ce94f2a5b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:04:56.295627 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75db95-e3cb-475b-8c69-54ce94f2a5b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:04:56.296093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75db95-e3cb-475b-8c69-54ce94f2a5b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:04:56.297760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75db95-e3cb-475b-8c69-54ce94f2a5b0 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:04:56.308196 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 609/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 28 12:04:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:04:56.314394 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4309e50-e2c1-48d4-9a75-812836bac1d3 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:04:56.377703 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:04:56.443870 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4309e50-e2c1-48d4-9a75-812836bac1d3 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:04:56.485535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a7c28-9ca0-4011-9929-d219993ee95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:04:56.486186 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a7c28-9ca0-4011-9929-d219993ee95f None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:04:56.486455 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a7c28-9ca0-4011-9929-d219993ee95f None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:04:56.486726 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a7c28-9ca0-4011-9929-d219993ee95f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:04:56.498292 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a7c28-9ca0-4011-9929-d219993ee95f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:04:56.499785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a7c28-9ca0-4011-9929-d219993ee95f None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:04:56.514041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-8c7a7c28-9ca0-4011-9929-d219993ee95f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:04:56.514041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:04:56.514041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:04:56.514041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:04:56.514041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:04:56.514041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:04:56.514041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:04:56.514041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:04:56.514041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:04:56.514041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:04:56.514041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:04:56.514041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:04:56.514041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:04:56.514041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:04:56.514041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:04:56.514041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:04:56.523119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:04:56.523119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:04:56.523119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:04:56.523119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:04:56.523119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:04:56.523119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:04:56.523119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:04:56.523119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:04:56.523119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:04:56.523119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:04:56.523119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:04:56.523119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:04:56.523119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:04:56.523119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:04:56.523119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:04:56.523119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:04:56.523119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:04:56.524799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:04:56.524799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:04:56.524799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:04:56.524799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 601/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:04:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:04:56.527362 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75db95-e3cb-475b-8c69-54ce94f2a5b0 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:04:56.659560 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:04:56.665064 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75db95-e3cb-475b-8c69-54ce94f2a5b0 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:04:56.716534 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3dd68-3809-4606-854b-0a92dc768c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:04:56.717331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3dd68-3809-4606-854b-0a92dc768c67 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:04:56.717771 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3dd68-3809-4606-854b-0a92dc768c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:04:56.718094 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3dd68-3809-4606-854b-0a92dc768c67 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:04:56.718976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3dd68-3809-4606-854b-0a92dc768c67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:04:56.719300 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3dd68-3809-4606-854b-0a92dc768c67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:04:56.721314 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3dd68-3809-4606-854b-0a92dc768c67 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:04:56.739767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 610/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:04:56.746135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a7c28-9ca0-4011-9929-d219993ee95f None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:04:56.863633 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a7c28-9ca0-4011-9929-d219993ee95f None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:04:56.865963 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:04:56.904109 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5eebba-d754-44ad-83d6-d23cc2dddde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:04:56.904894 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5eebba-d754-44ad-83d6-d23cc2dddde3 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:04:56.905271 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5eebba-d754-44ad-83d6-d23cc2dddde3 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:04:56.905710 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5eebba-d754-44ad-83d6-d23cc2dddde3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:04:56.913995 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5eebba-d754-44ad-83d6-d23cc2dddde3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:04:56.915579 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5eebba-d754-44ad-83d6-d23cc2dddde3 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:04:56.927759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-cf5eebba-d754-44ad-83d6-d23cc2dddde3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 28 12:04:56.927759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:04:56.927759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:04:56.927759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:04:56.927759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:04:56.927759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:04:56.927759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:04:56.927759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:04:56.927759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:04:56.927759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:04:56.927759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:04:56.927759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:04:56.927759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:04:56.927759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:04:56.927759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:04:56.927759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:04:56.928791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:04:56.928791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:04:56.928791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:04:56.928791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:04:56.928791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:04:56.928791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:04:56.928791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:04:56.928791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:04:56.928791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:04:56.928791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:04:56.928791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:04:56.928791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:04:56.928791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:04:56.928791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:04:56.928791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:04:56.928791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:04:56.928791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:04:56.928791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:04:56.930624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:04:56.930624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:04:56.930624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:04:56.930624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:04:56.930624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:04:56.930624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:04:56.930624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:04:56.930624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:04:56.930624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 28 12:04:56.930624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:04:56.930624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 602/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:04:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:04:56.934660 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3dd68-3809-4606-854b-0a92dc768c67 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:04:57.047538 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3dd68-3809-4606-854b-0a92dc768c67 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:04:57.090680 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2bbb6-d695-4e01-a397-be211f88a3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:04:57.091295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2bbb6-d695-4e01-a397-be211f88a3b6 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:04:57.091602 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2bbb6-d695-4e01-a397-be211f88a3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:04:57.091867 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2bbb6-d695-4e01-a397-be211f88a3b6 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:04:57.092591 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2bbb6-d695-4e01-a397-be211f88a3b6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:04:57.092890 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2bbb6-d695-4e01-a397-be211f88a3b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:04:57.094354 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2bbb6-d695-4e01-a397-be211f88a3b6 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:04:57.118263 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 611/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Sep 28 12:04:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:04:57.124651 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5eebba-d754-44ad-83d6-d23cc2dddde3 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:04:57.253300 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5eebba-d754-44ad-83d6-d23cc2dddde3 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:04:57.295307 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7a925-b377-4e1f-8d6b-5eb8fb86931c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:04:57.295990 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7a925-b377-4e1f-8d6b-5eb8fb86931c None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:04:57.296262 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7a925-b377-4e1f-8d6b-5eb8fb86931c None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:04:57.296571 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7a925-b377-4e1f-8d6b-5eb8fb86931c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:04:57.335422 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:04:57.393748 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7a925-b377-4e1f-8d6b-5eb8fb86931c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:04:57.395585 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7a925-b377-4e1f-8d6b-5eb8fb86931c None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:04:57.515644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 603/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:04:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 28 12:04:57.522059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2bbb6-d695-4e01-a397-be211f88a3b6 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:04:57.546026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:04:57.654529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2bbb6-d695-4e01-a397-be211f88a3b6 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:04:57.692570 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719d5cc-45d1-459f-ae45-426dcf8c43ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:04:57.693375 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719d5cc-45d1-459f-ae45-426dcf8c43ec None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:04:57.693705 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719d5cc-45d1-459f-ae45-426dcf8c43ec None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:04:57.694091 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719d5cc-45d1-459f-ae45-426dcf8c43ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:04:57.707667 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719d5cc-45d1-459f-ae45-426dcf8c43ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:04:57.709341 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719d5cc-45d1-459f-ae45-426dcf8c43ec None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:04:57.727218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-2719d5cc-45d1-459f-ae45-426dcf8c43ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:04:57.727218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:04:57.727218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:04:57.727218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:04:57.727218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:04:57.727218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:04:57.727218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:04:57.727218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:04:57.727218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:04:57.727218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:04:57.727218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:04:57.727218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:04:57.727218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:04:57.727218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:04:57.727218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:04:57.727218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:04:57.728452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:04:57.728452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:04:57.728452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:04:57.728452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:04:57.728452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:04:57.728452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:04:57.728452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:04:57.728452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:04:57.728452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:04:57.728452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:04:57.728452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:04:57.728452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:04:57.728452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:04:57.728452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:04:57.728452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:04:57.728452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:04:57.728452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:04:57.729567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:04:57.729567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:04:57.729567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:04:57.729567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 612/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:04:57.736801 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7a925-b377-4e1f-8d6b-5eb8fb86931c None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:04:57.807422 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:04:57.850917 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7a925-b377-4e1f-8d6b-5eb8fb86931c None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:04:57.893723 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968db314-9235-4f81-bd67-429dc0bd6077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:04:57.894360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968db314-9235-4f81-bd67-429dc0bd6077 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:04:57.894698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968db314-9235-4f81-bd67-429dc0bd6077 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:04:57.895020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968db314-9235-4f81-bd67-429dc0bd6077 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:04:57.895684 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968db314-9235-4f81-bd67-429dc0bd6077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:04:57.895977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968db314-9235-4f81-bd67-429dc0bd6077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:04:57.897364 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968db314-9235-4f81-bd67-429dc0bd6077 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:04:57.909012 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 604/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:04:57.915654 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719d5cc-45d1-459f-ae45-426dcf8c43ec None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:04:58.003367 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:04:58.037451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719d5cc-45d1-459f-ae45-426dcf8c43ec None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:04:58.076812 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2229932-a903-4dd1-85aa-abcf4f44ba42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:04:58.077449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2229932-a903-4dd1-85aa-abcf4f44ba42 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:04:58.077727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2229932-a903-4dd1-85aa-abcf4f44ba42 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:04:58.077995 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2229932-a903-4dd1-85aa-abcf4f44ba42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:04:58.085825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2229932-a903-4dd1-85aa-abcf4f44ba42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:04:58.087609 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2229932-a903-4dd1-85aa-abcf4f44ba42 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:04:58.100240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-f2229932-a903-4dd1-85aa-abcf4f44ba42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:04:58.100240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:04:58.100240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:04:58.100240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:04:58.100240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:04:58.100240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:04:58.100240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:04:58.100240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:04:58.100240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:04:58.100240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:04:58.100240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:04:58.100240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:04:58.100240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:04:58.100240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:04:58.100240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:04:58.101412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:04:58.101412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:04:58.101412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:04:58.101412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:04:58.101412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:04:58.101412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:04:58.101412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:04:58.101412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:04:58.101412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:04:58.101412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:04:58.101412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:04:58.101412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:04:58.101412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:04:58.101412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:04:58.101412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:04:58.101412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:04:58.101412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:04:58.102543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:04:58.102543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:04:58.102543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:04:58.102543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:04:58.102543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:04:58.102543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:04:58.102543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:04:58.102543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:04:58.106471 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 613/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:04:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:04:58.107461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968db314-9235-4f81-bd67-429dc0bd6077 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:04:58.222020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968db314-9235-4f81-bd67-429dc0bd6077 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:04:58.247543 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:04:58.259655 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e0acd-8773-49ff-84f6-d5a38772cf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:04:58.260267 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e0acd-8773-49ff-84f6-d5a38772cf15 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:04:58.260548 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e0acd-8773-49ff-84f6-d5a38772cf15 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:04:58.260821 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e0acd-8773-49ff-84f6-d5a38772cf15 None admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:04:58.261518 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e0acd-8773-49ff-84f6-d5a38772cf15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:04:58.261824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e0acd-8773-49ff-84f6-d5a38772cf15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:04:58.263261 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e0acd-8773-49ff-84f6-d5a38772cf15 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:04:58.276490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 605/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:04:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:04:58.283527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2229932-a903-4dd1-85aa-abcf4f44ba42 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:04:58.400260 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2229932-a903-4dd1-85aa-abcf4f44ba42 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:04:58.430398 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:04:58.437263 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca7bd0-3ee0-4d8e-b77b-7607c49f1ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:04:58.437913 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca7bd0-3ee0-4d8e-b77b-7607c49f1ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:04:58.438284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca7bd0-3ee0-4d8e-b77b-7607c49f1ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:04:58.438578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca7bd0-3ee0-4d8e-b77b-7607c49f1ec3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:04:58.439327 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca7bd0-3ee0-4d8e-b77b-7607c49f1ec3 None admin] RBAC: Adding query filter params (role.id=9b8671e5f63c4b08982273f189eab5ec, scope.project.id=c854d366f35145e8b2fadb9b014d0199, user.id=09e495edc6fd47c892679bb908c3f5bd) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:04:58.439781 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca7bd0-3ee0-4d8e-b77b-7607c49f1ec3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:04:58.441470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca7bd0-3ee0-4d8e-b77b-7607c49f1ec3 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:04:58.448081 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 614/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:04:58 2022] GET /identity/v3/role_assignments?user.id=09e495edc6fd47c892679bb908c3f5bd&scope.project.id=c854d366f35145e8b2fadb9b014d0199&role.id=9b8671e5f63c4b08982273f189eab5ec => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:00.662656 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789ce15-dae9-47a8-a036-d69373a2d74f None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:00.663188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789ce15-dae9-47a8-a036-d69373a2d74f None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:00.663188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789ce15-dae9-47a8-a036-d69373a2d74f None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:00.664857 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 606/1220] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:05:00.670019 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df71dd-abdf-4206-b2a7-dfe1adfb143b None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:00.670421 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df71dd-abdf-4206-b2a7-dfe1adfb143b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:00.670621 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df71dd-abdf-4206-b2a7-dfe1adfb143b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:00.689577 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-54df71dd-abdf-4206-b2a7-dfe1adfb143b None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:05:00.690754 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-54df71dd-abdf-4206-b2a7-dfe1adfb143b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:05:00.779577 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 615/1221] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:05:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:05:01.046407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789ce15-dae9-47a8-a036-d69373a2d74f None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:01.163462 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789ce15-dae9-47a8-a036-d69373a2d74f None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:01.200150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731abb8a-a320-47ed-8b7d-293a2027425b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:01.200843 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731abb8a-a320-47ed-8b7d-293a2027425b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:01.201122 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731abb8a-a320-47ed-8b7d-293a2027425b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:01.201394 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731abb8a-a320-47ed-8b7d-293a2027425b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:01.211654 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731abb8a-a320-47ed-8b7d-293a2027425b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:05:01.216694 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-731abb8a-a320-47ed-8b7d-293a2027425b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:05:01.216694 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:01.216694 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:01.216694 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:01.216694 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:01.216694 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:01.216694 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:01.216694 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:01.216694 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:01.216694 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:01.216694 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:01.216694 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:01.216694 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:05:01.216694 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:05:01.216694 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:05:01.216694 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:05:01.217825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:05:01.217825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:05:01.217825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:05:01.217825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:05:01.217825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:01.217825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:01.217825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:01.217825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:01.217825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:01.217825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:01.217825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:01.217825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:01.217825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:01.217825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:01.217825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:01.217825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:01.218685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:01.218685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:01.218685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:01.218685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:01.218685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:05:01.218685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:05:01.218685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:05:01.218685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:05:01.218685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:05:01.218685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:05:01.218685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:05:01.218685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:05:01.218685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 607/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 28 12:05:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:05:01.224700 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df71dd-abdf-4206-b2a7-dfe1adfb143b None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:01.336116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df71dd-abdf-4206-b2a7-dfe1adfb143b None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:01.364051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:01.380300 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae1dea-504a-44aa-83a2-96916b706122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:01.381067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae1dea-504a-44aa-83a2-96916b706122 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:01.381318 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae1dea-504a-44aa-83a2-96916b706122 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:01.381663 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae1dea-504a-44aa-83a2-96916b706122 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:01.382436 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae1dea-504a-44aa-83a2-96916b706122 None admin] RBAC: Adding query filter params (name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:01.382827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae1dea-504a-44aa-83a2-96916b706122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:01.384508 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae1dea-504a-44aa-83a2-96916b706122 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:01.396350 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 616/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 28 12:05:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:01.403708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731abb8a-a320-47ed-8b7d-293a2027425b None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:01.451642 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:01.515585 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731abb8a-a320-47ed-8b7d-293a2027425b None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:01.553505 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583c04c-74e3-48ed-9b2f-c51ca7b7ad27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:01.554134 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583c04c-74e3-48ed-9b2f-c51ca7b7ad27 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:01.554435 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583c04c-74e3-48ed-9b2f-c51ca7b7ad27 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:01.554675 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583c04c-74e3-48ed-9b2f-c51ca7b7ad27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:01.565577 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583c04c-74e3-48ed-9b2f-c51ca7b7ad27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:01.567524 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583c04c-74e3-48ed-9b2f-c51ca7b7ad27 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:01.586253 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-2583c04c-74e3-48ed-9b2f-c51ca7b7ad27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:05:01.586253 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:01.586253 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:01.586253 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:01.586253 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:01.586253 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:01.586253 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:01.586253 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:01.586253 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:01.586253 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:01.586253 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:01.586253 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:01.586253 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:05:01.586253 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:05:01.586253 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:05:01.586253 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:05:01.587401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:01.587401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:01.587401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:01.587401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:01.587401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:01.587401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:01.587401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:01.587401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:01.587401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:01.587401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:01.587401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:01.587401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:01.587401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:01.587401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:01.587401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:01.587401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:01.587401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:05:01.588513 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:05:01.588513 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:05:01.588513 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:05:01.588513 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 608/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:05:01.593682 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae1dea-504a-44aa-83a2-96916b706122 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:01.706618 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae1dea-504a-44aa-83a2-96916b706122 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:01.751825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6199e1-d7cd-4cb2-a51f-52e502b27e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:01.752459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6199e1-d7cd-4cb2-a51f-52e502b27e1a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:01.752766 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6199e1-d7cd-4cb2-a51f-52e502b27e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:01.753062 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6199e1-d7cd-4cb2-a51f-52e502b27e1a None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:01.753721 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6199e1-d7cd-4cb2-a51f-52e502b27e1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:01.754021 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6199e1-d7cd-4cb2-a51f-52e502b27e1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:01.755383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6199e1-d7cd-4cb2-a51f-52e502b27e1a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:01.767932 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 617/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:01.774163 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583c04c-74e3-48ed-9b2f-c51ca7b7ad27 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:01.873413 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:01.881650 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583c04c-74e3-48ed-9b2f-c51ca7b7ad27 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:01.915792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acff3b-9884-4f3e-b7cf-ea7d6229cdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:01.916418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acff3b-9884-4f3e-b7cf-ea7d6229cdca None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:01.916697 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acff3b-9884-4f3e-b7cf-ea7d6229cdca None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:01.916965 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acff3b-9884-4f3e-b7cf-ea7d6229cdca None admin] PATH_INFO: `/v3/users/placement` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:01.924546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acff3b-9884-4f3e-b7cf-ea7d6229cdca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:01.925987 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acff3b-9884-4f3e-b7cf-ea7d6229cdca None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:01.937215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-20acff3b-9884-4f3e-b7cf-ea7d6229cdca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 28 12:05:01.937215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:01.937215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:01.937215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:01.937215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:01.937215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:01.937215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:01.937215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:01.937215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:01.937215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:01.937215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:01.937215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:01.937215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:05:01.937215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:05:01.937215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:05:01.937215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:05:01.938208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:01.938208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:01.938208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:05:01.938208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:05:01.938208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:05:01.938208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:05:01.938208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:01.938208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:01.938208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:01.938208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:01.938208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:01.938208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:01.938208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:01.938208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:01.938208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:01.938208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:01.938208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:01.938208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:01.939846 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:01.939846 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:01.939846 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:05:01.939846 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:05:01.939846 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:05:01.939846 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:05:01.939846 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:05:01.939846 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:05:01.939846 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 28 12:05:01.939846 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:05:01.939846 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 609/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:05:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:05:01.945038 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6199e1-d7cd-4cb2-a51f-52e502b27e1a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:01.994632 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:02.052614 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6199e1-d7cd-4cb2-a51f-52e502b27e1a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:02.091547 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2689b-94c5-41de-b655-971dd485373f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:02.092212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2689b-94c5-41de-b655-971dd485373f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:02.092483 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2689b-94c5-41de-b655-971dd485373f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:02.092774 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2689b-94c5-41de-b655-971dd485373f None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:02.093603 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2689b-94c5-41de-b655-971dd485373f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:02.093940 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2689b-94c5-41de-b655-971dd485373f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:02.096178 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2689b-94c5-41de-b655-971dd485373f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:02.115167 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 618/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Sep 28 12:05:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:02.121886 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acff3b-9884-4f3e-b7cf-ea7d6229cdca None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:02.239118 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acff3b-9884-4f3e-b7cf-ea7d6229cdca None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:02.280305 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692d6ba-8ef2-48b0-b920-a06d47c22049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:02.280976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692d6ba-8ef2-48b0-b920-a06d47c22049 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:02.281285 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692d6ba-8ef2-48b0-b920-a06d47c22049 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:02.281612 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692d6ba-8ef2-48b0-b920-a06d47c22049 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:02.293432 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692d6ba-8ef2-48b0-b920-a06d47c22049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:02.295059 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692d6ba-8ef2-48b0-b920-a06d47c22049 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:02.311015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-b692d6ba-8ef2-48b0-b920-a06d47c22049 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:05:02.311015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:02.311015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:02.311015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:02.311015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:02.311015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:02.311015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:02.311015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:02.311015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:02.311015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:02.311015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:02.311015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:02.311015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:05:02.311015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:05:02.311015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:05:02.311015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:05:02.312441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:02.312441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:02.312441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:02.312441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:02.312441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:02.312441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:02.312441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:02.312441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:02.312441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:02.312441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:02.312441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:02.312441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:02.312441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:02.312441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:02.312441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:02.312441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:02.312441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:05:02.314188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:05:02.314188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:05:02.314188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:05:02.314188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 610/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:05:02.319201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2689b-94c5-41de-b655-971dd485373f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:02.434538 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2689b-94c5-41de-b655-971dd485373f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:02.436899 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:02.472277 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8d36a-69bc-4d54-9924-61774be11131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:02.472912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8d36a-69bc-4d54-9924-61774be11131 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:02.473247 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8d36a-69bc-4d54-9924-61774be11131 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:02.473554 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8d36a-69bc-4d54-9924-61774be11131 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:02.474223 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8d36a-69bc-4d54-9924-61774be11131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:02.474521 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8d36a-69bc-4d54-9924-61774be11131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:02.475902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8d36a-69bc-4d54-9924-61774be11131 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:02.487010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 619/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:02.492670 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692d6ba-8ef2-48b0-b920-a06d47c22049 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:02.502340 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:02.605153 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692d6ba-8ef2-48b0-b920-a06d47c22049 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:02.642567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d5893-b513-4743-a1b5-684aefeffb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:02.643201 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d5893-b513-4743-a1b5-684aefeffb4e None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:02.643508 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d5893-b513-4743-a1b5-684aefeffb4e None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:02.643782 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d5893-b513-4743-a1b5-684aefeffb4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:02.650696 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d5893-b513-4743-a1b5-684aefeffb4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:02.652185 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d5893-b513-4743-a1b5-684aefeffb4e None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:02.663944 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-1a9d5893-b513-4743-a1b5-684aefeffb4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:05:02.663944 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:02.663944 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:02.663944 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:02.663944 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:02.663944 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:02.663944 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:02.663944 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:02.663944 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:02.663944 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:02.663944 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:02.663944 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:02.663944 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:05:02.663944 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:05:02.663944 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:05:02.665178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:05:02.665178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:02.665178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:02.665178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:02.665178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:02.665178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:02.665178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:02.665178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:02.665178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:02.665178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:02.665178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:02.665178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:02.665178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:02.665178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:02.665178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:02.665178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:02.665178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:02.666377 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:05:02.666377 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:05:02.666377 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:05:02.666377 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:05:02.666377 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:05:02.666377 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:05:02.666377 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:05:02.666377 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:05:02.666377 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 611/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:05:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:05:02.671088 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8d36a-69bc-4d54-9924-61774be11131 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:02.786988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8d36a-69bc-4d54-9924-61774be11131 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:02.825116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85feed-eb6b-48c2-b8b2-2af902e5d25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:02.825779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85feed-eb6b-48c2-b8b2-2af902e5d25c None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:02.826087 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85feed-eb6b-48c2-b8b2-2af902e5d25c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:02.826416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85feed-eb6b-48c2-b8b2-2af902e5d25c None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:02.827303 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85feed-eb6b-48c2-b8b2-2af902e5d25c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:02.827705 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85feed-eb6b-48c2-b8b2-2af902e5d25c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:02.829281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85feed-eb6b-48c2-b8b2-2af902e5d25c None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:02.843843 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 620/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:05:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:05:02.850461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d5893-b513-4743-a1b5-684aefeffb4e None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:02.920051 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:02.958845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d5893-b513-4743-a1b5-684aefeffb4e None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:02.993674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252dbf0-f388-4885-99a7-41344165eae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:02.994584 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252dbf0-f388-4885-99a7-41344165eae4 None admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:02.994894 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252dbf0-f388-4885-99a7-41344165eae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:02.995181 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252dbf0-f388-4885-99a7-41344165eae4 None admin] PATH_INFO: `/v3/projects/c854d366f35145e8b2fadb9b014d0199/users/09e495edc6fd47c892679bb908c3f5bd/roles/9b8671e5f63c4b08982273f189eab5ec` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:03.011391 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252dbf0-f388-4885-99a7-41344165eae4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c854d366f35145e8b2fadb9b014d0199, user_id=09e495edc6fd47c892679bb908c3f5bd, role_id=9b8671e5f63c4b08982273f189eab5ec)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:03.013138 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252dbf0-f388-4885-99a7-41344165eae4 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:03.027429 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 612/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 28 12:05:02 2022] PUT /identity/v3/projects/c854d366f35145e8b2fadb9b014d0199/users/09e495edc6fd47c892679bb908c3f5bd/roles/9b8671e5f63c4b08982273f189eab5ec => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:05:05.264904 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c967996-9555-44fb-bac2-5dc32c79d379 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:05.265614 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c967996-9555-44fb-bac2-5dc32c79d379 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:05.265614 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c967996-9555-44fb-bac2-5dc32c79d379 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:05.267274 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 621/1233] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:05:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:05:05.272954 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004de7b-ebe3-49a5-b321-37b302736496 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:05.273481 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004de7b-ebe3-49a5-b321-37b302736496 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:05.273481 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004de7b-ebe3-49a5-b321-37b302736496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:05.293663 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-a004de7b-ebe3-49a5-b321-37b302736496 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:05:05.294881 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-a004de7b-ebe3-49a5-b321-37b302736496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:05:05.383473 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 613/1234] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:05:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:05:05.663130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c967996-9555-44fb-bac2-5dc32c79d379 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:05.691098 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:05.775106 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c967996-9555-44fb-bac2-5dc32c79d379 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:05.809696 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab22e54-6744-44e5-a0cd-d86dbe9a1a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:05.810427 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab22e54-6744-44e5-a0cd-d86dbe9a1a21 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:05.810697 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab22e54-6744-44e5-a0cd-d86dbe9a1a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:05.811020 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab22e54-6744-44e5-a0cd-d86dbe9a1a21 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:05.823264 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab22e54-6744-44e5-a0cd-d86dbe9a1a21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:05:05.828003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-8ab22e54-6744-44e5-a0cd-d86dbe9a1a21 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:05:05.828003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:05.828003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:05.828003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:05.828003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:05.828003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:05.828003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:05.828003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:05.828003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:05.828003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:05.828003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:05.828003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:05.828003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:05:05.828003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:05:05.828003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:05:05.828003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:05:05.829870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:05:05.829870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:05:05.829870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:05:05.829870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:05:05.829870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:05.829870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:05.829870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:05.829870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:05.829870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:05.829870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:05.829870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:05.829870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:05.829870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:05.829870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:05.829870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:05.829870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:05.831041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:05.831041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:05.831041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:05.831041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:05.831041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:05:05.831041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:05:05.831041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:05:05.831041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:05:05.831041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:05:05.831041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:05:05.831041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:05:05.831041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:05:05.831041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 622/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 28 12:05:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:05:05.836143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004de7b-ebe3-49a5-b321-37b302736496 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:05.887951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:05.949755 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004de7b-ebe3-49a5-b321-37b302736496 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:05.990030 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7479d-9022-4b2b-9444-35e03370deb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:05.990738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7479d-9022-4b2b-9444-35e03370deb3 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:05.991025 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7479d-9022-4b2b-9444-35e03370deb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:05.991298 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7479d-9022-4b2b-9444-35e03370deb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:05.991996 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7479d-9022-4b2b-9444-35e03370deb3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:05.992302 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7479d-9022-4b2b-9444-35e03370deb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:05.993724 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7479d-9022-4b2b-9444-35e03370deb3 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:06.003494 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 614/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 28 12:05:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:06.009402 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab22e54-6744-44e5-a0cd-d86dbe9a1a21 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:06.101812 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:06.121589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab22e54-6744-44e5-a0cd-d86dbe9a1a21 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:06.161029 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5197dd1-7091-458e-b0de-7d6316074b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:06.161729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5197dd1-7091-458e-b0de-7d6316074b4f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:06.162010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5197dd1-7091-458e-b0de-7d6316074b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:06.162357 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5197dd1-7091-458e-b0de-7d6316074b4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:06.174708 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5197dd1-7091-458e-b0de-7d6316074b4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:06.176277 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5197dd1-7091-458e-b0de-7d6316074b4f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:06.193506 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-c5197dd1-7091-458e-b0de-7d6316074b4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:05:06.193506 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:06.193506 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:06.193506 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:06.193506 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:06.193506 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:06.193506 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:06.193506 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:06.193506 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:06.193506 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:06.193506 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:06.193506 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:06.193506 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:05:06.193506 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:05:06.193506 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:05:06.193506 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:05:06.196671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:06.196671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:06.196671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:06.196671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:06.196671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:06.196671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:06.196671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:06.196671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:06.196671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:06.196671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:06.196671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:06.196671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:06.196671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:06.196671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:06.196671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:06.196671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:06.196671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:05:06.198219 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:05:06.198219 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:05:06.198219 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:05:06.198219 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 623/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:05:06.200850 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7479d-9022-4b2b-9444-35e03370deb3 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:06.314997 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7479d-9022-4b2b-9444-35e03370deb3 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:06.324776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:06.351589 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70ea35-994d-48f1-86dd-7a37dd3472d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:06.352198 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70ea35-994d-48f1-86dd-7a37dd3472d5 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:06.352477 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70ea35-994d-48f1-86dd-7a37dd3472d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:06.352747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70ea35-994d-48f1-86dd-7a37dd3472d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:06.353384 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70ea35-994d-48f1-86dd-7a37dd3472d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:06.353689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70ea35-994d-48f1-86dd-7a37dd3472d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:06.355061 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70ea35-994d-48f1-86dd-7a37dd3472d5 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:06.373432 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 615/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:05:06.380756 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5197dd1-7091-458e-b0de-7d6316074b4f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:06.489585 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5197dd1-7091-458e-b0de-7d6316074b4f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:06.523456 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffdea9-2982-4e68-b609-f6ed05f49e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:06.524090 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffdea9-2982-4e68-b609-f6ed05f49e19 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:06.524368 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffdea9-2982-4e68-b609-f6ed05f49e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:06.524637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffdea9-2982-4e68-b609-f6ed05f49e19 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:06.527305 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:06.533194 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffdea9-2982-4e68-b609-f6ed05f49e19 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:06.534792 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffdea9-2982-4e68-b609-f6ed05f49e19 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:06.547361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-1dffdea9-2982-4e68-b609-f6ed05f49e19 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 28 12:05:06.547361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:06.547361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:06.547361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:06.547361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:06.547361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:06.547361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:06.547361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:06.547361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:06.547361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:06.547361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:06.547361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:06.547361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:05:06.547361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:05:06.547361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:05:06.547361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:05:06.549023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:06.549023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:06.549023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:05:06.549023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:05:06.549023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:05:06.549023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:05:06.549023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:06.549023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:06.549023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:06.549023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:06.549023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:06.549023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:06.549023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:06.549023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:06.549023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:06.549023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:06.549023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:06.549023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:06.550010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:06.550010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:06.550010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:05:06.550010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:05:06.550010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:05:06.550010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:05:06.550010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:05:06.550010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:05:06.550010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 28 12:05:06.550010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:05:06.550010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 624/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:05:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:05:06.555217 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70ea35-994d-48f1-86dd-7a37dd3472d5 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:06.671237 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70ea35-994d-48f1-86dd-7a37dd3472d5 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:06.712339 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80733ef2-a1e9-4499-a42b-371dcabbeeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:06.713034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80733ef2-a1e9-4499-a42b-371dcabbeeb0 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:06.713316 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80733ef2-a1e9-4499-a42b-371dcabbeeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:06.713590 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80733ef2-a1e9-4499-a42b-371dcabbeeb0 None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:06.714339 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80733ef2-a1e9-4499-a42b-371dcabbeeb0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:06.714698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80733ef2-a1e9-4499-a42b-371dcabbeeb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:06.716254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80733ef2-a1e9-4499-a42b-371dcabbeeb0 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:06.736371 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 616/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Sep 28 12:05:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:06.743122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffdea9-2982-4e68-b609-f6ed05f49e19 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:06.853420 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffdea9-2982-4e68-b609-f6ed05f49e19 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:06.890606 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c05a7-db91-4046-8092-f49be5257896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:06.891229 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c05a7-db91-4046-8092-f49be5257896 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:06.892044 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c05a7-db91-4046-8092-f49be5257896 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:06.892320 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c05a7-db91-4046-8092-f49be5257896 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:06.960723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:06.968094 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c05a7-db91-4046-8092-f49be5257896 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:06.969531 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c05a7-db91-4046-8092-f49be5257896 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:07.080236 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 625/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:05:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 28 12:05:07.086448 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80733ef2-a1e9-4499-a42b-371dcabbeeb0 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:07.116843 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:07.199698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80733ef2-a1e9-4499-a42b-371dcabbeeb0 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:07.237603 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4474c-5b70-410d-8954-e625f74af16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:07.238297 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4474c-5b70-410d-8954-e625f74af16c None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:07.238511 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4474c-5b70-410d-8954-e625f74af16c None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:07.238786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4474c-5b70-410d-8954-e625f74af16c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:07.249599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4474c-5b70-410d-8954-e625f74af16c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:07.251602 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4474c-5b70-410d-8954-e625f74af16c None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:07.267128 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-f1c4474c-5b70-410d-8954-e625f74af16c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:05:07.267128 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:07.267128 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:07.267128 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:07.267128 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:07.267128 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:07.267128 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:07.267128 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:07.267128 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:07.267128 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:07.267128 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:07.267128 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:07.267128 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:05:07.267128 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:05:07.267128 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:05:07.267128 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:05:07.268356 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:07.268356 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:07.268356 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:07.268356 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:07.268356 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:07.268356 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:07.268356 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:07.268356 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:07.268356 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:07.268356 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:07.268356 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:07.268356 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:07.268356 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:07.268356 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:07.268356 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:07.268356 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:07.268356 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:05:07.269575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:05:07.269575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:05:07.269575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:05:07.269575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 617/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:05:07.274398 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c05a7-db91-4046-8092-f49be5257896 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:07.376671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:07.385369 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c05a7-db91-4046-8092-f49be5257896 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:07.428894 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb1136-f6c2-48cc-a54f-b29dfb687e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:07.429837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb1136-f6c2-48cc-a54f-b29dfb687e31 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:07.430171 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb1136-f6c2-48cc-a54f-b29dfb687e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:07.430487 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb1136-f6c2-48cc-a54f-b29dfb687e31 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:07.431189 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb1136-f6c2-48cc-a54f-b29dfb687e31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:07.431540 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb1136-f6c2-48cc-a54f-b29dfb687e31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:07.433081 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb1136-f6c2-48cc-a54f-b29dfb687e31 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:07.447275 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 626/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:05:07.453023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4474c-5b70-410d-8954-e625f74af16c None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:07.544167 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:07.572318 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4474c-5b70-410d-8954-e625f74af16c None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:07.620127 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e8b68-44b6-4cf9-a4ad-a270d54eb8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:07.621007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e8b68-44b6-4cf9-a4ad-a270d54eb8fd None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:07.621574 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e8b68-44b6-4cf9-a4ad-a270d54eb8fd None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:07.621841 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e8b68-44b6-4cf9-a4ad-a270d54eb8fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:07.631178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e8b68-44b6-4cf9-a4ad-a270d54eb8fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:07.633247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e8b68-44b6-4cf9-a4ad-a270d54eb8fd None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:07.649110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-170e8b68-44b6-4cf9-a4ad-a270d54eb8fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:05:07.649110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:07.649110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:07.649110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:07.649110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:07.649110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:07.649110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:07.649110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:07.649110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:07.649110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:07.649110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:07.649110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:07.649110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:05:07.649110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:05:07.649110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:05:07.650224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:05:07.650224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:07.650224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:07.650224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:07.650224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:07.650224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:07.650224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:07.650224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:07.650224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:07.650224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:07.650224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:07.650224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:07.650224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:07.650224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:07.650224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:07.650224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:07.650224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:07.651521 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:05:07.651521 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:05:07.651521 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:05:07.651521 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:05:07.651521 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:05:07.651521 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:05:07.651521 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:05:07.651521 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:05:07.651521 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 618/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:05:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:05:07.657260 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb1136-f6c2-48cc-a54f-b29dfb687e31 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:07.783065 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb1136-f6c2-48cc-a54f-b29dfb687e31 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:07.819293 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872c629-ad53-47c5-ade9-4aa65c69b12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:07.819998 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872c629-ad53-47c5-ade9-4aa65c69b12b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:07.820288 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872c629-ad53-47c5-ade9-4aa65c69b12b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:07.820563 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872c629-ad53-47c5-ade9-4aa65c69b12b None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:07.821347 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872c629-ad53-47c5-ade9-4aa65c69b12b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:07.821656 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872c629-ad53-47c5-ade9-4aa65c69b12b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:07.823262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872c629-ad53-47c5-ade9-4aa65c69b12b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:07.837519 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 627/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:05:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:07.844247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e8b68-44b6-4cf9-a4ad-a270d54eb8fd None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:07.951234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e8b68-44b6-4cf9-a4ad-a270d54eb8fd None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:07.989317 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c8ce8-0e54-41a9-9d5e-c1df0f68da79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:07.989917 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c8ce8-0e54-41a9-9d5e-c1df0f68da79 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:07.990190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c8ce8-0e54-41a9-9d5e-c1df0f68da79 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:07.990459 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c8ce8-0e54-41a9-9d5e-c1df0f68da79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:07.991174 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c8ce8-0e54-41a9-9d5e-c1df0f68da79 None admin] RBAC: Adding query filter params (role.id=9b8671e5f63c4b08982273f189eab5ec, scope.project.id=c854d366f35145e8b2fadb9b014d0199, user.id=09e495edc6fd47c892679bb908c3f5bd) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:07.991505 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c8ce8-0e54-41a9-9d5e-c1df0f68da79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:07.992926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c8ce8-0e54-41a9-9d5e-c1df0f68da79 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:07.999046 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 619/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:05:07 2022] GET /identity/v3/role_assignments?user.id=09e495edc6fd47c892679bb908c3f5bd&scope.project.id=c854d366f35145e8b2fadb9b014d0199&role.id=9b8671e5f63c4b08982273f189eab5ec => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:10.318647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f0ee6-062d-44ef-8e92-0315f43717db None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:10.319281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f0ee6-062d-44ef-8e92-0315f43717db None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:10.319281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f0ee6-062d-44ef-8e92-0315f43717db None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:10.320620 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 628/1247] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:05:10.326102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e0334-bbd9-4b34-8b66-3532f74f05f2 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:10.326559 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e0334-bbd9-4b34-8b66-3532f74f05f2 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:10.326672 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e0334-bbd9-4b34-8b66-3532f74f05f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:10.333544 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:10.346803 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-123e0334-bbd9-4b34-8b66-3532f74f05f2 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:05:10.348119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-123e0334-bbd9-4b34-8b66-3532f74f05f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:05:10.426797 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 620/1248] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:05:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:05:10.709988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f0ee6-062d-44ef-8e92-0315f43717db None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:10.730271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:10.823899 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f0ee6-062d-44ef-8e92-0315f43717db None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:10.860232 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe1730-198d-4cb4-8ee7-8c4573e466af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:10.860938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe1730-198d-4cb4-8ee7-8c4573e466af None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:10.861232 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe1730-198d-4cb4-8ee7-8c4573e466af None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:10.861532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe1730-198d-4cb4-8ee7-8c4573e466af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:10.872630 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe1730-198d-4cb4-8ee7-8c4573e466af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:05:10.878010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-cdbe1730-198d-4cb4-8ee7-8c4573e466af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:05:10.878010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:10.878010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:10.878010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:10.878010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:10.878010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:10.878010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:10.878010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:10.878010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:10.878010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:10.878010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:10.878010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:10.878010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:05:10.878010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:05:10.878010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:05:10.878010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:05:10.879249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:05:10.879249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:05:10.879249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:05:10.879249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:05:10.879249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:10.879249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:10.879249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:10.879249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:10.879249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:10.879249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:10.879249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:10.879249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:10.879249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:10.879249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:10.879249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:10.879249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:10.880188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:10.880188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:10.880188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:10.880188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:10.880188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:05:10.880188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:05:10.880188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:05:10.880188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:05:10.880188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:05:10.880188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:05:10.880188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:05:10.880188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:05:10.880188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 629/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:05:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:05:10.885457 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e0334-bbd9-4b34-8b66-3532f74f05f2 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:10.990773 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e0334-bbd9-4b34-8b66-3532f74f05f2 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:11.020023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:11.025490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2342e-efdf-4ceb-9af5-a5e8cfd48f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:11.026093 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2342e-efdf-4ceb-9af5-a5e8cfd48f2d None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:11.026366 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2342e-efdf-4ceb-9af5-a5e8cfd48f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:11.026634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2342e-efdf-4ceb-9af5-a5e8cfd48f2d None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:11.027285 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2342e-efdf-4ceb-9af5-a5e8cfd48f2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:11.027614 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2342e-efdf-4ceb-9af5-a5e8cfd48f2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:11.028978 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2342e-efdf-4ceb-9af5-a5e8cfd48f2d None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:11.037809 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 621/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:05:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:11.044489 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe1730-198d-4cb4-8ee7-8c4573e466af None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:11.135647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:11.161466 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe1730-198d-4cb4-8ee7-8c4573e466af None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:11.202748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c8345-298d-4266-a084-d6731826c5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:11.203936 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c8345-298d-4266-a084-d6731826c5de None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:11.204248 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c8345-298d-4266-a084-d6731826c5de None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:11.204525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c8345-298d-4266-a084-d6731826c5de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:11.215529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c8345-298d-4266-a084-d6731826c5de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:11.216983 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c8345-298d-4266-a084-d6731826c5de None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:11.233567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-708c8345-298d-4266-a084-d6731826c5de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:05:11.233567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:11.233567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:11.233567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:11.233567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:11.233567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:11.233567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:11.233567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:11.233567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:11.233567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:11.233567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:11.233567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:11.233567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:05:11.233567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:05:11.233567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:05:11.233567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:05:11.234897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:11.234897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:11.234897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:11.234897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:11.234897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:11.234897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:11.234897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:11.234897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:11.234897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:11.234897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:11.234897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:11.234897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:11.234897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:11.234897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:11.234897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:11.234897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:11.234897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:05:11.236585 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:05:11.236585 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:05:11.236585 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:05:11.236585 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 630/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:05:11.244746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2342e-efdf-4ceb-9af5-a5e8cfd48f2d None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:11.364180 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2342e-efdf-4ceb-9af5-a5e8cfd48f2d None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:11.405620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89dc97-355c-4b57-b3cd-b45a8ec3abf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:11.406235 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89dc97-355c-4b57-b3cd-b45a8ec3abf8 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:11.406550 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89dc97-355c-4b57-b3cd-b45a8ec3abf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:11.406822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89dc97-355c-4b57-b3cd-b45a8ec3abf8 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:11.409760 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89dc97-355c-4b57-b3cd-b45a8ec3abf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:11.410091 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89dc97-355c-4b57-b3cd-b45a8ec3abf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:11.411547 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89dc97-355c-4b57-b3cd-b45a8ec3abf8 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:11.426366 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 622/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:11.432350 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c8345-298d-4266-a084-d6731826c5de None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:11.547262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c8345-298d-4266-a084-d6731826c5de None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:11.576642 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:11.585595 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b122c3-d439-46eb-ad35-ac6851f42baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:11.586379 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b122c3-d439-46eb-ad35-ac6851f42baa None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:11.586527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b122c3-d439-46eb-ad35-ac6851f42baa None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:11.586798 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b122c3-d439-46eb-ad35-ac6851f42baa None admin] PATH_INFO: `/v3/users/placement` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:11.596370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b122c3-d439-46eb-ad35-ac6851f42baa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:11.597865 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b122c3-d439-46eb-ad35-ac6851f42baa None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:11.611180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-17b122c3-d439-46eb-ad35-ac6851f42baa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 28 12:05:11.611180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:11.611180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:11.611180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:11.611180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:11.611180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:11.611180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:11.611180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:11.611180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:11.611180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:11.611180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:11.611180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:11.611180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:05:11.611180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:05:11.611180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:05:11.611180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:05:11.612332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:11.612332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:11.612332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:05:11.612332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:05:11.612332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:05:11.612332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:05:11.612332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:11.612332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:11.612332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:11.612332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:11.612332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:11.612332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:11.612332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:11.612332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:11.612332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:11.612332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:11.612332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:11.612332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:11.613323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:11.613323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:11.613323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:05:11.613323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:05:11.613323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:05:11.613323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:05:11.613323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:05:11.613323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:05:11.613323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 28 12:05:11.613323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:05:11.613323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 631/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:05:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:05:11.618493 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89dc97-355c-4b57-b3cd-b45a8ec3abf8 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:11.676662 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:11.724409 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89dc97-355c-4b57-b3cd-b45a8ec3abf8 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:11.761290 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a0d08-a010-4ec7-b5d0-f5d7714ef1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:11.761911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a0d08-a010-4ec7-b5d0-f5d7714ef1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:11.762185 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a0d08-a010-4ec7-b5d0-f5d7714ef1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:11.762448 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a0d08-a010-4ec7-b5d0-f5d7714ef1f2 None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:11.763182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a0d08-a010-4ec7-b5d0-f5d7714ef1f2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:11.763505 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a0d08-a010-4ec7-b5d0-f5d7714ef1f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:11.764949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a0d08-a010-4ec7-b5d0-f5d7714ef1f2 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:11.784232 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 623/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Sep 28 12:05:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:11.790032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b122c3-d439-46eb-ad35-ac6851f42baa None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:11.897722 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b122c3-d439-46eb-ad35-ac6851f42baa None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:11.933703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f86b4-c53c-4f16-82c1-d8c8c5e186b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:11.934324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f86b4-c53c-4f16-82c1-d8c8c5e186b3 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:11.934601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f86b4-c53c-4f16-82c1-d8c8c5e186b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:11.934871 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f86b4-c53c-4f16-82c1-d8c8c5e186b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:11.992972 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:12.006087 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f86b4-c53c-4f16-82c1-d8c8c5e186b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:12.007576 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f86b4-c53c-4f16-82c1-d8c8c5e186b3 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:12.108960 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 632/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:05:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:05:12.114912 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a0d08-a010-4ec7-b5d0-f5d7714ef1f2 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:12.221864 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a0d08-a010-4ec7-b5d0-f5d7714ef1f2 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:12.235157 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:12.256269 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dff69-f19a-460a-86a9-a0b2b9a8fc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:12.256889 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dff69-f19a-460a-86a9-a0b2b9a8fc17 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:12.257164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dff69-f19a-460a-86a9-a0b2b9a8fc17 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:12.257431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dff69-f19a-460a-86a9-a0b2b9a8fc17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:12.267652 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687dff69-f19a-460a-86a9-a0b2b9a8fc17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:12.269068 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687dff69-f19a-460a-86a9-a0b2b9a8fc17 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:12.283799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-687dff69-f19a-460a-86a9-a0b2b9a8fc17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:05:12.283799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:12.283799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:12.283799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:12.283799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:12.283799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:12.283799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:12.283799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:12.283799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:12.283799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:12.283799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:12.283799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:12.283799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:05:12.283799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:05:12.283799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:05:12.283799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:05:12.284960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:12.284960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:12.284960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:12.284960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:12.284960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:12.284960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:12.284960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:12.284960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:12.284960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:12.284960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:12.284960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:12.284960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:12.284960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:12.284960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:12.284960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:12.284960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:12.284960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:05:12.286186 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:05:12.286186 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:05:12.286186 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:05:12.286186 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 624/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:05:12.290605 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f86b4-c53c-4f16-82c1-d8c8c5e186b3 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:12.378182 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:12.392190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f86b4-c53c-4f16-82c1-d8c8c5e186b3 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:12.426775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2ed06-ad79-4f8d-a57b-68dbef752586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:12.427375 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2ed06-ad79-4f8d-a57b-68dbef752586 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:12.427678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2ed06-ad79-4f8d-a57b-68dbef752586 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:12.427949 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2ed06-ad79-4f8d-a57b-68dbef752586 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:12.428586 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2ed06-ad79-4f8d-a57b-68dbef752586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:12.428888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2ed06-ad79-4f8d-a57b-68dbef752586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:12.430258 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2ed06-ad79-4f8d-a57b-68dbef752586 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:12.441962 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 633/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:12.447618 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dff69-f19a-460a-86a9-a0b2b9a8fc17 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:12.545409 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dff69-f19a-460a-86a9-a0b2b9a8fc17 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:12.577576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6dd12-fd18-4d9a-9513-09a16800d426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:12.578181 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6dd12-fd18-4d9a-9513-09a16800d426 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:12.578455 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6dd12-fd18-4d9a-9513-09a16800d426 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:12.578721 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6dd12-fd18-4d9a-9513-09a16800d426 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:12.585995 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6dd12-fd18-4d9a-9513-09a16800d426 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:12.587416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6dd12-fd18-4d9a-9513-09a16800d426 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:12.598567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-1cc6dd12-fd18-4d9a-9513-09a16800d426 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:05:12.598567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:12.598567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:12.598567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:12.598567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:12.598567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:12.598567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:12.598567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:12.598567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:12.598567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:12.598567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:12.598567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:12.598567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:05:12.598567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:05:12.598567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:05:12.599649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:05:12.599649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:12.599649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:12.599649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:12.599649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:12.599649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:12.599649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:12.599649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:12.599649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:12.599649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:12.599649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:12.599649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:12.599649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:12.599649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:12.599649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:12.599649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:12.599649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:12.600786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:05:12.600786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:05:12.600786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:05:12.600786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:05:12.600786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:05:12.600786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:05:12.600786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:05:12.600786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:05:12.600786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 625/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:05:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:05:12.605562 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2ed06-ad79-4f8d-a57b-68dbef752586 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:12.701675 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2ed06-ad79-4f8d-a57b-68dbef752586 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:12.734715 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc66a2-858e-435b-b002-8981c8248fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:12.735841 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc66a2-858e-435b-b002-8981c8248fdc None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:12.736116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc66a2-858e-435b-b002-8981c8248fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:12.736380 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc66a2-858e-435b-b002-8981c8248fdc None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:12.737058 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc66a2-858e-435b-b002-8981c8248fdc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:12.737362 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc66a2-858e-435b-b002-8981c8248fdc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:12.738772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc66a2-858e-435b-b002-8981c8248fdc None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:12.750640 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 634/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:05:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:12.757257 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6dd12-fd18-4d9a-9513-09a16800d426 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:12.782186 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:12.854538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6dd12-fd18-4d9a-9513-09a16800d426 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:12.888240 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0469d-98ba-4571-8730-8372a02a33a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:12.888834 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0469d-98ba-4571-8730-8372a02a33a0 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:12.889112 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0469d-98ba-4571-8730-8372a02a33a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:12.889383 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0469d-98ba-4571-8730-8372a02a33a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:12.890096 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0469d-98ba-4571-8730-8372a02a33a0 None admin] RBAC: Adding query filter params (role.id=66456d39fc0c496c8f290a436b726216, scope.project.id=c854d366f35145e8b2fadb9b014d0199, user.id=09e495edc6fd47c892679bb908c3f5bd) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:12.890401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0469d-98ba-4571-8730-8372a02a33a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:12.891871 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0469d-98ba-4571-8730-8372a02a33a0 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:12.897106 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 626/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:05:12 2022] GET /identity/v3/role_assignments?user.id=09e495edc6fd47c892679bb908c3f5bd&scope.project.id=c854d366f35145e8b2fadb9b014d0199&role.id=66456d39fc0c496c8f290a436b726216 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:14.993136 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63db5a-0d91-4e89-8ed0-1b9096d2d7ac None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:14.993655 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63db5a-0d91-4e89-8ed0-1b9096d2d7ac None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:14.993655 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63db5a-0d91-4e89-8ed0-1b9096d2d7ac None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:14.995184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 635/1261] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:05:15.000357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b66a50-9693-4ca4-937a-93e1f30ab282 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:15.000776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b66a50-9693-4ca4-937a-93e1f30ab282 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:15.001466 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b66a50-9693-4ca4-937a-93e1f30ab282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:15.020055 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-95b66a50-9693-4ca4-937a-93e1f30ab282 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:05:15.021226 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-95b66a50-9693-4ca4-937a-93e1f30ab282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:05:15.087214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 627/1262] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:05:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:05:15.354960 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63db5a-0d91-4e89-8ed0-1b9096d2d7ac None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:15.366375 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:15.463318 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63db5a-0d91-4e89-8ed0-1b9096d2d7ac None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:15.496661 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba402a-8163-465e-b595-309a89f2a07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:15.497276 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba402a-8163-465e-b595-309a89f2a07a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:15.497552 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba402a-8163-465e-b595-309a89f2a07a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:15.497821 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba402a-8163-465e-b595-309a89f2a07a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:15.508208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba402a-8163-465e-b595-309a89f2a07a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:05:15.512948 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-dbba402a-8163-465e-b595-309a89f2a07a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:05:15.512948 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:15.512948 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:15.512948 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:15.512948 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:15.512948 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:15.512948 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:15.512948 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:15.512948 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:15.512948 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:15.512948 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:15.512948 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:15.512948 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:05:15.512948 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:05:15.512948 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:05:15.512948 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:05:15.514063 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:05:15.514063 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:05:15.514063 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:05:15.514063 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:05:15.514063 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:15.514063 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:15.514063 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:15.514063 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:15.514063 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:15.514063 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:15.514063 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:15.514063 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:15.514063 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:15.514063 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:15.514063 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:15.514063 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:15.515059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:15.515059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:15.515059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:15.515059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:15.515059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:05:15.515059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:05:15.515059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:05:15.515059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:05:15.515059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:05:15.515059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:05:15.515059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:05:15.515059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:05:15.515059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 636/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:05:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:05:15.520807 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b66a50-9693-4ca4-937a-93e1f30ab282 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:15.538469 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:15.616183 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b66a50-9693-4ca4-937a-93e1f30ab282 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:15.649206 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a657e-7c43-4ad2-9ad8-f87e58e15bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:15.649792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a657e-7c43-4ad2-9ad8-f87e58e15bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:15.650068 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a657e-7c43-4ad2-9ad8-f87e58e15bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:15.650336 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a657e-7c43-4ad2-9ad8-f87e58e15bb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:15.650986 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a657e-7c43-4ad2-9ad8-f87e58e15bb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:15.651283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a657e-7c43-4ad2-9ad8-f87e58e15bb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:15.652663 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a657e-7c43-4ad2-9ad8-f87e58e15bb3 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:15.660954 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 628/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:05:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:15.666487 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba402a-8163-465e-b595-309a89f2a07a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:15.732830 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:15.765170 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba402a-8163-465e-b595-309a89f2a07a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:15.798757 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c0626-8e5a-467d-ae3b-835c8d1a5b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:15.799379 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c0626-8e5a-467d-ae3b-835c8d1a5b1f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:15.799684 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c0626-8e5a-467d-ae3b-835c8d1a5b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:15.799963 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c0626-8e5a-467d-ae3b-835c8d1a5b1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:15.809733 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c0626-8e5a-467d-ae3b-835c8d1a5b1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:15.811174 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c0626-8e5a-467d-ae3b-835c8d1a5b1f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:15.827313 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-724c0626-8e5a-467d-ae3b-835c8d1a5b1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:05:15.827313 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:15.827313 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:15.827313 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:15.827313 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:15.827313 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:15.827313 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:15.827313 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:15.827313 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:15.827313 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:15.827313 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:15.827313 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:15.827313 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:05:15.827313 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:05:15.827313 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:05:15.827313 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:05:15.828592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:15.828592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:15.828592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:15.828592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:15.828592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:15.828592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:15.828592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:15.828592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:15.828592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:15.828592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:15.828592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:15.828592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:15.828592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:15.828592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:15.828592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:15.828592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:15.828592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:05:15.830157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:05:15.830157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:05:15.830157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:05:15.830157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 637/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:05:15.835585 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a657e-7c43-4ad2-9ad8-f87e58e15bb3 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:15.915275 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:15.933900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a657e-7c43-4ad2-9ad8-f87e58e15bb3 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:15.966888 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce623f56-2240-4fe0-829c-06ba2c1d18ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:15.967508 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce623f56-2240-4fe0-829c-06ba2c1d18ed None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:15.967789 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce623f56-2240-4fe0-829c-06ba2c1d18ed None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:15.968060 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce623f56-2240-4fe0-829c-06ba2c1d18ed None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:15.968688 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce623f56-2240-4fe0-829c-06ba2c1d18ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:15.968990 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce623f56-2240-4fe0-829c-06ba2c1d18ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:15.970911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce623f56-2240-4fe0-829c-06ba2c1d18ed None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:15.982264 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 629/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:15.988126 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c0626-8e5a-467d-ae3b-835c8d1a5b1f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:16.085132 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c0626-8e5a-467d-ae3b-835c8d1a5b1f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:16.104390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:16.118286 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f5d2d-a13a-45ae-943e-0724ba117c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:16.118903 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f5d2d-a13a-45ae-943e-0724ba117c91 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:16.119459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f5d2d-a13a-45ae-943e-0724ba117c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:16.119731 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f5d2d-a13a-45ae-943e-0724ba117c91 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:16.127529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f5d2d-a13a-45ae-943e-0724ba117c91 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:16.128962 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f5d2d-a13a-45ae-943e-0724ba117c91 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:16.139729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-ca8f5d2d-a13a-45ae-943e-0724ba117c91 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 28 12:05:16.139729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:16.139729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:16.139729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:16.139729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:16.139729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:16.139729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:16.139729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:16.139729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:16.139729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:16.139729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:16.139729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:16.139729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:05:16.139729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:05:16.139729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:05:16.139729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:05:16.140875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:16.140875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:16.140875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:05:16.140875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:05:16.140875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:05:16.140875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:05:16.140875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:16.140875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:16.140875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:16.140875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:16.140875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:16.140875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:16.140875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:16.140875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:16.140875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:16.140875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:16.140875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:16.140875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:16.142624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:16.142624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:16.142624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:05:16.142624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:05:16.142624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:05:16.142624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:05:16.142624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:05:16.142624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:05:16.142624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 28 12:05:16.142624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:05:16.142624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 638/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:05:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:05:16.147347 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce623f56-2240-4fe0-829c-06ba2c1d18ed None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:16.248591 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce623f56-2240-4fe0-829c-06ba2c1d18ed None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:16.281990 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac270c3-d799-4d1c-b4f3-5b124a051e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:16.282605 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac270c3-d799-4d1c-b4f3-5b124a051e5e None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:16.282895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac270c3-d799-4d1c-b4f3-5b124a051e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:16.283161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac270c3-d799-4d1c-b4f3-5b124a051e5e None admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:16.283904 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac270c3-d799-4d1c-b4f3-5b124a051e5e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:16.284208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac270c3-d799-4d1c-b4f3-5b124a051e5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:16.285629 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac270c3-d799-4d1c-b4f3-5b124a051e5e None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:16.294064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:16.302613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 630/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Sep 28 12:05:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:16.308496 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f5d2d-a13a-45ae-943e-0724ba117c91 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:16.409942 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f5d2d-a13a-45ae-943e-0724ba117c91 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:16.442392 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813db2b9-f96f-4866-b649-38a2fb0fba8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:16.443009 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813db2b9-f96f-4866-b649-38a2fb0fba8e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:16.443292 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813db2b9-f96f-4866-b649-38a2fb0fba8e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:16.443595 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813db2b9-f96f-4866-b649-38a2fb0fba8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:16.453767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813db2b9-f96f-4866-b649-38a2fb0fba8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:16.455818 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813db2b9-f96f-4866-b649-38a2fb0fba8e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:16.471678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-813db2b9-f96f-4866-b649-38a2fb0fba8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:05:16.471678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:16.471678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:16.471678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:16.471678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:16.471678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:16.471678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:16.471678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:16.471678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:16.471678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:16.471678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:16.471678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:16.471678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:05:16.471678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:05:16.471678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:05:16.471678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:05:16.472901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:16.472901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:16.472901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:16.472901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:16.472901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:16.472901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:16.472901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:16.472901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:16.472901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:16.472901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:16.472901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:16.472901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:16.472901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:16.472901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:16.472901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:16.472901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:16.472901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:05:16.473981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:05:16.473981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:05:16.473981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:05:16.473981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 639/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:05:16.478330 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac270c3-d799-4d1c-b4f3-5b124a051e5e None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:16.576273 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac270c3-d799-4d1c-b4f3-5b124a051e5e None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:16.608713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978890d1-7e39-4716-bf7f-9f603cb3936d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:16.609317 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978890d1-7e39-4716-bf7f-9f603cb3936d None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:16.609593 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978890d1-7e39-4716-bf7f-9f603cb3936d None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:16.609863 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978890d1-7e39-4716-bf7f-9f603cb3936d None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:16.610986 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978890d1-7e39-4716-bf7f-9f603cb3936d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:16.611286 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978890d1-7e39-4716-bf7f-9f603cb3936d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:16.612669 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978890d1-7e39-4716-bf7f-9f603cb3936d None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:16.623808 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 631/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:16.630188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813db2b9-f96f-4866-b649-38a2fb0fba8e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:16.660904 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:16.728158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813db2b9-f96f-4866-b649-38a2fb0fba8e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:16.761637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982174a-de2f-47a7-b7f5-98ac435d7712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:16.762257 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982174a-de2f-47a7-b7f5-98ac435d7712 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:16.762535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982174a-de2f-47a7-b7f5-98ac435d7712 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:16.762809 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982174a-de2f-47a7-b7f5-98ac435d7712 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:16.769310 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982174a-de2f-47a7-b7f5-98ac435d7712 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:16.770734 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982174a-de2f-47a7-b7f5-98ac435d7712 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:16.781915 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-1982174a-de2f-47a7-b7f5-98ac435d7712 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:05:16.781915 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:16.781915 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:16.781915 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:16.781915 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:16.781915 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:16.781915 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:16.781915 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:16.781915 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:16.781915 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:16.781915 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:16.781915 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:16.781915 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:05:16.781915 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:05:16.781915 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:05:16.783035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:05:16.783035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:16.783035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:16.783035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:16.783035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:16.783035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:16.783035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:16.783035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:16.783035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:16.783035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:16.783035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:16.783035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:16.783035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:16.783035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:16.783035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:16.783035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:16.783035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:16.784381 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:05:16.784381 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:05:16.784381 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:05:16.784381 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:05:16.784381 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:05:16.784381 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:05:16.784381 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:05:16.784381 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:05:16.784381 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 640/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:05:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:05:16.789112 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978890d1-7e39-4716-bf7f-9f603cb3936d None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:16.848858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:16.889359 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978890d1-7e39-4716-bf7f-9f603cb3936d None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:16.921665 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118aff0e-d2d5-488f-bc71-80f77cdc867d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:16.922251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118aff0e-d2d5-488f-bc71-80f77cdc867d None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:16.922523 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118aff0e-d2d5-488f-bc71-80f77cdc867d None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:16.923363 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118aff0e-d2d5-488f-bc71-80f77cdc867d None admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:16.924071 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118aff0e-d2d5-488f-bc71-80f77cdc867d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:16.924371 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118aff0e-d2d5-488f-bc71-80f77cdc867d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:16.925779 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118aff0e-d2d5-488f-bc71-80f77cdc867d None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:16.937320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 632/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:05:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:05:16.943418 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982174a-de2f-47a7-b7f5-98ac435d7712 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:17.032766 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:17.041433 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982174a-de2f-47a7-b7f5-98ac435d7712 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:17.073907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb8af0-f89e-45a6-a0c0-4e1ffdbc7db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:17.074546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb8af0-f89e-45a6-a0c0-4e1ffdbc7db5 None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:17.074828 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb8af0-f89e-45a6-a0c0-4e1ffdbc7db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:17.075105 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb8af0-f89e-45a6-a0c0-4e1ffdbc7db5 None admin] PATH_INFO: `/v3/projects/c854d366f35145e8b2fadb9b014d0199/users/09e495edc6fd47c892679bb908c3f5bd/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:17.077012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb8af0-f89e-45a6-a0c0-4e1ffdbc7db5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c854d366f35145e8b2fadb9b014d0199, user_id=09e495edc6fd47c892679bb908c3f5bd, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:17.078437 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb8af0-f89e-45a6-a0c0-4e1ffdbc7db5 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:17.091605 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 641/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 28 12:05:16 2022] PUT /identity/v3/projects/c854d366f35145e8b2fadb9b014d0199/users/09e495edc6fd47c892679bb908c3f5bd/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:05:19.203076 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2438e-f94e-4cc0-83c9-b31d7f3f40ed None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:19.203634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2438e-f94e-4cc0-83c9-b31d7f3f40ed None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:19.203634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2438e-f94e-4cc0-83c9-b31d7f3f40ed None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:19.205091 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 633/1274] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:05:19.210196 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd3afd-9441-4167-8015-27663bba353f None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:19.210686 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd3afd-9441-4167-8015-27663bba353f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:19.210776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd3afd-9441-4167-8015-27663bba353f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:19.229718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-79bd3afd-9441-4167-8015-27663bba353f None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:05:19.230892 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-79bd3afd-9441-4167-8015-27663bba353f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:05:19.295148 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 642/1275] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:05:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:05:19.559875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2438e-f94e-4cc0-83c9-b31d7f3f40ed None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:19.657738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2438e-f94e-4cc0-83c9-b31d7f3f40ed None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:19.674639 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:19.691561 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f8cb6-50cb-42f4-b05e-10720edff75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:19.692175 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f8cb6-50cb-42f4-b05e-10720edff75f None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:19.692447 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f8cb6-50cb-42f4-b05e-10720edff75f None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:19.692712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f8cb6-50cb-42f4-b05e-10720edff75f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:19.702506 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f8cb6-50cb-42f4-b05e-10720edff75f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:05:19.707260 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-132f8cb6-50cb-42f4-b05e-10720edff75f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:05:19.707260 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:19.707260 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:19.707260 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:19.707260 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:19.707260 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:19.707260 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:19.707260 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:19.707260 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:19.707260 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:19.707260 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:19.707260 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:19.707260 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:05:19.707260 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:05:19.707260 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:05:19.707260 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:05:19.708416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:05:19.708416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:05:19.708416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:05:19.708416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:05:19.708416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:19.708416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:19.708416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:19.708416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:19.708416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:19.708416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:19.708416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:19.708416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:19.708416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:19.708416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:19.708416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:19.708416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:19.709511 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:19.709511 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:19.709511 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:19.709511 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:19.709511 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:05:19.709511 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:05:19.709511 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:05:19.709511 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:05:19.709511 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:05:19.709511 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:05:19.709511 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:05:19.709511 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:05:19.709511 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 634/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 28 12:05:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:05:19.714263 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd3afd-9441-4167-8015-27663bba353f None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:19.792201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:19.810836 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd3afd-9441-4167-8015-27663bba353f None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:19.843238 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd2b17-0f29-40e2-871c-0756eecb3937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:19.843855 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd2b17-0f29-40e2-871c-0756eecb3937 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:19.844129 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd2b17-0f29-40e2-871c-0756eecb3937 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:19.844394 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd2b17-0f29-40e2-871c-0756eecb3937 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:19.845564 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd2b17-0f29-40e2-871c-0756eecb3937 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:19.845859 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd2b17-0f29-40e2-871c-0756eecb3937 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:19.847215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd2b17-0f29-40e2-871c-0756eecb3937 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:19.854915 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 643/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 28 12:05:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:19.861291 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f8cb6-50cb-42f4-b05e-10720edff75f None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:19.957167 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f8cb6-50cb-42f4-b05e-10720edff75f None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:19.990143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cecf05c-7fae-4ea7-8cfd-5f1dbbc434fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:19.990746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cecf05c-7fae-4ea7-8cfd-5f1dbbc434fa None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:19.991021 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cecf05c-7fae-4ea7-8cfd-5f1dbbc434fa None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:19.991290 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cecf05c-7fae-4ea7-8cfd-5f1dbbc434fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:20.001247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cecf05c-7fae-4ea7-8cfd-5f1dbbc434fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:20.002669 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cecf05c-7fae-4ea7-8cfd-5f1dbbc434fa None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:20.016708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-2cecf05c-7fae-4ea7-8cfd-5f1dbbc434fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:05:20.016708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:20.016708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:20.016708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:20.016708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:20.016708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:20.016708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:20.016708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:20.016708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:20.016708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:20.016708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:20.016708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:20.016708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:05:20.016708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:05:20.016708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:05:20.016708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:05:20.017924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:20.017924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:20.017924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:20.017924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:20.017924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:20.017924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:20.017924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:20.017924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:20.017924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:20.017924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:20.017924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:20.017924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:20.017924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:20.017924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:20.017924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:20.017924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:20.017924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:05:20.019094 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:05:20.019094 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:05:20.019094 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:05:20.019094 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 635/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:05:20.023369 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd2b17-0f29-40e2-871c-0756eecb3937 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:20.121530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd2b17-0f29-40e2-871c-0756eecb3937 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:20.153001 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b7436-e5ef-495c-ac32-ae670a98c975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:20.153596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b7436-e5ef-495c-ac32-ae670a98c975 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:20.153870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b7436-e5ef-495c-ac32-ae670a98c975 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:20.154138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b7436-e5ef-495c-ac32-ae670a98c975 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:20.154767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b7436-e5ef-495c-ac32-ae670a98c975 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:20.155064 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b7436-e5ef-495c-ac32-ae670a98c975 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:20.156432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b7436-e5ef-495c-ac32-ae670a98c975 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:20.168166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 644/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:20.174322 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cecf05c-7fae-4ea7-8cfd-5f1dbbc434fa None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:20.204639 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:20.277650 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cecf05c-7fae-4ea7-8cfd-5f1dbbc434fa None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:20.310340 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb704c85-a8b4-418f-b919-4bf185a46e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:20.310955 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb704c85-a8b4-418f-b919-4bf185a46e96 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:20.311236 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb704c85-a8b4-418f-b919-4bf185a46e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:20.311535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb704c85-a8b4-418f-b919-4bf185a46e96 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:20.318738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb704c85-a8b4-418f-b919-4bf185a46e96 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:20.320217 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb704c85-a8b4-418f-b919-4bf185a46e96 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:20.331725 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-cb704c85-a8b4-418f-b919-4bf185a46e96 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 28 12:05:20.331725 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:20.331725 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:20.331725 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:20.331725 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:20.331725 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:20.331725 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:20.331725 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:20.331725 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:20.331725 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:20.331725 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:20.331725 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:20.331725 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:05:20.331725 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:05:20.331725 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:05:20.331725 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:05:20.332845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:20.332845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:20.332845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:05:20.332845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:05:20.332845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:05:20.332845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:05:20.332845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:20.332845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:20.332845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:20.332845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:20.332845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:20.332845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:20.332845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:20.332845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:20.332845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:20.332845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:20.332845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:20.332845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:20.334046 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:20.334046 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:20.334046 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:05:20.334046 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:05:20.334046 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:05:20.334046 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:05:20.334046 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:05:20.334046 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:05:20.334046 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 28 12:05:20.334046 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:05:20.334046 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 636/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:05:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:05:20.338511 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b7436-e5ef-495c-ac32-ae670a98c975 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:20.342231 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:20.438813 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b7436-e5ef-495c-ac32-ae670a98c975 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:20.473314 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9c547-ebb3-497d-acf6-851778e4f388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:20.473912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9c547-ebb3-497d-acf6-851778e4f388 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:20.474189 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9c547-ebb3-497d-acf6-851778e4f388 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:20.474458 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9c547-ebb3-497d-acf6-851778e4f388 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:20.475177 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9c547-ebb3-497d-acf6-851778e4f388 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:20.475523 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9c547-ebb3-497d-acf6-851778e4f388 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:20.476946 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9c547-ebb3-497d-acf6-851778e4f388 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:20.493273 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 645/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Sep 28 12:05:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:20.499282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb704c85-a8b4-418f-b919-4bf185a46e96 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:20.591272 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:20.602085 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb704c85-a8b4-418f-b919-4bf185a46e96 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:20.634530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266f533-c44e-4a01-8da6-9099793434d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:20.635121 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266f533-c44e-4a01-8da6-9099793434d8 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:20.635395 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266f533-c44e-4a01-8da6-9099793434d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:20.635700 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266f533-c44e-4a01-8da6-9099793434d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:20.699600 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266f533-c44e-4a01-8da6-9099793434d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:20.700961 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266f533-c44e-4a01-8da6-9099793434d8 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:20.787151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:20.797474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 637/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 28 12:05:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:05:20.803236 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9c547-ebb3-497d-acf6-851778e4f388 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:20.861966 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:20.899275 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9c547-ebb3-497d-acf6-851778e4f388 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:20.931144 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c29636-59f9-4af7-82b8-52ed70600702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:20.931780 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c29636-59f9-4af7-82b8-52ed70600702 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:20.932056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c29636-59f9-4af7-82b8-52ed70600702 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:20.932324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c29636-59f9-4af7-82b8-52ed70600702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:20.942411 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c29636-59f9-4af7-82b8-52ed70600702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:20.943866 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c29636-59f9-4af7-82b8-52ed70600702 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:20.958659 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-f8c29636-59f9-4af7-82b8-52ed70600702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:05:20.958659 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:20.958659 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:20.958659 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:20.958659 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:20.958659 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:20.958659 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:20.958659 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:20.958659 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:20.958659 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:20.958659 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:20.958659 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:20.958659 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:05:20.958659 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:05:20.958659 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:05:20.958659 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:05:20.963634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:20.963634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:20.963634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:20.963634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:20.963634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:20.963634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:20.963634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:20.963634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:20.963634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:20.963634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:20.963634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:20.963634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:20.963634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:20.963634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:20.963634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:20.963634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:20.963634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:05:20.964854 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:05:20.964854 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:05:20.964854 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:05:20.964854 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 646/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:05:20.965280 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266f533-c44e-4a01-8da6-9099793434d8 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:21.065073 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266f533-c44e-4a01-8da6-9099793434d8 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:21.097776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062fcba-424b-4888-afe9-dc16d1d4f181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:21.098367 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062fcba-424b-4888-afe9-dc16d1d4f181 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:21.098646 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062fcba-424b-4888-afe9-dc16d1d4f181 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:21.098917 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062fcba-424b-4888-afe9-dc16d1d4f181 None admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:21.099578 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062fcba-424b-4888-afe9-dc16d1d4f181 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:21.099882 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062fcba-424b-4888-afe9-dc16d1d4f181 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:21.101243 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062fcba-424b-4888-afe9-dc16d1d4f181 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:21.112738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 638/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 28 12:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:21.118282 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c29636-59f9-4af7-82b8-52ed70600702 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:21.213904 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c29636-59f9-4af7-82b8-52ed70600702 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:21.226710 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:21.247452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557afa54-d2e9-4773-b328-421992e1bd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:21.248076 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557afa54-d2e9-4773-b328-421992e1bd1f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:21.248352 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557afa54-d2e9-4773-b328-421992e1bd1f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:21.248621 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557afa54-d2e9-4773-b328-421992e1bd1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:21.255618 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557afa54-d2e9-4773-b328-421992e1bd1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:21.257051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557afa54-d2e9-4773-b328-421992e1bd1f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:21.268051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-557afa54-d2e9-4773-b328-421992e1bd1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:05:21.268051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:21.268051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:21.268051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:21.268051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:21.268051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:21.268051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:21.268051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:21.268051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:21.268051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:21.268051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:21.268051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:21.268051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:05:21.268051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:05:21.268051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:05:21.269130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:05:21.269130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:21.269130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:21.269130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:21.269130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:21.269130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:21.269130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:21.269130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:21.269130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:21.269130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:21.269130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:21.269130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:21.269130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:21.269130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:21.269130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:21.269130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:21.269130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:21.270259 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:05:21.270259 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:05:21.270259 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:05:21.270259 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:05:21.270259 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:05:21.270259 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:05:21.270259 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:05:21.270259 dv-cinder-859193-2-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Sep 28 12:05:21.270259 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 647/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 28 12:05:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:05:21.274770 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062fcba-424b-4888-afe9-dc16d1d4f181 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:21.323584 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:21.375284 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062fcba-424b-4888-afe9-dc16d1d4f181 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:21.408150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7148f9-72be-45dd-8e1d-f8655c99bb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:21.408734 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7148f9-72be-45dd-8e1d-f8655c99bb8b None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:21.409005 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7148f9-72be-45dd-8e1d-f8655c99bb8b None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:21.409270 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7148f9-72be-45dd-8e1d-f8655c99bb8b None admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:21.409943 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7148f9-72be-45dd-8e1d-f8655c99bb8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:21.410243 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7148f9-72be-45dd-8e1d-f8655c99bb8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:21.411716 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7148f9-72be-45dd-8e1d-f8655c99bb8b None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:21.423809 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 639/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 28 12:05:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:21.429780 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557afa54-d2e9-4773-b328-421992e1bd1f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:21.525150 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557afa54-d2e9-4773-b328-421992e1bd1f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:21.558022 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5488dc-d4ff-4002-a791-4beddfdf641f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:21.558600 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5488dc-d4ff-4002-a791-4beddfdf641f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:21.558877 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5488dc-d4ff-4002-a791-4beddfdf641f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:21.559143 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5488dc-d4ff-4002-a791-4beddfdf641f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:21.559875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5488dc-d4ff-4002-a791-4beddfdf641f None admin] RBAC: Adding query filter params (role.id=66456d39fc0c496c8f290a436b726216, scope.project.id=c854d366f35145e8b2fadb9b014d0199, user.id=09e495edc6fd47c892679bb908c3f5bd) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:21.560177 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5488dc-d4ff-4002-a791-4beddfdf641f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:21.561574 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5488dc-d4ff-4002-a791-4beddfdf641f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:21.567461 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 648/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 28 12:05:21 2022] GET /identity/v3/role_assignments?user.id=09e495edc6fd47c892679bb908c3f5bd&scope.project.id=c854d366f35145e8b2fadb9b014d0199&role.id=66456d39fc0c496c8f290a436b726216 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:23.724888 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75106401-d0b0-4e5a-a1c4-4f7c4ce9cd9e None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:23.725310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75106401-d0b0-4e5a-a1c4-4f7c4ce9cd9e None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:23.725415 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75106401-d0b0-4e5a-a1c4-4f7c4ce9cd9e None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:23.726747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 640/1288] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:05:23.732129 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155aef4a-f167-4e29-9f88-e29248024470 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:23.732576 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155aef4a-f167-4e29-9f88-e29248024470 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:23.732670 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155aef4a-f167-4e29-9f88-e29248024470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:23.751479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-155aef4a-f167-4e29-9f88-e29248024470 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:05:23.752670 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-155aef4a-f167-4e29-9f88-e29248024470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:05:23.781093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:23.818089 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 649/1289] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:05:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:05:24.081443 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75106401-d0b0-4e5a-a1c4-4f7c4ce9cd9e None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:24.179631 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75106401-d0b0-4e5a-a1c4-4f7c4ce9cd9e None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:24.190461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:24.213452 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4378e0-1f64-4d4e-bdc5-9087ec438054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:24.214061 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4378e0-1f64-4d4e-bdc5-9087ec438054 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:24.214334 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4378e0-1f64-4d4e-bdc5-9087ec438054 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:24.214601 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4378e0-1f64-4d4e-bdc5-9087ec438054 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:24.215170 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4378e0-1f64-4d4e-bdc5-9087ec438054 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:24.216552 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4378e0-1f64-4d4e-bdc5-9087ec438054 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:24.225102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-7d4378e0-1f64-4d4e-bdc5-9087ec438054 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 28 12:05:24.225102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:24.225102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:05:24.225102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:05:24.225102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:05:24.225102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:05:24.225102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:05:24.225102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:05:24.225102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 28 12:05:24.225102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:05:24.225102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:05:24.225102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:05:24.225102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:24.225102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:24.225102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:24.225102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:24.225102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:24.226358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:24.226358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:24.226358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:24.226358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:24.226358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:24.226358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:24.226358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:05:24.226358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:05:24.226358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:05:24.226358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:05:24.226358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:24.226358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:24.226358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:24.226358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:24.226358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:24.226358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:24.227467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:24.227467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:24.227467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:24.227467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:24.227467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:24.227467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:24.227467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:24.227467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:24.227467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:24.227467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:24.227467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:05:24.227467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:05:24.227467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 28 12:05:24.227467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:05:24.227467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 641/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 28 12:05:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:05:24.232209 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155aef4a-f167-4e29-9f88-e29248024470 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:24.329425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155aef4a-f167-4e29-9f88-e29248024470 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:24.362911 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d14f4-29c9-4835-93b5-9d92c43cb27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:24.363538 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d14f4-29c9-4835-93b5-9d92c43cb27f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:24.363860 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d14f4-29c9-4835-93b5-9d92c43cb27f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:24.364131 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d14f4-29c9-4835-93b5-9d92c43cb27f None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:24.364810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d14f4-29c9-4835-93b5-9d92c43cb27f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:24.365131 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d14f4-29c9-4835-93b5-9d92c43cb27f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:24.366548 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d14f4-29c9-4835-93b5-9d92c43cb27f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:24.372406 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 650/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Sep 28 12:05:24 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:24.378788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4378e0-1f64-4d4e-bdc5-9087ec438054 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:24.487786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4378e0-1f64-4d4e-bdc5-9087ec438054 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:24.519830 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01776ac-51d1-43ec-b536-b339fec365b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:24.520423 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01776ac-51d1-43ec-b536-b339fec365b5 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:24.520699 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01776ac-51d1-43ec-b536-b339fec365b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:24.520967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01776ac-51d1-43ec-b536-b339fec365b5 None admin] PATH_INFO: `/v3/services` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:24.521588 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01776ac-51d1-43ec-b536-b339fec365b5 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:24.521888 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01776ac-51d1-43ec-b536-b339fec365b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:24.523240 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01776ac-51d1-43ec-b536-b339fec365b5 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:24.527522 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 642/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Sep 28 12:05:24 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:26.646676 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d6990-6286-44f8-9cc2-5566cca0baba None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:26.647280 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d6990-6286-44f8-9cc2-5566cca0baba None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:26.647280 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d6990-6286-44f8-9cc2-5566cca0baba None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:26.648653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 651/1293] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:05:26.653869 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620ed6c-dadb-4323-9e51-bd3d8b2455b1 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:26.654241 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620ed6c-dadb-4323-9e51-bd3d8b2455b1 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:26.654420 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620ed6c-dadb-4323-9e51-bd3d8b2455b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:26.673293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-2620ed6c-dadb-4323-9e51-bd3d8b2455b1 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:05:26.674484 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-2620ed6c-dadb-4323-9e51-bd3d8b2455b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:05:26.703122 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:26.741610 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 643/1294] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:05:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:05:27.006373 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d6990-6286-44f8-9cc2-5566cca0baba None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:27.037675 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:27.106197 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d6990-6286-44f8-9cc2-5566cca0baba None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:27.139069 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc500688-3909-421c-8369-2064cd94c644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:27.139688 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc500688-3909-421c-8369-2064cd94c644 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:27.139963 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc500688-3909-421c-8369-2064cd94c644 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:27.140229 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc500688-3909-421c-8369-2064cd94c644 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:27.140876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc500688-3909-421c-8369-2064cd94c644 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:27.142765 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc500688-3909-421c-8369-2064cd94c644 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:27.156638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 652/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 28 12:05:27 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:05:29.284428 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70db34-8c44-4549-adcf-bbea7138968a None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:29.284951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70db34-8c44-4549-adcf-bbea7138968a None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:29.284951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70db34-8c44-4549-adcf-bbea7138968a None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:29.286304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 644/1296] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:05:29.291489 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf605850-d294-4db7-80b3-04092a980cba None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:29.291995 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf605850-d294-4db7-80b3-04092a980cba None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:29.292097 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf605850-d294-4db7-80b3-04092a980cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:29.310931 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-cf605850-d294-4db7-80b3-04092a980cba None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:05:29.312155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-cf605850-d294-4db7-80b3-04092a980cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:05:29.390466 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 653/1297] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:05:29 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:05:29.658566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70db34-8c44-4549-adcf-bbea7138968a None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:29.759456 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70db34-8c44-4549-adcf-bbea7138968a None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:29.792330 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5780c-1704-4799-8ce9-3579ba45aa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:29.792948 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5780c-1704-4799-8ce9-3579ba45aa75 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:29.793228 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5780c-1704-4799-8ce9-3579ba45aa75 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:29.793502 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5780c-1704-4799-8ce9-3579ba45aa75 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:29.794083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5780c-1704-4799-8ce9-3579ba45aa75 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:29.795466 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5780c-1704-4799-8ce9-3579ba45aa75 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:29.804561 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-d4f5780c-1704-4799-8ce9-3579ba45aa75 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 28 12:05:29.804561 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:29.804561 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:05:29.804561 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:05:29.804561 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:05:29.804561 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:05:29.804561 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:05:29.804561 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:05:29.804561 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 28 12:05:29.804561 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:05:29.804561 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:05:29.804561 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:05:29.804561 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:29.804561 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:29.804561 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:29.804561 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:29.804561 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:29.805758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:29.805758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:29.805758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:29.805758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:29.805758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:29.805758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:29.805758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:05:29.805758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:05:29.805758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:05:29.805758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:05:29.805758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:29.805758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:29.805758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:29.805758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:29.805758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:29.805758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:29.807034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:29.807034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:29.807034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:29.807034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:29.807034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:29.807034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:29.807034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:29.807034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:29.807034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:29.807034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:29.807034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:05:29.807034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:05:29.807034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 28 12:05:29.807034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:05:29.807034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 645/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 28 12:05:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:05:29.811561 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf605850-d294-4db7-80b3-04092a980cba None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:29.829331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:29.908648 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf605850-d294-4db7-80b3-04092a980cba None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:29.941190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79815bbc-18e4-4f7c-ab23-1733934ab36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:29.941791 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79815bbc-18e4-4f7c-ab23-1733934ab36f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:29.942069 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79815bbc-18e4-4f7c-ab23-1733934ab36f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:29.942338 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79815bbc-18e4-4f7c-ab23-1733934ab36f None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:29.942952 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79815bbc-18e4-4f7c-ab23-1733934ab36f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:29.943250 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79815bbc-18e4-4f7c-ab23-1733934ab36f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:29.944634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79815bbc-18e4-4f7c-ab23-1733934ab36f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:29.949566 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 654/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Sep 28 12:05:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:29.955900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5780c-1704-4799-8ce9-3579ba45aa75 None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:29.987139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:30.054214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5780c-1704-4799-8ce9-3579ba45aa75 None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:30.087037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812158b8-0462-422d-8bfa-39e5c54a3f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:30.087714 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812158b8-0462-422d-8bfa-39e5c54a3f96 None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:30.087997 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812158b8-0462-422d-8bfa-39e5c54a3f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:30.088272 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812158b8-0462-422d-8bfa-39e5c54a3f96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:30.088967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812158b8-0462-422d-8bfa-39e5c54a3f96 None admin] RBAC: Adding query filter params (interface=public, service_id=73806c63c984485b9328f9cf20805770, region_id=RegionOne) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:30.089277 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812158b8-0462-422d-8bfa-39e5c54a3f96 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:30.090635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812158b8-0462-422d-8bfa-39e5c54a3f96 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:30.095602 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 646/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Sep 28 12:05:29 2022] GET /identity/v3/endpoints?service_id=73806c63c984485b9328f9cf20805770&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:30.101077 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79815bbc-18e4-4f7c-ab23-1733934ab36f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:30.185588 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:30.204401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79815bbc-18e4-4f7c-ab23-1733934ab36f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:30.237570 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272f82f-e5ac-477e-aa23-8546edebced2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:30.238162 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272f82f-e5ac-477e-aa23-8546edebced2 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:30.238441 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272f82f-e5ac-477e-aa23-8546edebced2 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:30.238715 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272f82f-e5ac-477e-aa23-8546edebced2 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:30.239314 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272f82f-e5ac-477e-aa23-8546edebced2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:30.240704 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272f82f-e5ac-477e-aa23-8546edebced2 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:30.247612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 655/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Sep 28 12:05:30 2022] GET /identity/v3/services => generated 2191 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:05:32.396137 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcb125-fab3-4cf1-b79b-b3e1b039590f None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:32.396703 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcb125-fab3-4cf1-b79b-b3e1b039590f None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:32.396703 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcb125-fab3-4cf1-b79b-b3e1b039590f None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:32.398006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 647/1302] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:05:32.403191 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff71fa1-7efa-465a-87b9-c0a0260ba1a5 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:32.403641 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff71fa1-7efa-465a-87b9-c0a0260ba1a5 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:32.403753 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff71fa1-7efa-465a-87b9-c0a0260ba1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:32.422008 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-2ff71fa1-7efa-465a-87b9-c0a0260ba1a5 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:05:32.423274 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-2ff71fa1-7efa-465a-87b9-c0a0260ba1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:05:32.495843 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 656/1303] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:05:32 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:05:32.761871 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcb125-fab3-4cf1-b79b-b3e1b039590f None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:32.853986 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:32.861608 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcb125-fab3-4cf1-b79b-b3e1b039590f None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:32.894016 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c749d5-b2f4-4d17-9017-3358d35e870d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:32.894622 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c749d5-b2f4-4d17-9017-3358d35e870d None admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:32.894897 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c749d5-b2f4-4d17-9017-3358d35e870d None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:32.895165 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c749d5-b2f4-4d17-9017-3358d35e870d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:32.895763 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c749d5-b2f4-4d17-9017-3358d35e870d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:32.897108 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c749d5-b2f4-4d17-9017-3358d35e870d None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:32.905582 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application [None req-c8c749d5-b2f4-4d17-9017-3358d35e870d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 28 12:05:32.905582 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:32.905582 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:05:32.905582 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:05:32.905582 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:05:32.905582 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:05:32.905582 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:05:32.905582 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:05:32.905582 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 28 12:05:32.905582 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:05:32.905582 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:05:32.905582 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:05:32.905582 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:05:32.905582 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:05:32.905582 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:05:32.905582 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:05:32.905582 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:05:32.906576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:05:32.906576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:05:32.906576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:05:32.906576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:05:32.906576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:05:32.906576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:05:32.906576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:05:32.906576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:05:32.906576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:05:32.906576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:05:32.906576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:05:32.906576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:05:32.906576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:05:32.906576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:05:32.906576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:05:32.906576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:05:32.908008 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:05:32.908008 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application with Lock( Sep 28 12:05:32.908008 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:05:32.908008 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:05:32.908008 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:05:32.908008 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:05:32.908008 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:05:32.908008 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:05:32.908008 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:05:32.908008 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:05:32.908008 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:05:32.908008 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:05:32.908008 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 28 12:05:32.908008 dv-cinder-859193-2-smb devstack@keystone.service[81599]: ERROR keystone.server.flask.application Sep 28 12:05:32.908008 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 648/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 28 12:05:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:05:32.913180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff71fa1-7efa-465a-87b9-c0a0260ba1a5 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:32.987200 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:33.009364 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff71fa1-7efa-465a-87b9-c0a0260ba1a5 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:33.042782 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa882e3-4ece-4ea5-b463-bb901d175902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:33.043385 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa882e3-4ece-4ea5-b463-bb901d175902 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:33.043695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa882e3-4ece-4ea5-b463-bb901d175902 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:33.043969 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa882e3-4ece-4ea5-b463-bb901d175902 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:33.044595 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa882e3-4ece-4ea5-b463-bb901d175902 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:05:33.044899 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa882e3-4ece-4ea5-b463-bb901d175902 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:33.046256 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa882e3-4ece-4ea5-b463-bb901d175902 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:33.051266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 657/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Sep 28 12:05:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:05:33.056832 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c749d5-b2f4-4d17-9017-3358d35e870d None admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:05:33.153853 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c749d5-b2f4-4d17-9017-3358d35e870d None admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:05:33.187214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4f7b2-3958-44d2-a8b4-44895903f734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:05:33.187829 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4f7b2-3958-44d2-a8b4-44895903f734 None admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:05:33.188108 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4f7b2-3958-44d2-a8b4-44895903f734 None admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:05:33.188378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4f7b2-3958-44d2-a8b4-44895903f734 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:05:33.189028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4f7b2-3958-44d2-a8b4-44895903f734 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:05:33.190375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4f7b2-3958-44d2-a8b4-44895903f734 None admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:05:33.209386 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 649/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:05:33 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:05:43.048756 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=30 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:05:43.205276 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:06:36.949904 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02677a-4d4c-430e-9638-0aeb3018790c None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:06:36.950443 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02677a-4d4c-430e-9638-0aeb3018790c None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:06:36.950443 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02677a-4d4c-430e-9638-0aeb3018790c None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:06:36.951849 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 658/1307] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:06:36.957698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313ba9e-9c10-4305-a47f-f50efc62962f None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:06:36.958119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313ba9e-9c10-4305-a47f-f50efc62962f None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:06:36.958210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313ba9e-9c10-4305-a47f-f50efc62962f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:06:37.102609 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-c313ba9e-9c10-4305-a47f-f50efc62962f None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:06:37.104146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-c313ba9e-9c10-4305-a47f-f50efc62962f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:06:37.340685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 650/1308] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:06:37.690546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b5c89-7162-405b-bb7c-4b2883fe3a97 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:06:37.691219 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b5c89-7162-405b-bb7c-4b2883fe3a97 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:06:37.691742 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b5c89-7162-405b-bb7c-4b2883fe3a97 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:06:37.693584 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 659/1309] 10.222.0.16 () {54 vars in 964 bytes} [Wed Sep 28 12:06:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:06:37.699240 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c85de-e793-4f2c-b251-3fb13ab9b9cf None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:06:37.699559 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c85de-e793-4f2c-b251-3fb13ab9b9cf None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:06:37.699843 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c85de-e793-4f2c-b251-3fb13ab9b9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:06:37.787696 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-c41c85de-e793-4f2c-b251-3fb13ab9b9cf None None] MFA Rules not processed for user `ca51ff621664452db7dd991714462e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:06:37.788911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-c41c85de-e793-4f2c-b251-3fb13ab9b9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:06:37.812595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:06:37.877760 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 651/1310] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Sep 28 12:06:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:06:37.886502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b5c89-7162-405b-bb7c-4b2883fe3a97 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:06:37.888515 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3f7b5c89-7162-405b-bb7c-4b2883fe3a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:06:38.018960 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b5c89-7162-405b-bb7c-4b2883fe3a97 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:06:38.102952 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411c0cf-42f2-42fd-9f9b-2961a3639fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:06:38.103858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411c0cf-42f2-42fd-9f9b-2961a3639fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:06:38.104303 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411c0cf-42f2-42fd-9f9b-2961a3639fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:06:38.104732 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411c0cf-42f2-42fd-9f9b-2961a3639fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:06:38.106496 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a411c0cf-42f2-42fd-9f9b-2961a3639fc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:06:38.173290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:06:38.242417 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411c0cf-42f2-42fd-9f9b-2961a3639fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:06:38.243931 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411c0cf-42f2-42fd-9f9b-2961a3639fc5 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:06:38.269962 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 660/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:06:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:06:40.752590 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d3d93-2e9c-41a6-a529-d2bd55de40a6 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:06:40.753133 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d3d93-2e9c-41a6-a529-d2bd55de40a6 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:06:40.753133 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d3d93-2e9c-41a6-a529-d2bd55de40a6 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:06:40.754489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 652/1312] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:06:40.759750 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b56ca0-92a8-40cf-b130-55e91c38719e None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:06:40.760186 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b56ca0-92a8-40cf-b130-55e91c38719e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:06:40.760293 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b56ca0-92a8-40cf-b130-55e91c38719e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:06:40.841042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-85b56ca0-92a8-40cf-b130-55e91c38719e None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:06:40.842253 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-85b56ca0-92a8-40cf-b130-55e91c38719e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:06:40.938886 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 661/1313] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:06:41.218564 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d3d93-2e9c-41a6-a529-d2bd55de40a6 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:06:41.220706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-131d3d93-2e9c-41a6-a529-d2bd55de40a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:06:41.323349 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d3d93-2e9c-41a6-a529-d2bd55de40a6 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:06:41.396139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:06:41.398465 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8036320-3f66-4451-b217-4dd796b4df20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:06:41.399296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8036320-3f66-4451-b217-4dd796b4df20 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:06:41.399759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8036320-3f66-4451-b217-4dd796b4df20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:06:41.400213 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8036320-3f66-4451-b217-4dd796b4df20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:06:41.401876 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-c8036320-3f66-4451-b217-4dd796b4df20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:06:41.510287 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8036320-3f66-4451-b217-4dd796b4df20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:06:41.511658 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8036320-3f66-4451-b217-4dd796b4df20 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:06:41.529775 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 653/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:06:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:06:43.973609 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdb4d6-dc3f-4230-b8b1-282a4d629d17 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:06:43.974128 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdb4d6-dc3f-4230-b8b1-282a4d629d17 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:06:43.974128 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdb4d6-dc3f-4230-b8b1-282a4d629d17 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:06:43.975498 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 662/1315] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:06:43.980845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de140531-1d67-4489-8e8e-8820d98b4f92 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:06:43.981264 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de140531-1d67-4489-8e8e-8820d98b4f92 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:06:43.981396 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de140531-1d67-4489-8e8e-8820d98b4f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:06:44.047163 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-de140531-1d67-4489-8e8e-8820d98b4f92 None None] MFA Rules not processed for user `487e6099c4e64a10bbdf6b7df5e94d5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:06:44.048417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-de140531-1d67-4489-8e8e-8820d98b4f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:06:44.100105 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:06:44.145553 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 654/1316] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:06:43 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:06:44.433770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bdb4d6-dc3f-4230-b8b1-282a4d629d17 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:06:44.435349 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-45bdb4d6-dc3f-4230-b8b1-282a4d629d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:06:44.446000 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:06:44.541077 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bdb4d6-dc3f-4230-b8b1-282a4d629d17 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:06:44.617720 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a5783-3414-4500-bbd7-2f172b4a4e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:06:44.618507 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a5783-3414-4500-bbd7-2f172b4a4e3b service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:06:44.618998 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a5783-3414-4500-bbd7-2f172b4a4e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:06:44.619280 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a5783-3414-4500-bbd7-2f172b4a4e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:06:44.620894 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-284a5783-3414-4500-bbd7-2f172b4a4e3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:06:44.682532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:06:44.729374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a5783-3414-4500-bbd7-2f172b4a4e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:06:44.731070 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a5783-3414-4500-bbd7-2f172b4a4e3b service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:06:44.751215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 663/1317] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:06:44 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:06:47.432463 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a478c1b-35dc-48c6-b6b5-6edc7f259277 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:06:47.433053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a478c1b-35dc-48c6-b6b5-6edc7f259277 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:06:47.433053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a478c1b-35dc-48c6-b6b5-6edc7f259277 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:06:47.434344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 655/1318] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:06:47.439766 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3147400-ab68-4b72-b1fa-68d3cd18f72a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:06:47.440192 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3147400-ab68-4b72-b1fa-68d3cd18f72a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:06:47.440311 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3147400-ab68-4b72-b1fa-68d3cd18f72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:06:47.506705 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-c3147400-ab68-4b72-b1fa-68d3cd18f72a None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:06:47.507964 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c3147400-ab68-4b72-b1fa-68d3cd18f72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:06:47.622084 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 664/1319] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:06:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:06:47.931732 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a478c1b-35dc-48c6-b6b5-6edc7f259277 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:06:47.933270 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-7a478c1b-35dc-48c6-b6b5-6edc7f259277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:06:48.039030 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a478c1b-35dc-48c6-b6b5-6edc7f259277 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:06:48.112600 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343e0d8-d2b9-48fc-85a4-48b13c12ce0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:06:48.113204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343e0d8-d2b9-48fc-85a4-48b13c12ce0f service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:06:48.113480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343e0d8-d2b9-48fc-85a4-48b13c12ce0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:06:48.113749 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343e0d8-d2b9-48fc-85a4-48b13c12ce0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:06:48.115342 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-9343e0d8-d2b9-48fc-85a4-48b13c12ce0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:06:48.122583 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:06:48.223721 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343e0d8-d2b9-48fc-85a4-48b13c12ce0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:06:48.225141 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343e0d8-d2b9-48fc-85a4-48b13c12ce0f service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:06:48.243539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 656/1320] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:06:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:06:51.036735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e0056-7114-42fb-a3ec-e015f9a0d9ef None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:06:51.037297 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e0056-7114-42fb-a3ec-e015f9a0d9ef None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:06:51.037297 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e0056-7114-42fb-a3ec-e015f9a0d9ef None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:06:51.038609 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 665/1321] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:06:51.043897 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e994d-0ca2-46f5-a5a3-2ed202832496 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:06:51.044302 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e994d-0ca2-46f5-a5a3-2ed202832496 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:06:51.044426 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e994d-0ca2-46f5-a5a3-2ed202832496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:06:51.109009 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-236e994d-0ca2-46f5-a5a3-2ed202832496 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:06:51.110191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-236e994d-0ca2-46f5-a5a3-2ed202832496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:06:51.177703 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:06:51.220046 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 657/1322] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:06:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:06:51.505103 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e0056-7114-42fb-a3ec-e015f9a0d9ef None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:06:51.506644 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-fa4e0056-7114-42fb-a3ec-e015f9a0d9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:06:51.528488 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:06:51.614017 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e0056-7114-42fb-a3ec-e015f9a0d9ef None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:06:51.691453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c1316-c34b-435d-87b1-14aed8e37591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:06:51.692079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c1316-c34b-435d-87b1-14aed8e37591 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:06:51.692350 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c1316-c34b-435d-87b1-14aed8e37591 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:06:51.692614 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c1316-c34b-435d-87b1-14aed8e37591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:06:51.694197 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-4a7c1316-c34b-435d-87b1-14aed8e37591 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:06:51.768714 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:06:51.806786 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c1316-c34b-435d-87b1-14aed8e37591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:06:51.808472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c1316-c34b-435d-87b1-14aed8e37591 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:06:51.826990 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 666/1323] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:06:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:06:54.047366 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd799d3-672e-4fb8-bacb-72cd141f99ec None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:06:54.047961 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd799d3-672e-4fb8-bacb-72cd141f99ec None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:06:54.047961 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd799d3-672e-4fb8-bacb-72cd141f99ec None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:06:54.049372 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 658/1324] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:06:54.054847 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426001f-5f4f-4512-a7e7-63e832a0ca84 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:06:54.055258 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426001f-5f4f-4512-a7e7-63e832a0ca84 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:06:54.055410 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426001f-5f4f-4512-a7e7-63e832a0ca84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:06:54.121360 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-6426001f-5f4f-4512-a7e7-63e832a0ca84 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:06:54.122839 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6426001f-5f4f-4512-a7e7-63e832a0ca84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:06:54.229350 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 667/1325] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:06:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:06:54.518202 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd799d3-672e-4fb8-bacb-72cd141f99ec None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:06:54.519828 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-afd799d3-672e-4fb8-bacb-72cd141f99ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:06:54.624150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd799d3-672e-4fb8-bacb-72cd141f99ec None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:06:54.701577 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9507f93-f3b9-4dfa-b501-b6cb1daf4a4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:06:54.702186 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9507f93-f3b9-4dfa-b501-b6cb1daf4a4e service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:06:54.702464 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9507f93-f3b9-4dfa-b501-b6cb1daf4a4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:06:54.702739 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9507f93-f3b9-4dfa-b501-b6cb1daf4a4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:06:54.704791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-a9507f93-f3b9-4dfa-b501-b6cb1daf4a4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:06:54.722721 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:06:54.817157 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9507f93-f3b9-4dfa-b501-b6cb1daf4a4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:06:54.818593 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9507f93-f3b9-4dfa-b501-b6cb1daf4a4e service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:06:54.837025 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 659/1326] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:06:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:06:57.044193 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eaa5fd-c9cd-45d5-9365-e9aba92635de None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:06:57.044689 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eaa5fd-c9cd-45d5-9365-e9aba92635de None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:06:57.044689 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eaa5fd-c9cd-45d5-9365-e9aba92635de None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:06:57.046031 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 668/1327] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:06:57.051986 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46123a65-7b03-4a11-8313-5d9f9d5da175 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:06:57.052403 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46123a65-7b03-4a11-8313-5d9f9d5da175 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:06:57.052531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46123a65-7b03-4a11-8313-5d9f9d5da175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:06:57.120035 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-46123a65-7b03-4a11-8313-5d9f9d5da175 None None] MFA Rules not processed for user `487e6099c4e64a10bbdf6b7df5e94d5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:06:57.121122 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-46123a65-7b03-4a11-8313-5d9f9d5da175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:06:57.187083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:06:57.219789 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 660/1328] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:06:57 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:06:57.503033 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eaa5fd-c9cd-45d5-9365-e9aba92635de None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:06:57.504641 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e1eaa5fd-c9cd-45d5-9365-e9aba92635de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:06:57.537557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:06:57.613348 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eaa5fd-c9cd-45d5-9365-e9aba92635de None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:06:57.687100 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded898f8-3f6b-4200-9156-aa64b48f1668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:06:57.687662 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded898f8-3f6b-4200-9156-aa64b48f1668 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:06:57.687942 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded898f8-3f6b-4200-9156-aa64b48f1668 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:06:57.688207 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded898f8-3f6b-4200-9156-aa64b48f1668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:06:57.689919 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ded898f8-3f6b-4200-9156-aa64b48f1668 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:06:57.769227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:06:57.801935 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded898f8-3f6b-4200-9156-aa64b48f1668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:06:57.803360 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded898f8-3f6b-4200-9156-aa64b48f1668 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:06:57.821807 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 669/1329] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:06:57 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:07:00.191713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73306c9b-4265-46a0-9d22-016a81e52d23 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:00.192252 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73306c9b-4265-46a0-9d22-016a81e52d23 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:00.192252 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73306c9b-4265-46a0-9d22-016a81e52d23 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:00.193596 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 661/1330] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:07:00.198825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a16a1-a921-4e85-bb7d-0248b19088f7 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:00.199220 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a16a1-a921-4e85-bb7d-0248b19088f7 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:00.199367 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a16a1-a921-4e85-bb7d-0248b19088f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:00.265268 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-be4a16a1-a921-4e85-bb7d-0248b19088f7 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:07:00.266469 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-be4a16a1-a921-4e85-bb7d-0248b19088f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:00.361895 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 670/1331] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:07:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:07:00.639629 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73306c9b-4265-46a0-9d22-016a81e52d23 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:07:00.641156 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-73306c9b-4265-46a0-9d22-016a81e52d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:00.745747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73306c9b-4265-46a0-9d22-016a81e52d23 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:07:00.818502 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ad76a-198a-4f0a-a4a5-a365d2a49e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:07:00.819100 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ad76a-198a-4f0a-a4a5-a365d2a49e82 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:00.819377 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ad76a-198a-4f0a-a4a5-a365d2a49e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:00.819676 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ad76a-198a-4f0a-a4a5-a365d2a49e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:00.821269 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-cb9ad76a-198a-4f0a-a4a5-a365d2a49e82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:00.848750 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:00.930780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ad76a-198a-4f0a-a4a5-a365d2a49e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:07:00.932236 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ad76a-198a-4f0a-a4a5-a365d2a49e82 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:07:00.949745 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 662/1332] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:07:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:07:03.149277 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097de159-fef8-429f-9290-f92c5eb4ddae None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:03.149853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097de159-fef8-429f-9290-f92c5eb4ddae None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:03.149853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097de159-fef8-429f-9290-f92c5eb4ddae None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:03.151165 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 671/1333] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:07:03.156328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81b8d6-912e-49d3-afad-5fe0172f763a None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:03.156711 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81b8d6-912e-49d3-afad-5fe0172f763a None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:03.156878 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81b8d6-912e-49d3-afad-5fe0172f763a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:03.223185 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-8a81b8d6-912e-49d3-afad-5fe0172f763a None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:07:03.224432 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-8a81b8d6-912e-49d3-afad-5fe0172f763a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:03.297830 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:03.320302 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 663/1334] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:07:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:07:03.621113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097de159-fef8-429f-9290-f92c5eb4ddae None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:07:03.622901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-097de159-fef8-429f-9290-f92c5eb4ddae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:03.663195 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:03.726269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097de159-fef8-429f-9290-f92c5eb4ddae None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:07:03.800969 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e911c34-54bd-429c-b159-b45955a1557e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:07:03.801566 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e911c34-54bd-429c-b159-b45955a1557e service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:03.801842 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e911c34-54bd-429c-b159-b45955a1557e service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:03.802109 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e911c34-54bd-429c-b159-b45955a1557e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:03.803699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3e911c34-54bd-429c-b159-b45955a1557e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:03.894480 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:03.919595 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e911c34-54bd-429c-b159-b45955a1557e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:07:03.921007 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e911c34-54bd-429c-b159-b45955a1557e service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:07:03.939562 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 672/1335] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:07:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:07:06.413087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fde670-9a2d-4829-9c63-0fc9cdffd3d6 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:06.413624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fde670-9a2d-4829-9c63-0fc9cdffd3d6 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:06.413624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fde670-9a2d-4829-9c63-0fc9cdffd3d6 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:06.414949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 664/1336] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:07:06.420236 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a99e9b-df7d-4431-a248-06ac63b742d4 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:06.420673 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a99e9b-df7d-4431-a248-06ac63b742d4 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:06.420781 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a99e9b-df7d-4431-a248-06ac63b742d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:06.491613 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-08a99e9b-df7d-4431-a248-06ac63b742d4 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:07:06.492825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-08a99e9b-df7d-4431-a248-06ac63b742d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:06.588179 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 673/1337] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:07:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:07:06.868148 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fde670-9a2d-4829-9c63-0fc9cdffd3d6 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:07:06.869698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-74fde670-9a2d-4829-9c63-0fc9cdffd3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:06.972311 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fde670-9a2d-4829-9c63-0fc9cdffd3d6 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:07:07.044308 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248c526-13a3-466d-9f2a-6e7e969e1fa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:07:07.044906 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248c526-13a3-466d-9f2a-6e7e969e1fa7 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:07.045182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248c526-13a3-466d-9f2a-6e7e969e1fa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:07.045448 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248c526-13a3-466d-9f2a-6e7e969e1fa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:07.047045 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-7248c526-13a3-466d-9f2a-6e7e969e1fa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:07.082761 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:07.166185 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7248c526-13a3-466d-9f2a-6e7e969e1fa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:07:07.167652 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7248c526-13a3-466d-9f2a-6e7e969e1fa7 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:07:07.186352 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 665/1338] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:07:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:07:11.207919 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddee2fb-918a-43cf-b6af-edcc8a02ed31 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:11.208466 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddee2fb-918a-43cf-b6af-edcc8a02ed31 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:11.208466 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddee2fb-918a-43cf-b6af-edcc8a02ed31 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:11.209740 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 674/1339] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:07:11.214888 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3800d3-caa2-49e8-86db-9d7047af19ec None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:11.215292 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3800d3-caa2-49e8-86db-9d7047af19ec None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:11.215463 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3800d3-caa2-49e8-86db-9d7047af19ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:11.281608 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-fb3800d3-caa2-49e8-86db-9d7047af19ec None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:07:11.283768 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-fb3800d3-caa2-49e8-86db-9d7047af19ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:11.368337 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:11.381000 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 666/1340] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:07:11.668226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddee2fb-918a-43cf-b6af-edcc8a02ed31 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:07:11.669787 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-bddee2fb-918a-43cf-b6af-edcc8a02ed31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:11.718890 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:11.777410 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddee2fb-918a-43cf-b6af-edcc8a02ed31 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:07:11.852326 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a71dcc-1659-4d8d-bef4-a1870956b210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:07:11.852931 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a71dcc-1659-4d8d-bef4-a1870956b210 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:11.853206 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a71dcc-1659-4d8d-bef4-a1870956b210 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:11.853475 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a71dcc-1659-4d8d-bef4-a1870956b210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:11.855054 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-11a71dcc-1659-4d8d-bef4-a1870956b210 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:11.946570 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:11.963999 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a71dcc-1659-4d8d-bef4-a1870956b210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:07:11.965440 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a71dcc-1659-4d8d-bef4-a1870956b210 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:07:11.984633 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 675/1341] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:07:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:07:14.772540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72011938-cf2a-4b7f-8c1c-572706b5dc07 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:14.773088 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72011938-cf2a-4b7f-8c1c-572706b5dc07 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:14.773088 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72011938-cf2a-4b7f-8c1c-572706b5dc07 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:14.774460 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 667/1342] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:07:14.779697 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b24b2c-37b7-42cc-ab90-c537e49faf70 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:14.780116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b24b2c-37b7-42cc-ab90-c537e49faf70 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:14.780387 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b24b2c-37b7-42cc-ab90-c537e49faf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:14.845180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-c9b24b2c-37b7-42cc-ab90-c537e49faf70 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:07:14.846371 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c9b24b2c-37b7-42cc-ab90-c537e49faf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:14.944119 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 676/1343] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:07:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:07:15.225793 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72011938-cf2a-4b7f-8c1c-572706b5dc07 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:07:15.227370 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-72011938-cf2a-4b7f-8c1c-572706b5dc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:15.335648 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72011938-cf2a-4b7f-8c1c-572706b5dc07 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:07:15.418353 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fb1f7-b062-46dc-a9db-6bf3430a70a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:07:15.418954 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fb1f7-b062-46dc-a9db-6bf3430a70a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:15.419309 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fb1f7-b062-46dc-a9db-6bf3430a70a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:15.419627 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fb1f7-b062-46dc-a9db-6bf3430a70a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:15.421294 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-e53fb1f7-b062-46dc-a9db-6bf3430a70a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:15.465066 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:15.535753 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fb1f7-b062-46dc-a9db-6bf3430a70a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:07:15.537195 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fb1f7-b062-46dc-a9db-6bf3430a70a6 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:07:15.556126 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 668/1344] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:07:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:07:19.668694 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4b3e7-e9e2-4d09-95b4-8a6df1cf13a5 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:19.669210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4b3e7-e9e2-4d09-95b4-8a6df1cf13a5 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:19.669329 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4b3e7-e9e2-4d09-95b4-8a6df1cf13a5 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:19.670610 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 677/1345] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:07:19.677342 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b1c20-3ad3-4a0f-9f46-c941afb23902 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:19.677834 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b1c20-3ad3-4a0f-9f46-c941afb23902 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:19.677949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b1c20-3ad3-4a0f-9f46-c941afb23902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:19.744283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-070b1c20-3ad3-4a0f-9f46-c941afb23902 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:07:19.745491 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-070b1c20-3ad3-4a0f-9f46-c941afb23902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:19.839578 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:19.842187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 669/1346] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:07:20.127581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4b3e7-e9e2-4d09-95b4-8a6df1cf13a5 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:07:20.129147 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-54d4b3e7-e9e2-4d09-95b4-8a6df1cf13a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:20.187369 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:20.232676 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4b3e7-e9e2-4d09-95b4-8a6df1cf13a5 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:07:20.304309 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13935a7-1c81-4fd2-8c0e-ecdf30f22cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:07:20.304900 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13935a7-1c81-4fd2-8c0e-ecdf30f22cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:20.305175 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13935a7-1c81-4fd2-8c0e-ecdf30f22cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:20.305438 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13935a7-1c81-4fd2-8c0e-ecdf30f22cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:20.306991 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d13935a7-1c81-4fd2-8c0e-ecdf30f22cc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:20.421945 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:20.425668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13935a7-1c81-4fd2-8c0e-ecdf30f22cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:07:20.427426 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13935a7-1c81-4fd2-8c0e-ecdf30f22cc5 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:07:20.445942 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 678/1347] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:07:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:07:25.440918 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a719b-aa34-45dd-9f3d-114659e6a400 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:25.441480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a719b-aa34-45dd-9f3d-114659e6a400 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:25.441480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a719b-aa34-45dd-9f3d-114659e6a400 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:25.443037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 670/1348] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 28 12:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:07:25.448102 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a73f5-ff7d-4a3d-a48f-62d1f1e96db5 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:25.448531 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a73f5-ff7d-4a3d-a48f-62d1f1e96db5 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:25.448642 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a73f5-ff7d-4a3d-a48f-62d1f1e96db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:25.550035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b72a73f5-ff7d-4a3d-a48f-62d1f1e96db5 None None] MFA Rules not processed for user `09e495edc6fd47c892679bb908c3f5bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:07:25.552408 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b72a73f5-ff7d-4a3d-a48f-62d1f1e96db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:25.739214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 679/1349] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 28 12:07:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:07:29.860160 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac754a-11a3-479f-ac62-80a0dd79fd70 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:29.861235 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac754a-11a3-479f-ac62-80a0dd79fd70 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:29.861353 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac754a-11a3-479f-ac62-80a0dd79fd70 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:29.862814 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 671/1350] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 28 12:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:07:29.867727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0663034-e7fc-485e-92ed-25a71d7163eb None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:29.868171 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0663034-e7fc-485e-92ed-25a71d7163eb None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:29.868468 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0663034-e7fc-485e-92ed-25a71d7163eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:29.926744 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:29.951297 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b0663034-e7fc-485e-92ed-25a71d7163eb None None] MFA Rules not processed for user `09e495edc6fd47c892679bb908c3f5bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:07:29.952545 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b0663034-e7fc-485e-92ed-25a71d7163eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:30.065291 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 680/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 28 12:07:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:07:31.516660 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b45e5c-d013-4f89-a52d-1b91937eb3a3 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:31.517674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b45e5c-d013-4f89-a52d-1b91937eb3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:31.517788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b45e5c-d013-4f89-a52d-1b91937eb3a3 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:31.519065 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 672/1352] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 28 12:07:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:07:31.524370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25c866-bf43-4ccd-a631-9596c4abb474 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:31.524797 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25c866-bf43-4ccd-a631-9596c4abb474 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:31.524923 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25c866-bf43-4ccd-a631-9596c4abb474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:31.603391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-9a25c866-bf43-4ccd-a631-9596c4abb474 None None] MFA Rules not processed for user `09e495edc6fd47c892679bb908c3f5bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:07:31.604621 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9a25c866-bf43-4ccd-a631-9596c4abb474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:31.646127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:31.715387 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 681/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 28 12:07:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:07:35.177054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140bd49-076e-49aa-ab50-bafe840d698e None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:35.178003 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140bd49-076e-49aa-ab50-bafe840d698e None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:35.178495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140bd49-076e-49aa-ab50-bafe840d698e None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:35.184234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 673/1354] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:07:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:07:35.190212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb934a-f9f0-41e8-8a46-3c499c9cc552 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:35.191147 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb934a-f9f0-41e8-8a46-3c499c9cc552 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:35.191726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb934a-f9f0-41e8-8a46-3c499c9cc552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:35.265760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-77eb934a-f9f0-41e8-8a46-3c499c9cc552 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:07:35.267097 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-77eb934a-f9f0-41e8-8a46-3c499c9cc552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:35.371484 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 682/1355] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:07:35.678977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f6607-e2a1-42cc-998b-d13f5f167cca None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:35.679503 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f6607-e2a1-42cc-998b-d13f5f167cca None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:35.679939 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f6607-e2a1-42cc-998b-d13f5f167cca None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:35.681643 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 674/1356] 10.222.0.16 () {54 vars in 961 bytes} [Wed Sep 28 12:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:07:35.689740 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38045b5-400e-45c0-8725-727680dd4c26 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:35.690029 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38045b5-400e-45c0-8725-727680dd4c26 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:35.690304 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38045b5-400e-45c0-8725-727680dd4c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:35.714280 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:35.792584 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b38045b5-400e-45c0-8725-727680dd4c26 None None] MFA Rules not processed for user `0e81804e04514ae882a1fd93789db025`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:07:35.793781 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b38045b5-400e-45c0-8725-727680dd4c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:35.920335 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 683/1357] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Sep 28 12:07:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:07:35.932401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f6607-e2a1-42cc-998b-d13f5f167cca None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:07:35.933893 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-607f6607-e2a1-42cc-998b-d13f5f167cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:36.101857 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f6607-e2a1-42cc-998b-d13f5f167cca None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:07:36.178611 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:36.220387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd7536-9e5c-4177-aa0e-940e18387094 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:07:36.221390 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd7536-9e5c-4177-aa0e-940e18387094 service nova] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:36.221730 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd7536-9e5c-4177-aa0e-940e18387094 service nova] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:36.222060 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd7536-9e5c-4177-aa0e-940e18387094 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:36.223734 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-12bd7536-9e5c-4177-aa0e-940e18387094 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:36.325561 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd7536-9e5c-4177-aa0e-940e18387094 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:07:36.327234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd7536-9e5c-4177-aa0e-940e18387094 service nova] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:07:36.346739 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 675/1358] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:07:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:07:38.739228 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193df84-eaa8-48a1-8b37-0a6b330311f3 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:38.739765 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193df84-eaa8-48a1-8b37-0a6b330311f3 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:38.739765 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193df84-eaa8-48a1-8b37-0a6b330311f3 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:38.741091 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 684/1359] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:07:38.746380 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee64cc-0a3d-4c25-bebe-37e7af4b5441 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:38.746786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee64cc-0a3d-4c25-bebe-37e7af4b5441 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:38.746922 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee64cc-0a3d-4c25-bebe-37e7af4b5441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:38.823745 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-bdee64cc-0a3d-4c25-bebe-37e7af4b5441 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:07:38.823745 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-bdee64cc-0a3d-4c25-bebe-37e7af4b5441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:38.862612 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:38.935504 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 676/1360] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:07:39.228237 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193df84-eaa8-48a1-8b37-0a6b330311f3 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:07:39.230048 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a193df84-eaa8-48a1-8b37-0a6b330311f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:39.305870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:39.406596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193df84-eaa8-48a1-8b37-0a6b330311f3 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:07:39.544204 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12076f23-7637-447c-9c7d-7430240b4911 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:07:39.544835 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12076f23-7637-447c-9c7d-7430240b4911 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:39.545109 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12076f23-7637-447c-9c7d-7430240b4911 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:39.545372 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12076f23-7637-447c-9c7d-7430240b4911 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:39.546936 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-12076f23-7637-447c-9c7d-7430240b4911 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:39.575532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:39.649480 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12076f23-7637-447c-9c7d-7430240b4911 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:07:39.651082 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12076f23-7637-447c-9c7d-7430240b4911 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:07:39.670218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 685/1361] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:07:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:07:42.160752 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82532bf6-1279-4075-b9be-69067db8d46c None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:42.161335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82532bf6-1279-4075-b9be-69067db8d46c None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:42.161335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82532bf6-1279-4075-b9be-69067db8d46c None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:42.162798 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 677/1362] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:07:42.167764 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be215e-f9b1-45c6-b51d-af4bc441aeb6 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:42.168199 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be215e-f9b1-45c6-b51d-af4bc441aeb6 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:42.168303 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be215e-f9b1-45c6-b51d-af4bc441aeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:42.238004 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-a9be215e-f9b1-45c6-b51d-af4bc441aeb6 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:07:42.239221 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a9be215e-f9b1-45c6-b51d-af4bc441aeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:42.341441 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:42.347806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 686/1363] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:07:42.633061 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787166e-a0ba-4ba7-b40d-5ca30c3163fe None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:42.633608 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787166e-a0ba-4ba7-b40d-5ca30c3163fe None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:42.633984 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787166e-a0ba-4ba7-b40d-5ca30c3163fe None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:42.635420 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 678/1364] 10.222.0.16 () {54 vars in 961 bytes} [Wed Sep 28 12:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:07:42.640737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061798d3-6484-4cc6-97a1-9dacee82a10c None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:42.641124 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061798d3-6484-4cc6-97a1-9dacee82a10c None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:42.641497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061798d3-6484-4cc6-97a1-9dacee82a10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:42.726992 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-061798d3-6484-4cc6-97a1-9dacee82a10c None None] MFA Rules not processed for user `0e81804e04514ae882a1fd93789db025`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:07:42.731152 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-061798d3-6484-4cc6-97a1-9dacee82a10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:42.855045 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 687/1365] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Sep 28 12:07:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:07:42.862118 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787166e-a0ba-4ba7-b40d-5ca30c3163fe None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:07:42.863831 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-e787166e-a0ba-4ba7-b40d-5ca30c3163fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:43.021698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787166e-a0ba-4ba7-b40d-5ca30c3163fe None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:07:43.042610 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:43.148827 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e201a-7170-473a-8898-ee8d14bc6d03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:07:43.149487 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e201a-7170-473a-8898-ee8d14bc6d03 service nova] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:43.149769 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e201a-7170-473a-8898-ee8d14bc6d03 service nova] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:43.150035 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e201a-7170-473a-8898-ee8d14bc6d03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:43.151669 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-9e7e201a-7170-473a-8898-ee8d14bc6d03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:43.250652 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e201a-7170-473a-8898-ee8d14bc6d03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:07:43.252560 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e201a-7170-473a-8898-ee8d14bc6d03 service nova] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:07:43.274028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 679/1366] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:07:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:07:43.386946 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90b1fe-dfb2-483f-98c7-dfeb34a9cbcf None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:43.387579 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90b1fe-dfb2-483f-98c7-dfeb34a9cbcf None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:43.387579 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90b1fe-dfb2-483f-98c7-dfeb34a9cbcf None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:43.389165 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 688/1367] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:07:43.395385 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29630d0c-6af0-40ed-973f-a15c66b7d77e None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:43.395716 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29630d0c-6af0-40ed-973f-a15c66b7d77e None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:43.395991 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29630d0c-6af0-40ed-973f-a15c66b7d77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:43.431563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:43.476687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-29630d0c-6af0-40ed-973f-a15c66b7d77e None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:07:43.478132 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-29630d0c-6af0-40ed-973f-a15c66b7d77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:43.601306 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 680/1368] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:07:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:07:43.935531 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e9192-1aa3-4f34-afd2-8e74b0ad9a4d None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:43.936128 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e9192-1aa3-4f34-afd2-8e74b0ad9a4d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:43.936128 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e9192-1aa3-4f34-afd2-8e74b0ad9a4d None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:43.937792 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 689/1369] 10.222.0.16 () {54 vars in 963 bytes} [Wed Sep 28 12:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:07:43.943284 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999055a-a55b-4ec3-88bf-752294b5a42f None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:43.943749 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999055a-a55b-4ec3-88bf-752294b5a42f None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:43.944316 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999055a-a55b-4ec3-88bf-752294b5a42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:44.022997 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-5999055a-a55b-4ec3-88bf-752294b5a42f None None] MFA Rules not processed for user `f09354b404d94e9db2e21292a61a06f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:07:44.024328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-5999055a-a55b-4ec3-88bf-752294b5a42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:44.073118 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:44.113109 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 681/1370] 10.222.0.16 () {58 vars in 1060 bytes} [Wed Sep 28 12:07:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:07:44.121060 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e9192-1aa3-4f34-afd2-8e74b0ad9a4d None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:07:44.122638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-442e9192-1aa3-4f34-afd2-8e74b0ad9a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:44.177608 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:44.236233 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e9192-1aa3-4f34-afd2-8e74b0ad9a4d None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:07:44.323877 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b60e6c-6359-47fe-b5c5-d62b180943f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:07:44.324505 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b60e6c-6359-47fe-b5c5-d62b180943f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:44.324836 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b60e6c-6359-47fe-b5c5-d62b180943f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:44.325114 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b60e6c-6359-47fe-b5c5-d62b180943f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:44.326838 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d3b60e6c-6359-47fe-b5c5-d62b180943f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:44.440109 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:44.454829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b60e6c-6359-47fe-b5c5-d62b180943f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:07:44.456389 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b60e6c-6359-47fe-b5c5-d62b180943f4 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:07:44.477302 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 690/1371] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:07:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:07:45.521054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1490a8-95e1-4da8-8a5e-da273bd6ea60 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:45.521575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1490a8-95e1-4da8-8a5e-da273bd6ea60 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:45.521575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1490a8-95e1-4da8-8a5e-da273bd6ea60 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:45.522940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 682/1372] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:07:45.528135 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aeab07-6156-4bc4-8142-cbb73a5c5380 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:45.528573 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aeab07-6156-4bc4-8142-cbb73a5c5380 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:45.528783 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aeab07-6156-4bc4-8142-cbb73a5c5380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:45.596566 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b4aeab07-6156-4bc4-8142-cbb73a5c5380 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:07:45.597771 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b4aeab07-6156-4bc4-8142-cbb73a5c5380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:45.695952 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 691/1373] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:07:45.991047 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1490a8-95e1-4da8-8a5e-da273bd6ea60 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:07:45.992723 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-ed1490a8-95e1-4da8-8a5e-da273bd6ea60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:46.154377 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1490a8-95e1-4da8-8a5e-da273bd6ea60 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:07:46.207550 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:46.272082 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcdb6ce-4436-4a16-b387-3260934499b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:07:46.272745 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdb6ce-4436-4a16-b387-3260934499b2 service nova] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:46.273022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdb6ce-4436-4a16-b387-3260934499b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:46.273289 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdb6ce-4436-4a16-b387-3260934499b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:46.274890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-4fcdb6ce-4436-4a16-b387-3260934499b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:46.370827 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcdb6ce-4436-4a16-b387-3260934499b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:07:46.372447 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcdb6ce-4436-4a16-b387-3260934499b2 service nova] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:07:46.392715 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 683/1374] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:07:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:07:48.599742 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298f3e1-91d9-49d6-a169-5619ea867b39 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:48.600274 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298f3e1-91d9-49d6-a169-5619ea867b39 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:48.600274 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298f3e1-91d9-49d6-a169-5619ea867b39 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:48.601607 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 692/1375] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:07:48.606721 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc175dee-f5e5-4a48-8bc6-46bf29bcb372 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:48.607142 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc175dee-f5e5-4a48-8bc6-46bf29bcb372 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:48.607323 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc175dee-f5e5-4a48-8bc6-46bf29bcb372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:48.674962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-cc175dee-f5e5-4a48-8bc6-46bf29bcb372 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:07:48.676194 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-cc175dee-f5e5-4a48-8bc6-46bf29bcb372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:48.683802 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:48.791056 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 684/1376] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:07:49.081772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298f3e1-91d9-49d6-a169-5619ea867b39 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:07:49.083749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8298f3e1-91d9-49d6-a169-5619ea867b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:49.148708 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:49.239963 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298f3e1-91d9-49d6-a169-5619ea867b39 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:07:49.364077 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff4bee-653e-4b12-8b0c-b64e4223fd64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:07:49.364755 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff4bee-653e-4b12-8b0c-b64e4223fd64 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:49.365129 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff4bee-653e-4b12-8b0c-b64e4223fd64 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:49.365493 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff4bee-653e-4b12-8b0c-b64e4223fd64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:49.367134 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9dff4bee-653e-4b12-8b0c-b64e4223fd64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:49.388481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:49.462558 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff4bee-653e-4b12-8b0c-b64e4223fd64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:07:49.464318 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff4bee-653e-4b12-8b0c-b64e4223fd64 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:07:49.484088 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 693/1377] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:07:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:07:51.731988 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57267c-8cf3-48e3-b0a1-05f4ace724f2 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:51.732866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57267c-8cf3-48e3-b0a1-05f4ace724f2 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:51.733384 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57267c-8cf3-48e3-b0a1-05f4ace724f2 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:51.734993 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 685/1378] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:07:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:07:51.740480 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06379629-2204-41be-8457-a5a837342573 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:51.740923 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06379629-2204-41be-8457-a5a837342573 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:51.741216 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06379629-2204-41be-8457-a5a837342573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:51.817250 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-06379629-2204-41be-8457-a5a837342573 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:07:51.818451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-06379629-2204-41be-8457-a5a837342573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:51.938270 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:51.951692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 694/1379] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:07:52.249861 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57267c-8cf3-48e3-b0a1-05f4ace724f2 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:07:52.251425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-4a57267c-8cf3-48e3-b0a1-05f4ace724f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:52.406679 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:52.418118 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57267c-8cf3-48e3-b0a1-05f4ace724f2 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:07:52.537382 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842d82d-5354-4c97-9e35-73b46cafc549 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:07:52.537993 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842d82d-5354-4c97-9e35-73b46cafc549 service nova] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:52.538275 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842d82d-5354-4c97-9e35-73b46cafc549 service nova] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:52.538545 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842d82d-5354-4c97-9e35-73b46cafc549 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:52.540193 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-5842d82d-5354-4c97-9e35-73b46cafc549 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:52.630839 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842d82d-5354-4c97-9e35-73b46cafc549 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:07:52.632512 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842d82d-5354-4c97-9e35-73b46cafc549 service nova] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:07:52.643144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:52.652146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 686/1380] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:07:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:07:55.195106 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd589f1-43e7-4054-bffe-0765903fe6a2 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:55.195681 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd589f1-43e7-4054-bffe-0765903fe6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:55.195812 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd589f1-43e7-4054-bffe-0765903fe6a2 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:55.197329 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 695/1381] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:07:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:07:55.202814 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59d15d-a8f5-406c-9737-8ad9dfe393cb None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:55.203237 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59d15d-a8f5-406c-9737-8ad9dfe393cb None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:55.203390 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59d15d-a8f5-406c-9737-8ad9dfe393cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:55.271174 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-7d59d15d-a8f5-406c-9737-8ad9dfe393cb None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:07:55.272435 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-7d59d15d-a8f5-406c-9737-8ad9dfe393cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:55.375797 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 687/1382] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:07:55.714684 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd589f1-43e7-4054-bffe-0765903fe6a2 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:07:55.716242 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-1dd589f1-43e7-4054-bffe-0765903fe6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:55.863982 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd589f1-43e7-4054-bffe-0765903fe6a2 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:07:55.932891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:55.990274 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af15986-74ee-4954-9561-426fac54d193 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:07:55.991091 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af15986-74ee-4954-9561-426fac54d193 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:55.991480 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af15986-74ee-4954-9561-426fac54d193 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:55.991844 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af15986-74ee-4954-9561-426fac54d193 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:55.993820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-1af15986-74ee-4954-9561-426fac54d193 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:56.085188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af15986-74ee-4954-9561-426fac54d193 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:07:56.086812 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af15986-74ee-4954-9561-426fac54d193 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:07:56.105024 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 696/1383] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:07:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:07:58.382593 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2f7bc-d41a-4601-88b7-964d2350c1dd None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:58.383261 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2f7bc-d41a-4601-88b7-964d2350c1dd None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:58.383261 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2f7bc-d41a-4601-88b7-964d2350c1dd None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:58.384386 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 688/1384] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:07:58.390405 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac6197-597b-4bfa-991b-754834b47160 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:58.390847 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac6197-597b-4bfa-991b-754834b47160 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:58.391247 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac6197-597b-4bfa-991b-754834b47160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:58.476562 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-35ac6197-597b-4bfa-991b-754834b47160 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:07:58.477792 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-35ac6197-597b-4bfa-991b-754834b47160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:58.512939 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:58.579692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 697/1385] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:07:58.872785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2f7bc-d41a-4601-88b7-964d2350c1dd None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:07:58.874560 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-f4b2f7bc-d41a-4601-88b7-964d2350c1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:58.957191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:59.036732 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2f7bc-d41a-4601-88b7-964d2350c1dd None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:07:59.181847 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64ac81-12d5-4272-833f-5bc6622f00f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:07:59.182969 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64ac81-12d5-4272-833f-5bc6622f00f1 service nova] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:07:59.183558 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64ac81-12d5-4272-833f-5bc6622f00f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:07:59.184053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64ac81-12d5-4272-833f-5bc6622f00f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:07:59.187248 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-2f64ac81-12d5-4272-833f-5bc6622f00f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:07:59.237870 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:59.290713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64ac81-12d5-4272-833f-5bc6622f00f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:07:59.292383 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64ac81-12d5-4272-833f-5bc6622f00f1 service nova] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:07:59.310246 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 689/1386] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:07:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:08:01.502987 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f966747-0241-42c1-9cfc-657356e40cb5 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:01.503859 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f966747-0241-42c1-9cfc-657356e40cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:01.503859 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f966747-0241-42c1-9cfc-657356e40cb5 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:01.504985 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 698/1387] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:01.510335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694fcb0-7fb1-43e0-9181-ec2e29b705d0 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:01.510764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694fcb0-7fb1-43e0-9181-ec2e29b705d0 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:01.510884 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694fcb0-7fb1-43e0-9181-ec2e29b705d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:01.584336 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-c694fcb0-7fb1-43e0-9181-ec2e29b705d0 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:01.585922 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-c694fcb0-7fb1-43e0-9181-ec2e29b705d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:01.690914 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 690/1388] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:08:01.978906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f966747-0241-42c1-9cfc-657356e40cb5 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:01.980550 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9f966747-0241-42c1-9cfc-657356e40cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:02.128445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f966747-0241-42c1-9cfc-657356e40cb5 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:02.145436 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:02.246605 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0661a-41f3-45f3-91bf-348af0efe3f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:02.247132 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0661a-41f3-45f3-91bf-348af0efe3f7 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:02.247412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0661a-41f3-45f3-91bf-348af0efe3f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:02.247715 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0661a-41f3-45f3-91bf-348af0efe3f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:02.249571 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e6d0661a-41f3-45f3-91bf-348af0efe3f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:02.339652 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0661a-41f3-45f3-91bf-348af0efe3f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:02.341253 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0661a-41f3-45f3-91bf-348af0efe3f7 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:02.359176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 699/1389] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:08:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:08:02.495838 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70e227-46a3-465e-a9d9-6bddd710c8cb None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:02.496453 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70e227-46a3-465e-a9d9-6bddd710c8cb None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:02.496700 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70e227-46a3-465e-a9d9-6bddd710c8cb None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:02.498130 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 691/1390] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:02.505028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c58004-219f-4390-bb32-d5609c92c64a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:02.505559 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c58004-219f-4390-bb32-d5609c92c64a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:02.505559 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c58004-219f-4390-bb32-d5609c92c64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:02.538356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:02.593524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-27c58004-219f-4390-bb32-d5609c92c64a None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:02.595578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-27c58004-219f-4390-bb32-d5609c92c64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:02.695595 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 700/1391] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:08:02.996206 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be1ef9-3c55-454b-be96-c1288cab3319 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:02.997005 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be1ef9-3c55-454b-be96-c1288cab3319 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:02.997280 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be1ef9-3c55-454b-be96-c1288cab3319 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:02.999011 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 692/1392] 10.222.0.16 () {54 vars in 962 bytes} [Wed Sep 28 12:08:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:03.004765 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732234c-f5c5-4429-91b4-a21beac79e5f None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:03.005130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732234c-f5c5-4429-91b4-a21beac79e5f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:03.005516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732234c-f5c5-4429-91b4-a21beac79e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:03.087136 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-5732234c-f5c5-4429-91b4-a21beac79e5f None None] MFA Rules not processed for user `9180b1616c524905b86769a9eb8f7757`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:03.088275 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5732234c-f5c5-4429-91b4-a21beac79e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:03.130875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:03.166721 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 701/1393] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Sep 28 12:08:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:08:03.176609 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be1ef9-3c55-454b-be96-c1288cab3319 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:03.178139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-e7be1ef9-3c55-454b-be96-c1288cab3319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:03.191949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:03.286887 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be1ef9-3c55-454b-be96-c1288cab3319 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:03.362519 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1c276-f99f-4086-948a-5c6d693eb251 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9180b1616c524905b86769a9eb8f7757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:03.363037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1c276-f99f-4086-948a-5c6d693eb251 service glance] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:03.363319 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1c276-f99f-4086-948a-5c6d693eb251 service glance] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:03.363625 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1c276-f99f-4086-948a-5c6d693eb251 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:03.365265 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-cbc1c276-f99f-4086-948a-5c6d693eb251 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:03.434466 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:03.482372 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1c276-f99f-4086-948a-5c6d693eb251 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:03.483851 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1c276-f99f-4086-948a-5c6d693eb251 service glance] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:03.502858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 693/1394] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:08:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:08:04.244148 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a111a-cbca-4ae3-b5fb-122acc22cd12 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:04.244624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a111a-cbca-4ae3-b5fb-122acc22cd12 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:04.244624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a111a-cbca-4ae3-b5fb-122acc22cd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:04.313765 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-cd1a111a-cbca-4ae3-b5fb-122acc22cd12 None None] MFA Rules not processed for user `c0e57ea982d349c1a86b544e9a6e7758`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:04.314974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-cd1a111a-cbca-4ae3-b5fb-122acc22cd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:04.416357 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 702/1395] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 28 12:08:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:08:04.466416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe34fca-0171-472f-9509-33e5be8cae79 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:04.466999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe34fca-0171-472f-9509-33e5be8cae79 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:04.466999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe34fca-0171-472f-9509-33e5be8cae79 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:04.468374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 694/1396] 10.222.0.16 () {54 vars in 943 bytes} [Wed Sep 28 12:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:04.476204 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bfcea-0b50-4617-9dfa-9ba0011c80c3 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:04.476581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bfcea-0b50-4617-9dfa-9ba0011c80c3 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:04.476913 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bfcea-0b50-4617-9dfa-9ba0011c80c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:04.549794 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:04.558264 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-996bfcea-0b50-4617-9dfa-9ba0011c80c3 None None] MFA Rules not processed for user `822e394e80fd41adb54d330adaf65a68`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:04.559504 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-996bfcea-0b50-4617-9dfa-9ba0011c80c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:04.584942 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a2ecb-4eae-4f6e-b1d9-9ea8e5fab1d0 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:04.585666 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a2ecb-4eae-4f6e-b1d9-9ea8e5fab1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:04.585953 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a2ecb-4eae-4f6e-b1d9-9ea8e5fab1d0 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:04.587321 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 695/1397] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:08:04.592457 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc40e8f-db4b-4ecf-aaa8-d134507f2fc4 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:04.592755 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc40e8f-db4b-4ecf-aaa8-d134507f2fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:04.593032 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc40e8f-db4b-4ecf-aaa8-d134507f2fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:04.660816 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-5fc40e8f-db4b-4ecf-aaa8-d134507f2fc4 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:04.662044 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-5fc40e8f-db4b-4ecf-aaa8-d134507f2fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:04.675796 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 703/1398] 10.222.0.16 () {58 vars in 1040 bytes} [Wed Sep 28 12:08:04 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:08:04.685886 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bfcea-0b50-4617-9dfa-9ba0011c80c3 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:04.696976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bfcea-0b50-4617-9dfa-9ba0011c80c3 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:04.771489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 696/1399] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:08:04.812509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba866b-6233-466f-9058-e0055cdf49c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '822e394e80fd41adb54d330adaf65a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:04.813053 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba866b-6233-466f-9058-e0055cdf49c1 service swift] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:04.813394 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba866b-6233-466f-9058-e0055cdf49c1 service swift] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:04.813666 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba866b-6233-466f-9058-e0055cdf49c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:04.815334 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e9ba866b-6233-466f-9058-e0055cdf49c1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:04.817872 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:04.901109 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba866b-6233-466f-9058-e0055cdf49c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:04.902845 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba866b-6233-466f-9058-e0055cdf49c1 service swift] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:04.910894 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 704/1400] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 28 12:08:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 28 12:08:05.069203 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc40e8f-db4b-4ecf-aaa8-d134507f2fc4 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:05.070337 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-5fc40e8f-db4b-4ecf-aaa8-d134507f2fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:05.101003 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:05.193224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc40e8f-db4b-4ecf-aaa8-d134507f2fc4 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:05.327053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c56d6-f51a-4301-b50f-e1beb775155d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:05.327609 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c56d6-f51a-4301-b50f-e1beb775155d service nova] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:05.327886 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c56d6-f51a-4301-b50f-e1beb775155d service nova] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:05.328152 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c56d6-f51a-4301-b50f-e1beb775155d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:05.330309 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-dd4c56d6-f51a-4301-b50f-e1beb775155d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:05.351526 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:05.431497 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4c56d6-f51a-4301-b50f-e1beb775155d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:05.433142 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4c56d6-f51a-4301-b50f-e1beb775155d service nova] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:05.459855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 697/1401] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:08:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:08:07.685008 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bc3cb-75b3-42e9-a95e-ed24145dc490 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:07.685537 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bc3cb-75b3-42e9-a95e-ed24145dc490 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:07.685537 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bc3cb-75b3-42e9-a95e-ed24145dc490 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:07.688056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 705/1402] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:08:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:07.692216 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9ce81-eb80-4a20-a634-c67a3e0c3d63 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:07.692958 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9ce81-eb80-4a20-a634-c67a3e0c3d63 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:07.693236 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9ce81-eb80-4a20-a634-c67a3e0c3d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:07.774067 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-b6c9ce81-eb80-4a20-a634-c67a3e0c3d63 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:07.775294 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b6c9ce81-eb80-4a20-a634-c67a3e0c3d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:07.887911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:07.899479 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 698/1403] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:08:08.186275 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bc3cb-75b3-42e9-a95e-ed24145dc490 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:08.188686 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-572bc3cb-75b3-42e9-a95e-ed24145dc490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:08.354249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:08.356938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bc3cb-75b3-42e9-a95e-ed24145dc490 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:08.546123 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5753e1-6090-487f-b913-cdb8cbb9d598 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:08.547009 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5753e1-6090-487f-b913-cdb8cbb9d598 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:08.547873 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5753e1-6090-487f-b913-cdb8cbb9d598 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:08.548148 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5753e1-6090-487f-b913-cdb8cbb9d598 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:08.550378 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-fe5753e1-6090-487f-b913-cdb8cbb9d598 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:08.649924 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5753e1-6090-487f-b913-cdb8cbb9d598 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:08.653847 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5753e1-6090-487f-b913-cdb8cbb9d598 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:08.672988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 706/1404] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:08:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:08:10.888986 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404b3ee-59c6-41b0-9fd9-6010102c8aef None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:10.889526 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404b3ee-59c6-41b0-9fd9-6010102c8aef None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:10.889526 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404b3ee-59c6-41b0-9fd9-6010102c8aef None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:10.890781 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 699/1405] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:10.896678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1d21f-ffd9-46d4-beb1-4c7438c13743 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:10.897466 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1d21f-ffd9-46d4-beb1-4c7438c13743 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:10.897756 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1d21f-ffd9-46d4-beb1-4c7438c13743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:10.902573 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:10.972756 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-cdc1d21f-ffd9-46d4-beb1-4c7438c13743 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:10.973975 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-cdc1d21f-ffd9-46d4-beb1-4c7438c13743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:11.085818 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 707/1406] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:08:11.377467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404b3ee-59c6-41b0-9fd9-6010102c8aef None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:11.379494 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-7404b3ee-59c6-41b0-9fd9-6010102c8aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:11.539371 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404b3ee-59c6-41b0-9fd9-6010102c8aef None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:11.616415 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:11.666258 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253608a-a27f-4db7-b699-9de9318a9f66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:11.666859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253608a-a27f-4db7-b699-9de9318a9f66 service nova] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:11.667131 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253608a-a27f-4db7-b699-9de9318a9f66 service nova] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:11.667398 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253608a-a27f-4db7-b699-9de9318a9f66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:11.669011 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-e253608a-a27f-4db7-b699-9de9318a9f66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:11.773888 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253608a-a27f-4db7-b699-9de9318a9f66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:11.775650 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253608a-a27f-4db7-b699-9de9318a9f66 service nova] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:11.795074 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 700/1407] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:08:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:08:21.084142 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=64 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:21.792687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=64 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:27.724612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b04496-ad1e-471f-9e51-a69f8a395aba None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:27.725154 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b04496-ad1e-471f-9e51-a69f8a395aba None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:27.725154 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b04496-ad1e-471f-9e51-a69f8a395aba None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:27.726521 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 708/1408] 10.222.0.16 () {54 vars in 918 bytes} [Wed Sep 28 12:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:27.731724 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcc3f6-655d-4568-a6a6-9226adc8c156 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:27.732171 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcc3f6-655d-4568-a6a6-9226adc8c156 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:27.732304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcc3f6-655d-4568-a6a6-9226adc8c156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:27.807235 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-d4bcc3f6-655d-4568-a6a6-9226adc8c156 None None] MFA Rules not processed for user `09e495edc6fd47c892679bb908c3f5bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:27.808468 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-d4bcc3f6-655d-4568-a6a6-9226adc8c156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:27.913195 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 701/1409] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Sep 28 12:08:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:08:27.927237 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed718773-3387-4e5e-9bd0-59244965b172 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:27.927548 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed718773-3387-4e5e-9bd0-59244965b172 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:27.927828 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed718773-3387-4e5e-9bd0-59244965b172 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:27.929195 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 709/1410] 10.222.0.16 () {54 vars in 918 bytes} [Wed Sep 28 12:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:27.933744 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551f803-72ac-47b3-954a-6d25bde8cdc7 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:27.934032 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551f803-72ac-47b3-954a-6d25bde8cdc7 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:27.934309 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551f803-72ac-47b3-954a-6d25bde8cdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:28.006899 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:28.009875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-4551f803-72ac-47b3-954a-6d25bde8cdc7 None None] MFA Rules not processed for user `0e81804e04514ae882a1fd93789db025`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:28.011612 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-4551f803-72ac-47b3-954a-6d25bde8cdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:28.127087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 702/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Sep 28 12:08:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:08:30.707631 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc898e2-b291-4882-b1cf-b89fc9c33f7a None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:30.708101 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc898e2-b291-4882-b1cf-b89fc9c33f7a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:30.708209 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc898e2-b291-4882-b1cf-b89fc9c33f7a None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:30.709527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 710/1412] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:30.714774 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc8124-9a5c-45f5-bdb1-a88e1d44eb91 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:30.715231 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc8124-9a5c-45f5-bdb1-a88e1d44eb91 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:30.715339 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc8124-9a5c-45f5-bdb1-a88e1d44eb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:30.781995 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-30dc8124-9a5c-45f5-bdb1-a88e1d44eb91 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:30.783209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-30dc8124-9a5c-45f5-bdb1-a88e1d44eb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:30.837899 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:30.880053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 703/1413] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:08:31.167715 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc898e2-b291-4882-b1cf-b89fc9c33f7a None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:31.169251 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-bbc898e2-b291-4882-b1cf-b89fc9c33f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:31.317150 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc898e2-b291-4882-b1cf-b89fc9c33f7a None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:31.390359 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:31.430698 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13faf1-238f-4ee0-b4f5-868807c36a84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:31.431265 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13faf1-238f-4ee0-b4f5-868807c36a84 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:31.431574 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13faf1-238f-4ee0-b4f5-868807c36a84 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:31.431844 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13faf1-238f-4ee0-b4f5-868807c36a84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:31.433424 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-af13faf1-238f-4ee0-b4f5-868807c36a84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:31.523120 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af13faf1-238f-4ee0-b4f5-868807c36a84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:31.524783 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af13faf1-238f-4ee0-b4f5-868807c36a84 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:31.542727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 711/1414] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:08:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:08:32.675093 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ea1b6-9ff3-4231-9998-804cb286e877 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:32.675687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ea1b6-9ff3-4231-9998-804cb286e877 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:32.675687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ea1b6-9ff3-4231-9998-804cb286e877 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:32.677030 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 704/1415] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 12:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:32.683271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526df50-d6a4-4eeb-9cb5-3f1cfa26637d None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:32.683749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526df50-d6a4-4eeb-9cb5-3f1cfa26637d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:32.683870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526df50-d6a4-4eeb-9cb5-3f1cfa26637d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:32.760603 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-3526df50-d6a4-4eeb-9cb5-3f1cfa26637d None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:32.761798 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3526df50-d6a4-4eeb-9cb5-3f1cfa26637d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:32.788788 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:32.974340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 712/1416] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 12:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:08:33.124393 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ea1b6-9ff3-4231-9998-804cb286e877 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:33.125966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-733ea1b6-9ff3-4231-9998-804cb286e877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:33.272524 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ea1b6-9ff3-4231-9998-804cb286e877 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:33.313397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:33.385724 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c353a91-ebff-4c3a-b9c1-0c973e7eb051 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:33.386326 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c353a91-ebff-4c3a-b9c1-0c973e7eb051 service nova] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:33.386606 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c353a91-ebff-4c3a-b9c1-0c973e7eb051 service nova] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:33.386879 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c353a91-ebff-4c3a-b9c1-0c973e7eb051 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:33.388505 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-7c353a91-ebff-4c3a-b9c1-0c973e7eb051 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:33.478544 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c353a91-ebff-4c3a-b9c1-0c973e7eb051 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:33.480162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c353a91-ebff-4c3a-b9c1-0c973e7eb051 service nova] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:33.498545 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 705/1417] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:08:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:08:34.628493 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8af5b0-1fd4-420e-8d99-e9450c401512 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:34.629038 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8af5b0-1fd4-420e-8d99-e9450c401512 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:34.629038 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8af5b0-1fd4-420e-8d99-e9450c401512 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:34.630372 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 713/1418] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 12:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:34.636591 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fdc85-981c-4395-aa6c-9f4b9c2636ad None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:34.637029 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fdc85-981c-4395-aa6c-9f4b9c2636ad None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:34.637144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fdc85-981c-4395-aa6c-9f4b9c2636ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:34.691393 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:34.713275 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-034fdc85-981c-4395-aa6c-9f4b9c2636ad None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:34.714505 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-034fdc85-981c-4395-aa6c-9f4b9c2636ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:34.812054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 706/1419] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 12:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:08:34.963031 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8af5b0-1fd4-420e-8d99-e9450c401512 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:34.964585 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8a8af5b0-1fd4-420e-8d99-e9450c401512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:35.110119 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8af5b0-1fd4-420e-8d99-e9450c401512 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:35.122422 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:35.228209 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f0b3c-4994-4436-8dc4-27964dea58e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:35.228805 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f0b3c-4994-4436-8dc4-27964dea58e1 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:35.229076 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f0b3c-4994-4436-8dc4-27964dea58e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:35.229341 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f0b3c-4994-4436-8dc4-27964dea58e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:35.230906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-380f0b3c-4994-4436-8dc4-27964dea58e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:35.319572 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f0b3c-4994-4436-8dc4-27964dea58e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:35.321149 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f0b3c-4994-4436-8dc4-27964dea58e1 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:35.339577 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 714/1420] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:08:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:08:36.461064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7dd47-1b30-41af-901d-e700d7ade226 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:36.461638 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7dd47-1b30-41af-901d-e700d7ade226 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:36.461638 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7dd47-1b30-41af-901d-e700d7ade226 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:36.462998 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 707/1421] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 12:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:36.469818 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843f457-a421-45f4-bc74-be895b4990c1 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:36.470262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843f457-a421-45f4-bc74-be895b4990c1 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:36.470372 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843f457-a421-45f4-bc74-be895b4990c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:36.490382 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:36.547508 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-6843f457-a421-45f4-bc74-be895b4990c1 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:36.548712 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6843f457-a421-45f4-bc74-be895b4990c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:36.645542 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 715/1422] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 12:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:08:36.797668 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7dd47-1b30-41af-901d-e700d7ade226 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:36.799189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-8cb7dd47-1b30-41af-901d-e700d7ade226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:36.908993 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:36.944854 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7dd47-1b30-41af-901d-e700d7ade226 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:37.071112 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77138066-63da-4f8e-a269-246485a9e2c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:37.071662 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77138066-63da-4f8e-a269-246485a9e2c2 service nova] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:37.071937 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77138066-63da-4f8e-a269-246485a9e2c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:37.072205 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77138066-63da-4f8e-a269-246485a9e2c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:37.073794 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-77138066-63da-4f8e-a269-246485a9e2c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:37.151616 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:37.165065 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77138066-63da-4f8e-a269-246485a9e2c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:37.166651 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77138066-63da-4f8e-a269-246485a9e2c2 service nova] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:37.184091 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 708/1423] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:08:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:08:38.303387 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c65b1a-9d20-4063-9051-f7ffa61aa7ba None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:38.303960 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c65b1a-9d20-4063-9051-f7ffa61aa7ba None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:38.303960 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c65b1a-9d20-4063-9051-f7ffa61aa7ba None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:38.305281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 716/1424] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 12:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:38.312080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97528e-b23d-4b47-b4d1-efe71cc8b758 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:38.312529 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97528e-b23d-4b47-b4d1-efe71cc8b758 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:38.312629 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97528e-b23d-4b47-b4d1-efe71cc8b758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:38.392779 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-4c97528e-b23d-4b47-b4d1-efe71cc8b758 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:38.394033 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-4c97528e-b23d-4b47-b4d1-efe71cc8b758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:38.490460 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 709/1425] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 12:08:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:08:38.640106 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c65b1a-9d20-4063-9051-f7ffa61aa7ba None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:38.641648 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-23c65b1a-9d20-4063-9051-f7ffa61aa7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:38.725252 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:38.788516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c65b1a-9d20-4063-9051-f7ffa61aa7ba None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:38.899609 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ade0f5-9983-45a5-b3f2-9bc971fc5885 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:38.900210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ade0f5-9983-45a5-b3f2-9bc971fc5885 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:38.900482 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ade0f5-9983-45a5-b3f2-9bc971fc5885 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:38.900747 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ade0f5-9983-45a5-b3f2-9bc971fc5885 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:38.902319 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-57ade0f5-9983-45a5-b3f2-9bc971fc5885 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:38.952749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:38.994738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ade0f5-9983-45a5-b3f2-9bc971fc5885 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:38.996358 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ade0f5-9983-45a5-b3f2-9bc971fc5885 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:39.014638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 717/1426] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:08:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:08:40.095135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ae149-5204-49d2-9ca8-bb96600d36e8 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:40.095781 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ae149-5204-49d2-9ca8-bb96600d36e8 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:40.095781 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ae149-5204-49d2-9ca8-bb96600d36e8 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:40.097117 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 710/1427] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 12:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:40.103221 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb4d73-6c0d-427f-b660-fba3f5371318 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:40.103658 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb4d73-6c0d-427f-b660-fba3f5371318 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:40.103817 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb4d73-6c0d-427f-b660-fba3f5371318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:40.188048 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-49bb4d73-6c0d-427f-b660-fba3f5371318 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:40.189268 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-49bb4d73-6c0d-427f-b660-fba3f5371318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:40.284499 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 718/1428] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 12:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:08:40.435362 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ae149-5204-49d2-9ca8-bb96600d36e8 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:40.436848 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-ef5ae149-5204-49d2-9ca8-bb96600d36e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:40.485330 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:40.582336 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ae149-5204-49d2-9ca8-bb96600d36e8 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:40.695281 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c84f8a-52d5-4a5b-a023-c60b5176c39f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:40.695850 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c84f8a-52d5-4a5b-a023-c60b5176c39f service nova] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:40.696114 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c84f8a-52d5-4a5b-a023-c60b5176c39f service nova] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:40.696384 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c84f8a-52d5-4a5b-a023-c60b5176c39f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:40.697987 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-75c84f8a-52d5-4a5b-a023-c60b5176c39f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:40.705851 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:40.790232 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c84f8a-52d5-4a5b-a023-c60b5176c39f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:40.791863 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c84f8a-52d5-4a5b-a023-c60b5176c39f service nova] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:40.809517 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 711/1429] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:08:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:08:41.872415 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223ba72-3ef5-409d-ba88-b71862781ce9 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:41.873505 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223ba72-3ef5-409d-ba88-b71862781ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:41.873505 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223ba72-3ef5-409d-ba88-b71862781ce9 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:41.874833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 719/1430] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 12:08:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:41.881032 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007482b-4461-47b4-9dec-4d7591c96c19 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:41.881439 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007482b-4461-47b4-9dec-4d7591c96c19 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:41.881565 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007482b-4461-47b4-9dec-4d7591c96c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:41.956859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-b007482b-4461-47b4-9dec-4d7591c96c19 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:41.957990 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b007482b-4461-47b4-9dec-4d7591c96c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:42.026012 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:42.055349 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 712/1431] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 12:08:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:08:42.204749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223ba72-3ef5-409d-ba88-b71862781ce9 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:42.206271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f223ba72-3ef5-409d-ba88-b71862781ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:42.232103 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:42.360798 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223ba72-3ef5-409d-ba88-b71862781ce9 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:42.448091 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:42.473456 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757c87b-3832-4735-919d-5c79602e25dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:42.474051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757c87b-3832-4735-919d-5c79602e25dd service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:42.474325 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757c87b-3832-4735-919d-5c79602e25dd service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:42.474593 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757c87b-3832-4735-919d-5c79602e25dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:42.476184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f757c87b-3832-4735-919d-5c79602e25dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:42.564911 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757c87b-3832-4735-919d-5c79602e25dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:42.566484 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757c87b-3832-4735-919d-5c79602e25dd service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:42.584250 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 720/1432] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:08:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:08:43.634009 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb5511-0262-4197-9c45-088fd2458ed9 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:43.634610 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb5511-0262-4197-9c45-088fd2458ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:43.634610 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb5511-0262-4197-9c45-088fd2458ed9 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:43.635929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 713/1433] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 12:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:43.642635 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873afa63-f5b0-4914-a0b9-59a150d234d1 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:43.643102 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873afa63-f5b0-4914-a0b9-59a150d234d1 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:43.643213 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873afa63-f5b0-4914-a0b9-59a150d234d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:43.718876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-873afa63-f5b0-4914-a0b9-59a150d234d1 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:43.720125 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-873afa63-f5b0-4914-a0b9-59a150d234d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:43.761049 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:43.816424 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 721/1434] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 12:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:08:43.966991 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb5511-0262-4197-9c45-088fd2458ed9 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:43.968491 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-01fb5511-0262-4197-9c45-088fd2458ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:44.114536 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb5511-0262-4197-9c45-088fd2458ed9 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:44.170017 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:44.229127 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e4792-52d6-4cde-8982-28f7092d7f67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:44.229668 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e4792-52d6-4cde-8982-28f7092d7f67 service nova] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:44.229948 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e4792-52d6-4cde-8982-28f7092d7f67 service nova] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:44.230222 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e4792-52d6-4cde-8982-28f7092d7f67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:44.231866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-740e4792-52d6-4cde-8982-28f7092d7f67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:44.322777 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e4792-52d6-4cde-8982-28f7092d7f67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:44.324382 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e4792-52d6-4cde-8982-28f7092d7f67 service nova] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:44.343264 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 714/1435] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:08:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:08:45.383530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ead5e-6698-4b6d-8123-0bb87f43ab42 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:45.384099 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ead5e-6698-4b6d-8123-0bb87f43ab42 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:45.384099 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ead5e-6698-4b6d-8123-0bb87f43ab42 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:45.385429 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 722/1436] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 12:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:45.391552 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87808f-9afb-4378-9af8-d8009b2e768c None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:45.391973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87808f-9afb-4378-9af8-d8009b2e768c None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:45.392096 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87808f-9afb-4378-9af8-d8009b2e768c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:45.467083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-ff87808f-9afb-4378-9af8-d8009b2e768c None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:45.468306 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-ff87808f-9afb-4378-9af8-d8009b2e768c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:45.470319 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:45.563717 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 715/1437] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 12:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:08:45.711535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ead5e-6698-4b6d-8123-0bb87f43ab42 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:45.713039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ef2ead5e-6698-4b6d-8123-0bb87f43ab42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:45.857115 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ead5e-6698-4b6d-8123-0bb87f43ab42 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:45.883969 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:45.970228 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344a480-867f-4727-a51c-b70ab1a96a35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:45.970756 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344a480-867f-4727-a51c-b70ab1a96a35 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:45.971035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344a480-867f-4727-a51c-b70ab1a96a35 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:45.971309 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344a480-867f-4727-a51c-b70ab1a96a35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:45.972967 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7344a480-867f-4727-a51c-b70ab1a96a35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:46.061817 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7344a480-867f-4727-a51c-b70ab1a96a35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:46.063375 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7344a480-867f-4727-a51c-b70ab1a96a35 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:46.080769 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 723/1438] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:08:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:08:48.131141 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f624b50-8cda-4f25-8426-8f3b8ce6e4fc None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:48.131736 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f624b50-8cda-4f25-8426-8f3b8ce6e4fc None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:48.131736 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f624b50-8cda-4f25-8426-8f3b8ce6e4fc None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:48.133122 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 716/1439] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:48.138468 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f8f66-b81b-4b49-a737-6d87672417dc None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:48.138894 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f8f66-b81b-4b49-a737-6d87672417dc None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:48.138995 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f8f66-b81b-4b49-a737-6d87672417dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:48.179366 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:48.204934 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-f93f8f66-b81b-4b49-a737-6d87672417dc None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:48.206151 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f93f8f66-b81b-4b49-a737-6d87672417dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:48.301144 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 724/1440] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:08:48.584728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f624b50-8cda-4f25-8426-8f3b8ce6e4fc None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:48.586263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-3f624b50-8cda-4f25-8426-8f3b8ce6e4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:48.688571 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f624b50-8cda-4f25-8426-8f3b8ce6e4fc None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:48.721883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:48.765539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183b63f-00e3-4608-978f-b1f154eefeca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:48.766150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183b63f-00e3-4608-978f-b1f154eefeca service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:48.766429 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183b63f-00e3-4608-978f-b1f154eefeca service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:48.766704 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183b63f-00e3-4608-978f-b1f154eefeca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:48.768330 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-5183b63f-00e3-4608-978f-b1f154eefeca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:48.877156 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183b63f-00e3-4608-978f-b1f154eefeca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:48.878689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183b63f-00e3-4608-978f-b1f154eefeca service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:48.896931 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 717/1441] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:08:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:08:51.173266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3349078-2fd9-41f1-aa33-4e41e81add6d None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:51.173852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3349078-2fd9-41f1-aa33-4e41e81add6d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:51.173852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3349078-2fd9-41f1-aa33-4e41e81add6d None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:51.175151 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 725/1442] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:51.180505 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7932b-869f-4f2e-8f9c-e78f00933e2c None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:51.180967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7932b-869f-4f2e-8f9c-e78f00933e2c None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:51.181068 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7932b-869f-4f2e-8f9c-e78f00933e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:51.247875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-e6f7932b-869f-4f2e-8f9c-e78f00933e2c None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:51.249096 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-e6f7932b-869f-4f2e-8f9c-e78f00933e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:51.262004 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:51.346973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 718/1443] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:08:51.629177 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3349078-2fd9-41f1-aa33-4e41e81add6d None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:51.630701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b3349078-2fd9-41f1-aa33-4e41e81add6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:51.734649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3349078-2fd9-41f1-aa33-4e41e81add6d None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:51.748489 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:51.810860 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4ce1b-89b3-429f-b9f7-af122e9cd5b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:51.811491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4ce1b-89b3-429f-b9f7-af122e9cd5b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:51.811776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4ce1b-89b3-429f-b9f7-af122e9cd5b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:51.812050 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4ce1b-89b3-429f-b9f7-af122e9cd5b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:51.813632 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5ec4ce1b-89b3-429f-b9f7-af122e9cd5b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:51.922694 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4ce1b-89b3-429f-b9f7-af122e9cd5b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:51.924090 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4ce1b-89b3-429f-b9f7-af122e9cd5b2 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:51.942681 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 726/1444] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:08:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:08:54.391112 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19d8a9-8211-4d9b-96ce-36fc9044e975 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:54.391733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19d8a9-8211-4d9b-96ce-36fc9044e975 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:54.391733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19d8a9-8211-4d9b-96ce-36fc9044e975 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:54.393026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 719/1445] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:54.398385 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644a879-4cc2-4367-b9ea-c8d2517dc60f None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:54.398833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644a879-4cc2-4367-b9ea-c8d2517dc60f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:54.398931 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644a879-4cc2-4367-b9ea-c8d2517dc60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:54.446346 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:54.464193 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-1644a879-4cc2-4367-b9ea-c8d2517dc60f None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:54.465887 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-1644a879-4cc2-4367-b9ea-c8d2517dc60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:54.560288 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 727/1446] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:08:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:08:54.849551 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19d8a9-8211-4d9b-96ce-36fc9044e975 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:54.851236 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-ce19d8a9-8211-4d9b-96ce-36fc9044e975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:54.954242 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19d8a9-8211-4d9b-96ce-36fc9044e975 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:54.994602 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:55.030501 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f7506-46c1-407f-bfe2-5cac64e86ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:55.031110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f7506-46c1-407f-bfe2-5cac64e86ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:55.031391 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f7506-46c1-407f-bfe2-5cac64e86ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:55.031704 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f7506-46c1-407f-bfe2-5cac64e86ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:55.033300 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-dd4f7506-46c1-407f-bfe2-5cac64e86ff8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:55.151854 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f7506-46c1-407f-bfe2-5cac64e86ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:55.153321 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f7506-46c1-407f-bfe2-5cac64e86ff8 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:55.170792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 720/1447] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:08:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:08:57.457661 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2cfe5-ffb9-4bdb-a551-9019ad1de6a6 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:57.458290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2cfe5-ffb9-4bdb-a551-9019ad1de6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:57.458290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2cfe5-ffb9-4bdb-a551-9019ad1de6a6 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:57.459569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 728/1448] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:57.464749 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc7cf4-e4e7-4879-b32c-86c188ccc4d7 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:57.465708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc7cf4-e4e7-4879-b32c-86c188ccc4d7 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:57.465836 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc7cf4-e4e7-4879-b32c-86c188ccc4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:57.530890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-38fc7cf4-e4e7-4879-b32c-86c188ccc4d7 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:57.532109 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-38fc7cf4-e4e7-4879-b32c-86c188ccc4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:57.552174 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:57.628434 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 721/1449] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:08:57.914629 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2cfe5-ffb9-4bdb-a551-9019ad1de6a6 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:57.916274 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f6a2cfe5-ffb9-4bdb-a551-9019ad1de6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:58.019893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2cfe5-ffb9-4bdb-a551-9019ad1de6a6 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:58.040155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:58.094296 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a9743-0c12-42b4-9aa5-722c833fb310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:58.094905 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a9743-0c12-42b4-9aa5-722c833fb310 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:58.095181 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a9743-0c12-42b4-9aa5-722c833fb310 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:58.095473 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a9743-0c12-42b4-9aa5-722c833fb310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:58.097066 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b91a9743-0c12-42b4-9aa5-722c833fb310 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:58.205725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a9743-0c12-42b4-9aa5-722c833fb310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:58.207062 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a9743-0c12-42b4-9aa5-722c833fb310 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:58.225222 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 729/1450] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:08:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:09:00.535616 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f04e0-6309-46dd-b237-c224a14e924f None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:00.536153 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f04e0-6309-46dd-b237-c224a14e924f None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:00.536153 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f04e0-6309-46dd-b237-c224a14e924f None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:00.537491 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 722/1451] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:00.543063 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fe52a-35e1-4303-bbb9-08594127a7c2 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:00.544013 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fe52a-35e1-4303-bbb9-08594127a7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:00.544176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fe52a-35e1-4303-bbb9-08594127a7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:00.606969 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:00.609829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-ab3fe52a-35e1-4303-bbb9-08594127a7c2 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:00.611572 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ab3fe52a-35e1-4303-bbb9-08594127a7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:00.705936 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 730/1452] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:09:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:09:00.991509 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f04e0-6309-46dd-b237-c224a14e924f None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:00.993064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-8a8f04e0-6309-46dd-b237-c224a14e924f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:01.095983 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f04e0-6309-46dd-b237-c224a14e924f None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:01.145945 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:01.170129 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f013c-ad4e-4eff-bf0a-daa8dff9829a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:01.170734 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f013c-ad4e-4eff-bf0a-daa8dff9829a service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:01.171016 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f013c-ad4e-4eff-bf0a-daa8dff9829a service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:01.171291 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f013c-ad4e-4eff-bf0a-daa8dff9829a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:01.172933 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-fa6f013c-ad4e-4eff-bf0a-daa8dff9829a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:01.284753 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f013c-ad4e-4eff-bf0a-daa8dff9829a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:01.286196 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f013c-ad4e-4eff-bf0a-daa8dff9829a service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:01.304323 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 723/1453] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:09:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:09:03.488790 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde06507-d2b1-4f47-a7b2-067041a3049b None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:03.489350 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde06507-d2b1-4f47-a7b2-067041a3049b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:03.489350 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde06507-d2b1-4f47-a7b2-067041a3049b None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:03.490730 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 731/1454] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:03.496515 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10f423-eced-4156-85e1-5a701445fa10 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:03.496921 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10f423-eced-4156-85e1-5a701445fa10 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:03.497064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10f423-eced-4156-85e1-5a701445fa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:03.562919 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-1e10f423-eced-4156-85e1-5a701445fa10 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:03.564149 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-1e10f423-eced-4156-85e1-5a701445fa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:03.592964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:03.663807 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 724/1455] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:09:03.950483 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde06507-d2b1-4f47-a7b2-067041a3049b None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:03.952094 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-dde06507-d2b1-4f47-a7b2-067041a3049b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:04.055406 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde06507-d2b1-4f47-a7b2-067041a3049b None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:04.084189 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:04.130528 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e496d2f-bf58-4558-b0ec-3a053fb7c7bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:04.131132 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e496d2f-bf58-4558-b0ec-3a053fb7c7bc service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:04.131412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e496d2f-bf58-4558-b0ec-3a053fb7c7bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:04.131713 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e496d2f-bf58-4558-b0ec-3a053fb7c7bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:04.133307 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0e496d2f-bf58-4558-b0ec-3a053fb7c7bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:04.241870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e496d2f-bf58-4558-b0ec-3a053fb7c7bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:04.243217 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e496d2f-bf58-4558-b0ec-3a053fb7c7bc service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:04.262807 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 732/1456] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:09:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:09:06.471148 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796899c7-8f2b-4f56-9449-d05569c82f9d None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:06.471718 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796899c7-8f2b-4f56-9449-d05569c82f9d None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:06.471718 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796899c7-8f2b-4f56-9449-d05569c82f9d None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:06.473043 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 725/1457] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:06.478391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a1738-667f-4072-9844-0ab0c6a51bd8 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:06.478853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a1738-667f-4072-9844-0ab0c6a51bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:06.478953 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a1738-667f-4072-9844-0ab0c6a51bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:06.544979 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-201a1738-667f-4072-9844-0ab0c6a51bd8 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:06.546170 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-201a1738-667f-4072-9844-0ab0c6a51bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:06.554538 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:06.641517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 733/1458] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:09:06.931396 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796899c7-8f2b-4f56-9449-d05569c82f9d None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:06.932969 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-796899c7-8f2b-4f56-9449-d05569c82f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:07.035572 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796899c7-8f2b-4f56-9449-d05569c82f9d None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:07.094836 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:07.113785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686c869-387b-4191-baf7-b07b79313a81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:07.114395 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686c869-387b-4191-baf7-b07b79313a81 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:07.114674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686c869-387b-4191-baf7-b07b79313a81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:07.114946 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686c869-387b-4191-baf7-b07b79313a81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:07.116579 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-1686c869-387b-4191-baf7-b07b79313a81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:07.226058 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1686c869-387b-4191-baf7-b07b79313a81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:07.227415 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1686c869-387b-4191-baf7-b07b79313a81 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:07.248066 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 726/1459] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:09:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:09:09.465433 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bd440-8eea-4f76-b28d-74bafedbacc1 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:09.465973 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bd440-8eea-4f76-b28d-74bafedbacc1 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:09.465973 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bd440-8eea-4f76-b28d-74bafedbacc1 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:09.467309 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 734/1460] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:09:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:09.472526 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547711c9-0f7c-475c-9c6e-9d1a1d851348 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:09.472987 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547711c9-0f7c-475c-9c6e-9d1a1d851348 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:09.473094 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547711c9-0f7c-475c-9c6e-9d1a1d851348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:09.538819 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-547711c9-0f7c-475c-9c6e-9d1a1d851348 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:09.540062 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-547711c9-0f7c-475c-9c6e-9d1a1d851348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:09.578036 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:09.636696 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 727/1461] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:09:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:09:09.915930 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243bd440-8eea-4f76-b28d-74bafedbacc1 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:09.918004 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-243bd440-8eea-4f76-b28d-74bafedbacc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:10.021424 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243bd440-8eea-4f76-b28d-74bafedbacc1 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:10.059396 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:10.096311 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcbfb39-004d-4b91-9709-8c8008dc9cca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:10.096908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbfb39-004d-4b91-9709-8c8008dc9cca service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:10.097182 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbfb39-004d-4b91-9709-8c8008dc9cca service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:10.097446 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbfb39-004d-4b91-9709-8c8008dc9cca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:10.099012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-efcbfb39-004d-4b91-9709-8c8008dc9cca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:10.207583 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcbfb39-004d-4b91-9709-8c8008dc9cca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:10.208957 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcbfb39-004d-4b91-9709-8c8008dc9cca service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:10.227229 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 735/1462] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:09:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:09:12.371777 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e747f-8d61-49f3-9e9e-51c9631cf802 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:12.372330 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e747f-8d61-49f3-9e9e-51c9631cf802 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:12.372330 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e747f-8d61-49f3-9e9e-51c9631cf802 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:12.373592 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 728/1463] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:12.378903 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca9c4a-985d-4334-8b05-44182ea9fa55 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:12.379302 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca9c4a-985d-4334-8b05-44182ea9fa55 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:12.379459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca9c4a-985d-4334-8b05-44182ea9fa55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:12.447239 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-88ca9c4a-985d-4334-8b05-44182ea9fa55 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:12.448524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-88ca9c4a-985d-4334-8b05-44182ea9fa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:12.467032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:12.545866 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 736/1464] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:09:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:09:12.829295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e747f-8d61-49f3-9e9e-51c9631cf802 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:12.830847 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b08e747f-8d61-49f3-9e9e-51c9631cf802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:12.934460 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e747f-8d61-49f3-9e9e-51c9631cf802 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:13.003010 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:13.009894 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2798e-8f34-4e45-a033-da6d6579f89a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:13.010501 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2798e-8f34-4e45-a033-da6d6579f89a service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:13.010781 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2798e-8f34-4e45-a033-da6d6579f89a service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:13.011571 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2798e-8f34-4e45-a033-da6d6579f89a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:13.013163 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-33e2798e-8f34-4e45-a033-da6d6579f89a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:13.123287 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2798e-8f34-4e45-a033-da6d6579f89a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:13.124814 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2798e-8f34-4e45-a033-da6d6579f89a service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:13.143025 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 729/1465] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:09:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:09:15.312871 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3a79d-cb8a-48d2-bbd6-9a1dd8ec44a0 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:15.313436 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3a79d-cb8a-48d2-bbd6-9a1dd8ec44a0 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:15.313436 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3a79d-cb8a-48d2-bbd6-9a1dd8ec44a0 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:15.314806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 737/1466] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:15.320218 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8cb62-466c-44b7-89c8-547f85a07fe5 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:15.320639 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8cb62-466c-44b7-89c8-547f85a07fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:15.320776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8cb62-466c-44b7-89c8-547f85a07fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:15.387837 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-ece8cb62-466c-44b7-89c8-547f85a07fe5 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:15.389054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-ece8cb62-466c-44b7-89c8-547f85a07fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:15.437148 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:15.485902 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 730/1467] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:09:15.773037 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3a79d-cb8a-48d2-bbd6-9a1dd8ec44a0 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:15.774559 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-eef3a79d-cb8a-48d2-bbd6-9a1dd8ec44a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:15.877566 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3a79d-cb8a-48d2-bbd6-9a1dd8ec44a0 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:15.925021 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:15.950818 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8da15d-c46c-4a4e-a25f-1b824991cf6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:15.951409 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8da15d-c46c-4a4e-a25f-1b824991cf6c service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:15.951718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8da15d-c46c-4a4e-a25f-1b824991cf6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:15.951984 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8da15d-c46c-4a4e-a25f-1b824991cf6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:15.953556 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3e8da15d-c46c-4a4e-a25f-1b824991cf6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:16.060456 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8da15d-c46c-4a4e-a25f-1b824991cf6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:16.061878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8da15d-c46c-4a4e-a25f-1b824991cf6c service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:16.079562 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 738/1468] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:09:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:09:25.484362 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=22 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:26.077335 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=66 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:35.912247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41ea9d-b9f3-40ef-a67c-9a2c0895abae None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:35.912752 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41ea9d-b9f3-40ef-a67c-9a2c0895abae None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:35.912858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41ea9d-b9f3-40ef-a67c-9a2c0895abae None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:35.914211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 731/1469] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:35.920220 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b305d9f-5379-4fb1-89ec-91c9c8a96b09 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:35.920688 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b305d9f-5379-4fb1-89ec-91c9c8a96b09 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:35.920800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b305d9f-5379-4fb1-89ec-91c9c8a96b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:35.988066 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-4b305d9f-5379-4fb1-89ec-91c9c8a96b09 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:35.989289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-4b305d9f-5379-4fb1-89ec-91c9c8a96b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:36.085232 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 739/1470] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:09:36.382157 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427de38d-7071-413a-a010-483fcb0cc235 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:36.382442 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427de38d-7071-413a-a010-483fcb0cc235 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:36.382714 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427de38d-7071-413a-a010-483fcb0cc235 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:36.384158 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 732/1471] 10.222.0.16 () {54 vars in 962 bytes} [Wed Sep 28 12:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:36.389841 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddb0c0-0735-45d3-84c2-7b6e984dd29a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:36.390124 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddb0c0-0735-45d3-84c2-7b6e984dd29a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:36.390390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddb0c0-0735-45d3-84c2-7b6e984dd29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:36.469581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-24ddb0c0-0735-45d3-84c2-7b6e984dd29a None None] MFA Rules not processed for user `9180b1616c524905b86769a9eb8f7757`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:36.470804 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-24ddb0c0-0735-45d3-84c2-7b6e984dd29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:36.491363 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:36.547483 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 740/1472] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Sep 28 12:09:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:09:36.555176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427de38d-7071-413a-a010-483fcb0cc235 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:36.557282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-427de38d-7071-413a-a010-483fcb0cc235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:36.660036 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427de38d-7071-413a-a010-483fcb0cc235 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:36.734538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df820c8-5b4f-4148-8796-f8339ca78069 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9180b1616c524905b86769a9eb8f7757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:36.735151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df820c8-5b4f-4148-8796-f8339ca78069 service glance] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:36.735445 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df820c8-5b4f-4148-8796-f8339ca78069 service glance] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:36.735733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df820c8-5b4f-4148-8796-f8339ca78069 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:36.737434 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-2df820c8-5b4f-4148-8796-f8339ca78069 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:36.791685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:36.846581 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df820c8-5b4f-4148-8796-f8339ca78069 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:36.848022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df820c8-5b4f-4148-8796-f8339ca78069 service glance] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:36.867114 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 733/1473] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:09:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:09:39.103723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a54cae-37a5-488d-990f-50395b75c80a None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:39.104168 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a54cae-37a5-488d-990f-50395b75c80a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:39.104279 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a54cae-37a5-488d-990f-50395b75c80a None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:39.105596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 741/1474] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:39.110708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf4312-f068-4dff-a0d7-da502f0f6ea7 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:39.111116 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf4312-f068-4dff-a0d7-da502f0f6ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:39.111250 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf4312-f068-4dff-a0d7-da502f0f6ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:39.178193 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-8ccf4312-f068-4dff-a0d7-da502f0f6ea7 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:39.179326 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-8ccf4312-f068-4dff-a0d7-da502f0f6ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:39.273126 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 734/1475] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:09:39.543079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a54cae-37a5-488d-990f-50395b75c80a None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:39.544657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-85a54cae-37a5-488d-990f-50395b75c80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:39.669892 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a54cae-37a5-488d-990f-50395b75c80a None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:39.719898 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:39.764715 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710d7c0-da2e-456f-ab12-1d96ff33c3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:39.765319 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710d7c0-da2e-456f-ab12-1d96ff33c3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:39.765592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710d7c0-da2e-456f-ab12-1d96ff33c3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:39.765858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710d7c0-da2e-456f-ab12-1d96ff33c3b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:39.766487 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710d7c0-da2e-456f-ab12-1d96ff33c3b5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:39.768210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: WARNING py.warnings [None req-9710d7c0-da2e-456f-ab12-1d96ff33c3b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:09:39.768210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: warnings.warn(msg) Sep 28 12:09:39.768210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: Sep 28 12:09:39.769338 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710d7c0-da2e-456f-ab12-1d96ff33c3b5 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:39.789888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 742/1476] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:39 2022] GET /identity/v3/projects => generated 2553 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:09:41.971856 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0e1c1-0b72-4051-847e-c3c4b7067af0 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:41.972414 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0e1c1-0b72-4051-847e-c3c4b7067af0 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:41.972414 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0e1c1-0b72-4051-847e-c3c4b7067af0 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:41.973680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 735/1477] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:41.979574 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bcfba-998b-48f2-90c9-efc5fe78b759 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:41.980005 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bcfba-998b-48f2-90c9-efc5fe78b759 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:41.980109 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bcfba-998b-48f2-90c9-efc5fe78b759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:42.045532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b44bcfba-998b-48f2-90c9-efc5fe78b759 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:42.046725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b44bcfba-998b-48f2-90c9-efc5fe78b759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:42.144691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 743/1478] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:09:42.434859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0e1c1-0b72-4051-847e-c3c4b7067af0 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:42.436456 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b2d0e1c1-0b72-4051-847e-c3c4b7067af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:42.446477 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:42.580248 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0e1c1-0b72-4051-847e-c3c4b7067af0 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:42.661038 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:42.693958 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bba933-1902-4672-987f-7e04e2ea2258 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:42.694502 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bba933-1902-4672-987f-7e04e2ea2258 service nova] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:42.694776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bba933-1902-4672-987f-7e04e2ea2258 service nova] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:42.695046 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bba933-1902-4672-987f-7e04e2ea2258 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:42.697169 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-f2bba933-1902-4672-987f-7e04e2ea2258 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:42.788264 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bba933-1902-4672-987f-7e04e2ea2258 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:42.789848 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bba933-1902-4672-987f-7e04e2ea2258 service nova] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:42.807103 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 736/1479] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:09:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:09:45.124684 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a9777-8443-487f-b77c-e5914a4da775 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:45.125258 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a9777-8443-487f-b77c-e5914a4da775 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:45.125258 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a9777-8443-487f-b77c-e5914a4da775 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:45.126590 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 744/1480] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:09:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:45.131850 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67f91d-b950-4b06-9999-5949aaf8d625 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:45.132280 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67f91d-b950-4b06-9999-5949aaf8d625 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:45.132385 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67f91d-b950-4b06-9999-5949aaf8d625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:45.197798 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-0e67f91d-b950-4b06-9999-5949aaf8d625 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:45.199010 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-0e67f91d-b950-4b06-9999-5949aaf8d625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:45.245892 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:45.295725 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 737/1481] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:09:45.585413 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a9777-8443-487f-b77c-e5914a4da775 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:45.587760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-014a9777-8443-487f-b77c-e5914a4da775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:45.612826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:45.692431 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a9777-8443-487f-b77c-e5914a4da775 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:45.768524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1450a-983e-4b5a-b2d2-3bf8e13f2611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:45.769126 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1450a-983e-4b5a-b2d2-3bf8e13f2611 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:45.769404 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1450a-983e-4b5a-b2d2-3bf8e13f2611 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:45.769671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1450a-983e-4b5a-b2d2-3bf8e13f2611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:45.771253 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-60e1450a-983e-4b5a-b2d2-3bf8e13f2611 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:45.846118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:45.880504 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1450a-983e-4b5a-b2d2-3bf8e13f2611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:45.881923 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1450a-983e-4b5a-b2d2-3bf8e13f2611 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:45.902340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 745/1482] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:09:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:09:48.115651 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c34e0e-7837-4cca-959c-42cb58ebbb24 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:48.116188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c34e0e-7837-4cca-959c-42cb58ebbb24 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:48.116188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c34e0e-7837-4cca-959c-42cb58ebbb24 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:48.117535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 738/1483] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:48.123558 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab229e-d12d-4f1f-947f-f3551480fbd5 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:48.124010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab229e-d12d-4f1f-947f-f3551480fbd5 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:48.124119 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab229e-d12d-4f1f-947f-f3551480fbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:48.189489 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-ecab229e-d12d-4f1f-947f-f3551480fbd5 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:48.190692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ecab229e-d12d-4f1f-947f-f3551480fbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:48.285945 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 746/1484] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:09:48.580252 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c34e0e-7837-4cca-959c-42cb58ebbb24 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:48.581777 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-a4c34e0e-7837-4cca-959c-42cb58ebbb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:48.685942 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c34e0e-7837-4cca-959c-42cb58ebbb24 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:48.758379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:48.760054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b405e-1903-463a-a03b-1e138fcfd546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:48.760727 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b405e-1903-463a-a03b-1e138fcfd546 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:48.761192 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b405e-1903-463a-a03b-1e138fcfd546 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:48.761680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b405e-1903-463a-a03b-1e138fcfd546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:48.763543 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-458b405e-1903-463a-a03b-1e138fcfd546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:48.872441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b405e-1903-463a-a03b-1e138fcfd546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:48.873836 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b405e-1903-463a-a03b-1e138fcfd546 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:48.892579 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 739/1485] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:09:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:09:51.126081 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad22ce9-711c-48ac-b29a-7cd0fc2a5de8 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:51.126650 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad22ce9-711c-48ac-b29a-7cd0fc2a5de8 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:51.126650 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad22ce9-711c-48ac-b29a-7cd0fc2a5de8 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:51.128030 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 747/1486] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:51.133228 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db202d-e38c-45d3-980b-9e32a668afe6 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:51.134200 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db202d-e38c-45d3-980b-9e32a668afe6 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:51.134299 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db202d-e38c-45d3-980b-9e32a668afe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:51.200512 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-28db202d-e38c-45d3-980b-9e32a668afe6 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:51.201723 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-28db202d-e38c-45d3-980b-9e32a668afe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:51.260346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:51.306015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 740/1487] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:09:51.597050 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad22ce9-711c-48ac-b29a-7cd0fc2a5de8 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:51.598623 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-fad22ce9-711c-48ac-b29a-7cd0fc2a5de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:51.635603 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:51.702468 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad22ce9-711c-48ac-b29a-7cd0fc2a5de8 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:51.776272 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9660c-addf-435c-a396-7eb160f6a84c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:51.776903 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9660c-addf-435c-a396-7eb160f6a84c service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:51.777143 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9660c-addf-435c-a396-7eb160f6a84c service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:51.777410 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9660c-addf-435c-a396-7eb160f6a84c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:51.778983 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-cfd9660c-addf-435c-a396-7eb160f6a84c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:51.857733 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:51.887316 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9660c-addf-435c-a396-7eb160f6a84c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:51.888771 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9660c-addf-435c-a396-7eb160f6a84c service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:51.906243 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 748/1488] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:09:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:09:54.249177 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1150a1d-f645-440c-8c48-bded620beae8 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:54.249772 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1150a1d-f645-440c-8c48-bded620beae8 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:54.249772 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1150a1d-f645-440c-8c48-bded620beae8 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:54.251052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 741/1489] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 28 12:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:54.256278 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb133b6a-93e3-4a4c-bcd0-7cb9bee44a9c None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:54.256684 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb133b6a-93e3-4a4c-bcd0-7cb9bee44a9c None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:54.256838 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb133b6a-93e3-4a4c-bcd0-7cb9bee44a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:54.324309 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-cb133b6a-93e3-4a4c-bcd0-7cb9bee44a9c None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:54.325512 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-cb133b6a-93e3-4a4c-bcd0-7cb9bee44a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:54.421780 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 749/1490] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:09:54.717463 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1150a1d-f645-440c-8c48-bded620beae8 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:54.719009 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-a1150a1d-f645-440c-8c48-bded620beae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:54.822666 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1150a1d-f645-440c-8c48-bded620beae8 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:54.896059 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a104cba-a140-48f4-984c-4094a502ad63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:54.896595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a104cba-a140-48f4-984c-4094a502ad63 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:54.896875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a104cba-a140-48f4-984c-4094a502ad63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:54.897145 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a104cba-a140-48f4-984c-4094a502ad63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:54.898750 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-2a104cba-a140-48f4-984c-4094a502ad63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:54.908980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:55.010991 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a104cba-a140-48f4-984c-4094a502ad63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:55.012437 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a104cba-a140-48f4-984c-4094a502ad63 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:55.029977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 742/1491] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:09:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:10:04.420206 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=82 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:05.027632 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=50 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:11.201426 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb78a1-b84a-45ac-8d08-0bf11bdd0865 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:11.202019 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb78a1-b84a-45ac-8d08-0bf11bdd0865 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:11.202019 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb78a1-b84a-45ac-8d08-0bf11bdd0865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:11.280497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-afeb78a1-b84a-45ac-8d08-0bf11bdd0865 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:11:11.281719 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-afeb78a1-b84a-45ac-8d08-0bf11bdd0865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:11.376811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 750/1492] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:11:11.385347 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa4742-8d6e-4c1b-99c2-2da40270502c None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:11.385831 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa4742-8d6e-4c1b-99c2-2da40270502c None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:11.385928 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa4742-8d6e-4c1b-99c2-2da40270502c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:11.467786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-b8aa4742-8d6e-4c1b-99c2-2da40270502c None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:11:11.468898 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b8aa4742-8d6e-4c1b-99c2-2da40270502c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:11.563996 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 743/1493] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:11:11.569303 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb78a1-b84a-45ac-8d08-0bf11bdd0865 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:11.570617 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-afeb78a1-b84a-45ac-8d08-0bf11bdd0865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:11.582031 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb78a1-b84a-45ac-8d08-0bf11bdd0865 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:11.643839 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:11.678106 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3e6e0-6a96-4e0b-8830-4bd84ac0013b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:11.678715 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3e6e0-6a96-4e0b-8830-4bd84ac0013b admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:11.678993 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3e6e0-6a96-4e0b-8830-4bd84ac0013b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:11.679266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3e6e0-6a96-4e0b-8830-4bd84ac0013b admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:11.679941 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3e6e0-6a96-4e0b-8830-4bd84ac0013b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:11:11.680245 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3e6e0-6a96-4e0b-8830-4bd84ac0013b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:11.681254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: WARNING py.warnings [None req-54b3e6e0-6a96-4e0b-8830-4bd84ac0013b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:11:11.681254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: warnings.warn(msg) Sep 28 12:11:11.681254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: Sep 28 12:11:11.682137 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3e6e0-6a96-4e0b-8830-4bd84ac0013b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:11.693916 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 751/1494] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:11.703556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa4742-8d6e-4c1b-99c2-2da40270502c None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:11.712760 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa4742-8d6e-4c1b-99c2-2da40270502c None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:11.774062 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:11.807345 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a851ab-3a9f-4aef-9d16-2fe25aedd8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:11.807985 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a851ab-3a9f-4aef-9d16-2fe25aedd8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:11.808263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a851ab-3a9f-4aef-9d16-2fe25aedd8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:11.808530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a851ab-3a9f-4aef-9d16-2fe25aedd8c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:11.809161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a851ab-3a9f-4aef-9d16-2fe25aedd8c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:11.810914 dv-cinder-859193-2-smb devstack@keystone.service[81599]: WARNING py.warnings [None req-a3a851ab-3a9f-4aef-9d16-2fe25aedd8c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:11:11.810914 dv-cinder-859193-2-smb devstack@keystone.service[81599]: warnings.warn(msg) Sep 28 12:11:11.810914 dv-cinder-859193-2-smb devstack@keystone.service[81599]: Sep 28 12:11:11.812134 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a851ab-3a9f-4aef-9d16-2fe25aedd8c1 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:11.867365 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 744/1495] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:11:11 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:11:11.871586 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3e6e0-6a96-4e0b-8830-4bd84ac0013b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:11.873280 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-54b3e6e0-6a96-4e0b-8830-4bd84ac0013b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:11.907331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3e6e0-6a96-4e0b-8830-4bd84ac0013b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:12.004402 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c4261-1eb7-409b-b697-cb254e5b17c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:12.005007 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c4261-1eb7-409b-b697-cb254e5b17c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:12.005286 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c4261-1eb7-409b-b697-cb254e5b17c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:12.005557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c4261-1eb7-409b-b697-cb254e5b17c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:12.006185 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c4261-1eb7-409b-b697-cb254e5b17c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:12.007200 dv-cinder-859193-2-smb devstack@keystone.service[81598]: WARNING py.warnings [None req-3f1c4261-1eb7-409b-b697-cb254e5b17c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:11:12.007200 dv-cinder-859193-2-smb devstack@keystone.service[81598]: warnings.warn(msg) Sep 28 12:11:12.007200 dv-cinder-859193-2-smb devstack@keystone.service[81598]: Sep 28 12:11:12.008439 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c4261-1eb7-409b-b697-cb254e5b17c4 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:12.050733 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 752/1496] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:11:11 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:11:12.055300 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a851ab-3a9f-4aef-9d16-2fe25aedd8c1 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:12.056912 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-a3a851ab-3a9f-4aef-9d16-2fe25aedd8c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:12.118516 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a851ab-3a9f-4aef-9d16-2fe25aedd8c1 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:12.199709 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:12.210449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae291b-608d-4c04-ad09-287f2a83c734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:12.211044 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae291b-608d-4c04-ad09-287f2a83c734 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:12.211320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae291b-608d-4c04-ad09-287f2a83c734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:12.211624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae291b-608d-4c04-ad09-287f2a83c734 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:12.212258 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae291b-608d-4c04-ad09-287f2a83c734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:12.213269 dv-cinder-859193-2-smb devstack@keystone.service[81599]: WARNING py.warnings [None req-d8ae291b-608d-4c04-ad09-287f2a83c734 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:11:12.213269 dv-cinder-859193-2-smb devstack@keystone.service[81599]: warnings.warn(msg) Sep 28 12:11:12.213269 dv-cinder-859193-2-smb devstack@keystone.service[81599]: Sep 28 12:11:12.214141 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae291b-608d-4c04-ad09-287f2a83c734 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:12.226914 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 745/1497] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:11:12.231082 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c4261-1eb7-409b-b697-cb254e5b17c4 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:12.232631 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3f1c4261-1eb7-409b-b697-cb254e5b17c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:12.244949 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c4261-1eb7-409b-b697-cb254e5b17c4 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:12.270086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:12.351470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd7518-b5d8-43a6-865f-1e2cc34b25e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:12.352033 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd7518-b5d8-43a6-865f-1e2cc34b25e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:12.352335 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd7518-b5d8-43a6-865f-1e2cc34b25e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:12.352601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd7518-b5d8-43a6-865f-1e2cc34b25e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:12.353238 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd7518-b5d8-43a6-865f-1e2cc34b25e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:12.354244 dv-cinder-859193-2-smb devstack@keystone.service[81598]: WARNING py.warnings [None req-70bd7518-b5d8-43a6-865f-1e2cc34b25e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:11:12.354244 dv-cinder-859193-2-smb devstack@keystone.service[81598]: warnings.warn(msg) Sep 28 12:11:12.354244 dv-cinder-859193-2-smb devstack@keystone.service[81598]: Sep 28 12:11:12.355120 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd7518-b5d8-43a6-865f-1e2cc34b25e9 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:12.367623 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 753/1498] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:11:12.371839 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae291b-608d-4c04-ad09-287f2a83c734 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:12.373396 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-d8ae291b-608d-4c04-ad09-287f2a83c734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:12.409974 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae291b-608d-4c04-ad09-287f2a83c734 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:12.621530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919bade-7828-4384-84e0-4d64dd8bd402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:12.622089 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919bade-7828-4384-84e0-4d64dd8bd402 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:12.622362 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919bade-7828-4384-84e0-4d64dd8bd402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:12.622629 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919bade-7828-4384-84e0-4d64dd8bd402 admin admin] PATH_INFO: `/v3/projects/43021e656b4a4b91abb89e26efdbb9ee/users/20e6849d82f64d68ab1285ba25757b58/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:12.645547 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919bade-7828-4384-84e0-4d64dd8bd402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43021e656b4a4b91abb89e26efdbb9ee, user_id=20e6849d82f64d68ab1285ba25757b58, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:12.646550 dv-cinder-859193-2-smb devstack@keystone.service[81599]: WARNING py.warnings [None req-f919bade-7828-4384-84e0-4d64dd8bd402 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:11:12.646550 dv-cinder-859193-2-smb devstack@keystone.service[81599]: warnings.warn(msg) Sep 28 12:11:12.646550 dv-cinder-859193-2-smb devstack@keystone.service[81599]: Sep 28 12:11:12.648485 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919bade-7828-4384-84e0-4d64dd8bd402 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:12.676516 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 746/1499] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:11:12 2022] PUT /identity/v3/projects/43021e656b4a4b91abb89e26efdbb9ee/users/20e6849d82f64d68ab1285ba25757b58/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:11:12.688553 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d43790-7b2f-4e29-9e6d-5a060631de9e None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:12.688839 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d43790-7b2f-4e29-9e6d-5a060631de9e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:12.689115 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d43790-7b2f-4e29-9e6d-5a060631de9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:12.746519 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-97d43790-7b2f-4e29-9e6d-5a060631de9e None None] MFA Rules not processed for user `20e6849d82f64d68ab1285ba25757b58`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:11:12.747772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-97d43790-7b2f-4e29-9e6d-5a060631de9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:12.827213 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 754/1500] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:11:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:11:12.840260 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78918fb-321e-43ce-afc1-564afe4fef10 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:12.840540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78918fb-321e-43ce-afc1-564afe4fef10 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:12.840807 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78918fb-321e-43ce-afc1-564afe4fef10 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:12.842116 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 747/1501] 10.222.0.16 () {54 vars in 963 bytes} [Wed Sep 28 12:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:11:12.846869 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b511f1-db0e-491d-9d17-6100b2b55973 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:12.847153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b511f1-db0e-491d-9d17-6100b2b55973 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:12.847452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b511f1-db0e-491d-9d17-6100b2b55973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:12.879700 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:12.924040 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-a5b511f1-db0e-491d-9d17-6100b2b55973 None None] MFA Rules not processed for user `f09354b404d94e9db2e21292a61a06f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:11:12.925243 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a5b511f1-db0e-491d-9d17-6100b2b55973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:13.002086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 755/1502] 10.222.0.16 () {58 vars in 1060 bytes} [Wed Sep 28 12:11:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:11:13.010638 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78918fb-321e-43ce-afc1-564afe4fef10 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:13.012203 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-a78918fb-321e-43ce-afc1-564afe4fef10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:13.066017 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:13.119397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78918fb-321e-43ce-afc1-564afe4fef10 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:13.190506 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59161d15-3e7c-43b7-a696-82628780dc6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:13.191036 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59161d15-3e7c-43b7-a696-82628780dc6f service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:13.191918 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59161d15-3e7c-43b7-a696-82628780dc6f service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:13.192203 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59161d15-3e7c-43b7-a696-82628780dc6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:13.193764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-59161d15-3e7c-43b7-a696-82628780dc6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:13.288973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59161d15-3e7c-43b7-a696-82628780dc6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:13.290380 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59161d15-3e7c-43b7-a696-82628780dc6f service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:13.293811 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:13.309290 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 748/1503] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:11:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:11:13.354177 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c592e34-5c46-4d69-8c1b-55648d4b551b None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:13.355960 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c592e34-5c46-4d69-8c1b-55648d4b551b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:13.355960 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c592e34-5c46-4d69-8c1b-55648d4b551b None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:13.356254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 756/1504] 10.222.0.16 () {52 vars in 830 bytes} [Wed Sep 28 12:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:11:13.360562 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59161d15-3e7c-43b7-a696-82628780dc6f service cinder] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:13.361769 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-59161d15-3e7c-43b7-a696-82628780dc6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:13.462219 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59161d15-3e7c-43b7-a696-82628780dc6f service cinder] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:13.555670 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b72ac4-374f-4d47-a741-07c456118180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:13.556290 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b72ac4-374f-4d47-a741-07c456118180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:13.556565 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b72ac4-374f-4d47-a741-07c456118180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:13.556834 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b72ac4-374f-4d47-a741-07c456118180 admin admin] PATH_INFO: `/v3/users/20e6849d82f64d68ab1285ba25757b58` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:13.569393 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b72ac4-374f-4d47-a741-07c456118180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20e6849d82f64d68ab1285ba25757b58)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:13.570426 dv-cinder-859193-2-smb devstack@keystone.service[81599]: WARNING py.warnings [None req-c5b72ac4-374f-4d47-a741-07c456118180 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:11:13.570426 dv-cinder-859193-2-smb devstack@keystone.service[81599]: warnings.warn(msg) Sep 28 12:11:13.570426 dv-cinder-859193-2-smb devstack@keystone.service[81599]: Sep 28 12:11:13.571757 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b72ac4-374f-4d47-a741-07c456118180 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:13.581271 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:13.636249 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c5b72ac4-374f-4d47-a741-07c456118180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20e6849d82f64d68ab1285ba25757b58'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:11:13.658216 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c5b72ac4-374f-4d47-a741-07c456118180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20e6849d82f64d68ab1285ba25757b58'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:11:13.658674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c5b72ac4-374f-4d47-a741-07c456118180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20e6849d82f64d68ab1285ba25757b58'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:11:13.668225 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c5b72ac4-374f-4d47-a741-07c456118180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20e6849d82f64d68ab1285ba25757b58'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:11:13.682658 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c5b72ac4-374f-4d47-a741-07c456118180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20e6849d82f64d68ab1285ba25757b58'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:11:13.688320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 749/1505] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:11:13 2022] DELETE /identity/v3/users/20e6849d82f64d68ab1285ba25757b58 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:11:13.694091 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ee868-9ed4-4584-a66c-0cd8ac9fb1da None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:13.694605 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ee868-9ed4-4584-a66c-0cd8ac9fb1da None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:13.695080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ee868-9ed4-4584-a66c-0cd8ac9fb1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:13.752951 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-e99ee868-9ed4-4584-a66c-0cd8ac9fb1da None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:11:13.754120 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e99ee868-9ed4-4584-a66c-0cd8ac9fb1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:13.828533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:13.841869 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 757/1506] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:11:13.851929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b72ac4-374f-4d47-a741-07c456118180 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:13.853148 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-c5b72ac4-374f-4d47-a741-07c456118180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:13.954082 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b72ac4-374f-4d47-a741-07c456118180 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:14.009052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:14.032116 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681dafe-30ef-4940-91cc-512e149f581a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:14.032732 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681dafe-30ef-4940-91cc-512e149f581a service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:14.033008 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681dafe-30ef-4940-91cc-512e149f581a service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:14.033272 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681dafe-30ef-4940-91cc-512e149f581a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:14.034859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-e681dafe-30ef-4940-91cc-512e149f581a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:14.140896 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681dafe-30ef-4940-91cc-512e149f581a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:14.142311 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681dafe-30ef-4940-91cc-512e149f581a service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:14.161367 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 750/1507] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:11:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:11:14.491628 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ee868-9ed4-4584-a66c-0cd8ac9fb1da None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:14.493127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e99ee868-9ed4-4584-a66c-0cd8ac9fb1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:14.506528 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ee868-9ed4-4584-a66c-0cd8ac9fb1da None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:14.602241 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb06712-58f2-438a-b474-3c384216b4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:14.602821 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb06712-58f2-438a-b474-3c384216b4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:14.603093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb06712-58f2-438a-b474-3c384216b4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:14.603357 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb06712-58f2-438a-b474-3c384216b4ba admin admin] PATH_INFO: `/v3/projects/43021e656b4a4b91abb89e26efdbb9ee` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:14.613719 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb06712-58f2-438a-b474-3c384216b4ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=43021e656b4a4b91abb89e26efdbb9ee)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:14.614757 dv-cinder-859193-2-smb devstack@keystone.service[81598]: WARNING py.warnings [None req-1fb06712-58f2-438a-b474-3c384216b4ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:11:14.614757 dv-cinder-859193-2-smb devstack@keystone.service[81598]: warnings.warn(msg) Sep 28 12:11:14.614757 dv-cinder-859193-2-smb devstack@keystone.service[81598]: Sep 28 12:11:14.615971 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb06712-58f2-438a-b474-3c384216b4ba admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:14.673617 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-1fb06712-58f2-438a-b474-3c384216b4ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43021e656b4a4b91abb89e26efdbb9ee', 'request_id': 'req-1fb06712-58f2-438a-b474-3c384216b4ba'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:11:14.680670 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-1fb06712-58f2-438a-b474-3c384216b4ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43021e656b4a4b91abb89e26efdbb9ee', 'request_id': 'req-1fb06712-58f2-438a-b474-3c384216b4ba'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:11:14.694221 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-1fb06712-58f2-438a-b474-3c384216b4ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43021e656b4a4b91abb89e26efdbb9ee', 'request_id': 'req-1fb06712-58f2-438a-b474-3c384216b4ba'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:11:14.719658 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-1fb06712-58f2-438a-b474-3c384216b4ba admin admin] The token cache is being invalidate because project 43021e656b4a4b91abb89e26efdbb9ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:11:14.719945 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-1fb06712-58f2-438a-b474-3c384216b4ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:11:14.720370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-1fb06712-58f2-438a-b474-3c384216b4ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:11:14.721767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 758/1508] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:11:14 2022] DELETE /identity/v3/projects/43021e656b4a4b91abb89e26efdbb9ee => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:11:24.158431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=62 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:24.717605 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:50.037697 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c84132-7165-4c6a-b5ee-405d072648c7 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:50.038283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c84132-7165-4c6a-b5ee-405d072648c7 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:50.038283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c84132-7165-4c6a-b5ee-405d072648c7 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:50.039647 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 751/1509] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 12:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:12:50.044740 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d4d28-3906-4d12-a32d-374fa0fd21b8 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:50.045158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d4d28-3906-4d12-a32d-374fa0fd21b8 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:50.045288 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d4d28-3906-4d12-a32d-374fa0fd21b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:50.127357 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-2a6d4d28-3906-4d12-a32d-374fa0fd21b8 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:12:50.128588 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-2a6d4d28-3906-4d12-a32d-374fa0fd21b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:12:50.229419 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 759/1510] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 12:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:12:50.384917 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c84132-7165-4c6a-b5ee-405d072648c7 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:50.387030 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b1c84132-7165-4c6a-b5ee-405d072648c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:12:50.506074 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c84132-7165-4c6a-b5ee-405d072648c7 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:50.511565 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d64c4-a770-499a-8796-e05050bcf7b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:50.512169 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d64c4-a770-499a-8796-e05050bcf7b3 service nova] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:50.512457 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d64c4-a770-499a-8796-e05050bcf7b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:50.512731 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d64c4-a770-499a-8796-e05050bcf7b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:50.521207 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d64c4-a770-499a-8796-e05050bcf7b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:50.522779 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d64c4-a770-499a-8796-e05050bcf7b3 service nova] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:50.532649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 752/1511] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:12:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:12:51.612841 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26240bb0-8c26-49a1-816c-f8ac4d185f90 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:51.613526 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26240bb0-8c26-49a1-816c-f8ac4d185f90 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:51.613526 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26240bb0-8c26-49a1-816c-f8ac4d185f90 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:51.614734 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 760/1512] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 12:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:12:51.621508 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f0105-034e-4075-be6c-80086e5c6705 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:51.621969 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f0105-034e-4075-be6c-80086e5c6705 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:51.622081 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f0105-034e-4075-be6c-80086e5c6705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:51.641276 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-3e7f0105-034e-4075-be6c-80086e5c6705 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:12:51.642495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-3e7f0105-034e-4075-be6c-80086e5c6705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:12:51.650307 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 753/1513] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 12:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:12:51.804143 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26240bb0-8c26-49a1-816c-f8ac4d185f90 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:51.818408 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26240bb0-8c26-49a1-816c-f8ac4d185f90 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:51.823847 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2266f-e82f-43b0-8e30-706fdfd65684 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:51.824439 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2266f-e82f-43b0-8e30-706fdfd65684 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:51.824717 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2266f-e82f-43b0-8e30-706fdfd65684 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:51.824986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2266f-e82f-43b0-8e30-706fdfd65684 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:51.833531 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2266f-e82f-43b0-8e30-706fdfd65684 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:51.835088 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2266f-e82f-43b0-8e30-706fdfd65684 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:51.845217 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 761/1514] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:12:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:12:52.028080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040f39b-bc2e-4aac-ad7b-118bfe6d33d9 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:52.028356 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040f39b-bc2e-4aac-ad7b-118bfe6d33d9 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:52.028619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040f39b-bc2e-4aac-ad7b-118bfe6d33d9 None None] PATH_INFO: `/v3` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:52.029895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 754/1515] 10.222.0.50 () {54 vars in 925 bytes} [Wed Sep 28 12:12:52 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:12:52.036331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c63764-b6d2-48c3-a470-3e7eeabeea1a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:52.036610 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c63764-b6d2-48c3-a470-3e7eeabeea1a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:52.036879 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c63764-b6d2-48c3-a470-3e7eeabeea1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:52.095514 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-f9c63764-b6d2-48c3-a470-3e7eeabeea1a None None] MFA Rules not processed for user `09e495edc6fd47c892679bb908c3f5bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:12:52.096637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f9c63764-b6d2-48c3-a470-3e7eeabeea1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:12:52.113656 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:52.168574 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 762/1516] 10.222.0.50 () {58 vars in 1015 bytes} [Wed Sep 28 12:12:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:12:55.785072 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ae499-39fe-4c58-b18f-cacf9fd3f029 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:55.785529 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ae499-39fe-4c58-b18f-cacf9fd3f029 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:55.785626 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ae499-39fe-4c58-b18f-cacf9fd3f029 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:55.786928 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 755/1517] 10.222.0.16 () {54 vars in 961 bytes} [Wed Sep 28 12:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:12:55.792127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee2b49-9dc4-4b31-afaa-53e4b124f49a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:55.792639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee2b49-9dc4-4b31-afaa-53e4b124f49a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:55.792748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee2b49-9dc4-4b31-afaa-53e4b124f49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:55.813261 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-21ee2b49-9dc4-4b31-afaa-53e4b124f49a None None] MFA Rules not processed for user `09e495edc6fd47c892679bb908c3f5bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:12:55.814545 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-21ee2b49-9dc4-4b31-afaa-53e4b124f49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:12:55.823295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 763/1518] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Sep 28 12:12:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:12:55.831120 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ae499-39fe-4c58-b18f-cacf9fd3f029 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:55.844968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ae499-39fe-4c58-b18f-cacf9fd3f029 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:55.849892 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9d996-5169-48e9-8e06-23bdca453f05 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09e495edc6fd47c892679bb908c3f5bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:55.850477 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9d996-5169-48e9-8e06-23bdca453f05 service placement] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:55.850755 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9d996-5169-48e9-8e06-23bdca453f05 service placement] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:55.851024 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9d996-5169-48e9-8e06-23bdca453f05 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:55.859391 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9d996-5169-48e9-8e06-23bdca453f05 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:55.861572 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9d996-5169-48e9-8e06-23bdca453f05 service placement] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:55.871474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 756/1519] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:12:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:13:03.326352 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1043c-dc4f-4093-adbc-05fcf83a75b0 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:03.326920 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1043c-dc4f-4093-adbc-05fcf83a75b0 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:03.326920 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1043c-dc4f-4093-adbc-05fcf83a75b0 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:03.328329 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 764/1520] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 12:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:13:03.334445 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82990d-5b0e-4aa6-b7d1-7f7d47cf47a8 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:03.334875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82990d-5b0e-4aa6-b7d1-7f7d47cf47a8 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:03.334982 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82990d-5b0e-4aa6-b7d1-7f7d47cf47a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:03.354592 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-bb82990d-5b0e-4aa6-b7d1-7f7d47cf47a8 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:13:03.355837 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-bb82990d-5b0e-4aa6-b7d1-7f7d47cf47a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:13:03.364267 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 757/1521] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 12:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:13:03.518914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1043c-dc4f-4093-adbc-05fcf83a75b0 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:03.533390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1043c-dc4f-4093-adbc-05fcf83a75b0 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:03.538724 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece6f95-57c1-4506-9d07-d05dae3adb17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:03.539313 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece6f95-57c1-4506-9d07-d05dae3adb17 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:03.539617 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece6f95-57c1-4506-9d07-d05dae3adb17 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:03.539885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece6f95-57c1-4506-9d07-d05dae3adb17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:03.547796 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece6f95-57c1-4506-9d07-d05dae3adb17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:03.549350 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece6f95-57c1-4506-9d07-d05dae3adb17 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:03.558550 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 765/1522] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:13:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:13:04.638318 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3de7dc-c468-4f2d-8fc8-42c60e2d2979 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:04.638886 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3de7dc-c468-4f2d-8fc8-42c60e2d2979 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:04.638886 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3de7dc-c468-4f2d-8fc8-42c60e2d2979 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:04.640210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 758/1523] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 12:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:13:04.646636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9100c3-4c4e-4457-a7e4-3255394627fd None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:04.647057 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9100c3-4c4e-4457-a7e4-3255394627fd None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:04.647175 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9100c3-4c4e-4457-a7e4-3255394627fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:04.667042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-0a9100c3-4c4e-4457-a7e4-3255394627fd None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:13:04.668290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0a9100c3-4c4e-4457-a7e4-3255394627fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:13:04.676641 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 766/1524] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 12:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:13:04.828847 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3de7dc-c468-4f2d-8fc8-42c60e2d2979 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:04.843064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3de7dc-c468-4f2d-8fc8-42c60e2d2979 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:04.848506 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e46d1-4c07-40dd-b9ff-fa09d366438d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:04.849092 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e46d1-4c07-40dd-b9ff-fa09d366438d service nova] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:04.849371 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e46d1-4c07-40dd-b9ff-fa09d366438d service nova] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:04.849640 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e46d1-4c07-40dd-b9ff-fa09d366438d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:04.857502 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e46d1-4c07-40dd-b9ff-fa09d366438d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:04.859074 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e46d1-4c07-40dd-b9ff-fa09d366438d service nova] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:04.868833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 759/1525] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:13:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:13:09.077395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53865cf-f286-45cd-af26-dc77dd7291e1 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:09.077958 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53865cf-f286-45cd-af26-dc77dd7291e1 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:09.077958 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53865cf-f286-45cd-af26-dc77dd7291e1 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:09.079306 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 767/1526] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:13:09.084685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf1a9e-606b-48e1-8e71-65f16d414825 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:09.085121 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf1a9e-606b-48e1-8e71-65f16d414825 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:09.085245 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf1a9e-606b-48e1-8e71-65f16d414825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:09.104485 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-a0bf1a9e-606b-48e1-8e71-65f16d414825 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:13:09.105680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-a0bf1a9e-606b-48e1-8e71-65f16d414825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:13:09.114010 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 760/1527] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:13:09.398899 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53865cf-f286-45cd-af26-dc77dd7291e1 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:09.400871 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a53865cf-f286-45cd-af26-dc77dd7291e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:13:09.479590 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53865cf-f286-45cd-af26-dc77dd7291e1 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:09.483125 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88492a-11d0-456c-8242-5aaa63c9a851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:09.483750 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88492a-11d0-456c-8242-5aaa63c9a851 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:09.484026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88492a-11d0-456c-8242-5aaa63c9a851 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:09.484916 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88492a-11d0-456c-8242-5aaa63c9a851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:09.493884 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88492a-11d0-456c-8242-5aaa63c9a851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:09.495309 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88492a-11d0-456c-8242-5aaa63c9a851 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:09.504620 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 768/1528] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:13:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:13:11.636391 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4296f5-7d07-45f7-b18c-eb55cb47c70b None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:11.637002 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4296f5-7d07-45f7-b18c-eb55cb47c70b None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:11.637002 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4296f5-7d07-45f7-b18c-eb55cb47c70b None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:11.638287 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 761/1529] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:13:11.643516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508dee9-702e-4428-9f6b-f6f789bd734a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:11.643950 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508dee9-702e-4428-9f6b-f6f789bd734a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:11.644069 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508dee9-702e-4428-9f6b-f6f789bd734a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:11.664454 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-d508dee9-702e-4428-9f6b-f6f789bd734a None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:13:11.665643 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d508dee9-702e-4428-9f6b-f6f789bd734a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:13:11.673948 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 769/1530] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:13:11.959420 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4296f5-7d07-45f7-b18c-eb55cb47c70b None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:11.971081 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4296f5-7d07-45f7-b18c-eb55cb47c70b None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:11.974653 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedbe3f-90f7-4fb3-b80b-e912289f8c04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:11.975242 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedbe3f-90f7-4fb3-b80b-e912289f8c04 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:11.975558 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedbe3f-90f7-4fb3-b80b-e912289f8c04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:11.975833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedbe3f-90f7-4fb3-b80b-e912289f8c04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:11.984568 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caedbe3f-90f7-4fb3-b80b-e912289f8c04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:11.985976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caedbe3f-90f7-4fb3-b80b-e912289f8c04 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:11.995395 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 762/1531] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:13:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:13:15.600426 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d1d92-8ede-49f4-a8f7-8654f6e94938 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:15.600426 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d1d92-8ede-49f4-a8f7-8654f6e94938 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:15.601083 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d1d92-8ede-49f4-a8f7-8654f6e94938 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:15.602161 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 770/1532] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:13:15.608066 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e10b6d-74d6-44ea-bc7a-993a9a91be68 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:15.608628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e10b6d-74d6-44ea-bc7a-993a9a91be68 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:15.608736 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e10b6d-74d6-44ea-bc7a-993a9a91be68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:15.617317 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=81 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:15.629541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-a7e10b6d-74d6-44ea-bc7a-993a9a91be68 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:13:15.630745 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-a7e10b6d-74d6-44ea-bc7a-993a9a91be68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:13:15.638800 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 763/1533] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:13:15.943226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d1d92-8ede-49f4-a8f7-8654f6e94938 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:15.944938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3f7d1d92-8ede-49f4-a8f7-8654f6e94938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:13:16.009363 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:16.023558 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d1d92-8ede-49f4-a8f7-8654f6e94938 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:16.027141 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4597341-7942-406d-9cb1-ad1605d44720 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:16.027776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4597341-7942-406d-9cb1-ad1605d44720 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:16.028057 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4597341-7942-406d-9cb1-ad1605d44720 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:16.028329 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4597341-7942-406d-9cb1-ad1605d44720 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:16.037842 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4597341-7942-406d-9cb1-ad1605d44720 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:16.039249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4597341-7942-406d-9cb1-ad1605d44720 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:16.048610 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 771/1534] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:13:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:13:18.201768 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0a517-3de9-4db0-bee9-8a46e8c4beaa None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:18.202322 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0a517-3de9-4db0-bee9-8a46e8c4beaa None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:18.202322 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0a517-3de9-4db0-bee9-8a46e8c4beaa None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:18.203754 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 764/1535] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:13:18.209059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c1eee-4c59-4073-91ee-bfcd2fcfd68a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:18.209493 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c1eee-4c59-4073-91ee-bfcd2fcfd68a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:18.209599 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c1eee-4c59-4073-91ee-bfcd2fcfd68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:18.228887 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-bf8c1eee-4c59-4073-91ee-bfcd2fcfd68a None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:13:18.230102 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-bf8c1eee-4c59-4073-91ee-bfcd2fcfd68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:13:18.238474 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 772/1536] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:13:18.538888 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0a517-3de9-4db0-bee9-8a46e8c4beaa None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:18.540601 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-66e0a517-3de9-4db0-bee9-8a46e8c4beaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:13:18.554044 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0a517-3de9-4db0-bee9-8a46e8c4beaa None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:18.557610 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dfbae-0e99-4ebb-adb4-126e14ed25e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:18.558202 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dfbae-0e99-4ebb-adb4-126e14ed25e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:18.558482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dfbae-0e99-4ebb-adb4-126e14ed25e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:18.558755 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dfbae-0e99-4ebb-adb4-126e14ed25e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:18.567970 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dfbae-0e99-4ebb-adb4-126e14ed25e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:18.569405 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dfbae-0e99-4ebb-adb4-126e14ed25e1 service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:18.578924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 765/1537] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:13:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:13:28.224022 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=11 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:28.574663 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=8 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:48.471608 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9c258-77ba-4f84-81f6-dc7f8400fbb5 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:48.472652 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9c258-77ba-4f84-81f6-dc7f8400fbb5 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:48.473129 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9c258-77ba-4f84-81f6-dc7f8400fbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:48.500709 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-c5f9c258-77ba-4f84-81f6-dc7f8400fbb5 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:48.501922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c5f9c258-77ba-4f84-81f6-dc7f8400fbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:48.520758 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 773/1538] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:14:48.529451 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8310f3-b39d-45ff-b30a-9ca8bd09bf15 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:48.530033 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8310f3-b39d-45ff-b30a-9ca8bd09bf15 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:48.530033 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8310f3-b39d-45ff-b30a-9ca8bd09bf15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:48.562130 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-8f8310f3-b39d-45ff-b30a-9ca8bd09bf15 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:48.563527 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-8f8310f3-b39d-45ff-b30a-9ca8bd09bf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:48.576117 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 766/1539] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:48.580770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9c258-77ba-4f84-81f6-dc7f8400fbb5 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:48.593209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ce013-c141-43ad-9469-6591fabe0569 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:48.593209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ce013-c141-43ad-9469-6591fabe0569 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:48.593209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ce013-c141-43ad-9469-6591fabe0569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:48.598818 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9c258-77ba-4f84-81f6-dc7f8400fbb5 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:48.620901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2408a-6a0e-491c-bb7e-a7e94a86f1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:48.621858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2408a-6a0e-491c-bb7e-a7e94a86f1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:48.622443 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2408a-6a0e-491c-bb7e-a7e94a86f1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:48.622881 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2408a-6a0e-491c-bb7e-a7e94a86f1c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:48.623736 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2408a-6a0e-491c-bb7e-a7e94a86f1c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:14:48.624219 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2408a-6a0e-491c-bb7e-a7e94a86f1c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:48.626001 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2408a-6a0e-491c-bb7e-a7e94a86f1c0 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:48.629343 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-b92ce013-c141-43ad-9469-6591fabe0569 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:48.630509 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b92ce013-c141-43ad-9469-6591fabe0569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:48.644283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 774/1540] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:14:48.645856 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6722fb1-7a7b-4c5f-8ebe-d4500a4d7b66 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:48.646312 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6722fb1-7a7b-4c5f-8ebe-d4500a4d7b66 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:48.646755 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6722fb1-7a7b-4c5f-8ebe-d4500a4d7b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:48.651501 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 767/1541] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:48.668188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ce013-c141-43ad-9469-6591fabe0569 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:48.681223 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ce013-c141-43ad-9469-6591fabe0569 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:48.685600 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-f6722fb1-7a7b-4c5f-8ebe-d4500a4d7b66 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:48.687022 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f6722fb1-7a7b-4c5f-8ebe-d4500a4d7b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:48.695848 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74caf177-acf6-43e5-83b5-07342b4f63fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:48.696707 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74caf177-acf6-43e5-83b5-07342b4f63fe admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:48.697157 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74caf177-acf6-43e5-83b5-07342b4f63fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:48.697935 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74caf177-acf6-43e5-83b5-07342b4f63fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:48.700517 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74caf177-acf6-43e5-83b5-07342b4f63fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:48.703974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 775/1542] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:48.705442 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0465e0-af4f-420c-ae8c-38dea138ce1d None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:48.706267 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74caf177-acf6-43e5-83b5-07342b4f63fe admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:48.710071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0465e0-af4f-420c-ae8c-38dea138ce1d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:48.710071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0465e0-af4f-420c-ae8c-38dea138ce1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:48.734893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-cd0465e0-af4f-420c-ae8c-38dea138ce1d None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:48.736095 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-cd0465e0-af4f-420c-ae8c-38dea138ce1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:48.745899 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 776/1543] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:48.747360 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f1e08-f1d5-4a90-abf5-4c456cd393d2 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:48.747691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f1e08-f1d5-4a90-abf5-4c456cd393d2 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:48.748130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f1e08-f1d5-4a90-abf5-4c456cd393d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:48.754215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 768/1544] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:14:48 2022] POST /identity/v3/projects => generated 377 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:14:48.755384 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceab3de-1837-40b4-9ac1-130127d7d8ac None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:48.755703 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceab3de-1837-40b4-9ac1-130127d7d8ac None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:48.756033 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceab3de-1837-40b4-9ac1-130127d7d8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:48.774105 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-202f1e08-f1d5-4a90-abf5-4c456cd393d2 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:48.775318 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-202f1e08-f1d5-4a90-abf5-4c456cd393d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:48.783634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-7ceab3de-1837-40b4-9ac1-130127d7d8ac None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:48.784822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-7ceab3de-1837-40b4-9ac1-130127d7d8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:48.839856 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 777/1545] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:48.841849 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c31b2d-a6d6-4a3d-a94e-2929ad56a32a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:48.842137 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c31b2d-a6d6-4a3d-a94e-2929ad56a32a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:48.842480 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c31b2d-a6d6-4a3d-a94e-2929ad56a32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:48.848797 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 769/1546] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:48.851180 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28635c81-3669-434a-b49e-8bd93ed28b67 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:48.851717 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28635c81-3669-434a-b49e-8bd93ed28b67 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:48.852019 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28635c81-3669-434a-b49e-8bd93ed28b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:48.863759 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-c7c31b2d-a6d6-4a3d-a94e-2929ad56a32a None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:48.864979 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c7c31b2d-a6d6-4a3d-a94e-2929ad56a32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:48.871622 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-28635c81-3669-434a-b49e-8bd93ed28b67 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:48.872828 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-28635c81-3669-434a-b49e-8bd93ed28b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:48.873208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 778/1547] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:48.874459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4103a-a13b-4b37-83d7-b7be289adb25 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:48.874738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4103a-a13b-4b37-83d7-b7be289adb25 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:48.875013 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4103a-a13b-4b37-83d7-b7be289adb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:48.886477 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 770/1548] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:48.888265 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8814d-7419-4729-a860-3349eb7a4abd None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:48.888546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8814d-7419-4729-a860-3349eb7a4abd None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:48.888820 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8814d-7419-4729-a860-3349eb7a4abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:48.897324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b2d4103a-a13b-4b37-83d7-b7be289adb25 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:48.898024 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b2d4103a-a13b-4b37-83d7-b7be289adb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:48.906908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 779/1549] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:48.907740 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4103a-a13b-4b37-83d7-b7be289adb25 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:48.910687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-26e8814d-7419-4729-a860-3349eb7a4abd None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:48.911899 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-26e8814d-7419-4729-a860-3349eb7a4abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:48.920574 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 771/1550] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:48.921790 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f34b9-8cde-45b7-9378-0db84de248b8 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:48.922039 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f34b9-8cde-45b7-9378-0db84de248b8 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:48.922307 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f34b9-8cde-45b7-9378-0db84de248b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:48.923835 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4103a-a13b-4b37-83d7-b7be289adb25 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:48.928555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51a92f-e7db-4fe0-b4db-28cad5bcaf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:48.929186 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51a92f-e7db-4fe0-b4db-28cad5bcaf76 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:48.929467 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51a92f-e7db-4fe0-b4db-28cad5bcaf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:48.929740 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51a92f-e7db-4fe0-b4db-28cad5bcaf76 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:48.930368 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51a92f-e7db-4fe0-b4db-28cad5bcaf76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:48.932340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51a92f-e7db-4fe0-b4db-28cad5bcaf76 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:48.941837 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-ad7f34b9-8cde-45b7-9378-0db84de248b8 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:48.943040 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-ad7f34b9-8cde-45b7-9378-0db84de248b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:48.952017 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 772/1551] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:48.952858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f34b9-8cde-45b7-9378-0db84de248b8 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:48.958838 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 780/1552] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:14:48 2022] POST /identity/v3/users => generated 289 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:14:48.958838 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153d32c-a346-4c77-9889-0ccf52543555 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:48.958838 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153d32c-a346-4c77-9889-0ccf52543555 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:48.958838 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153d32c-a346-4c77-9889-0ccf52543555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:48.962740 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f34b9-8cde-45b7-9378-0db84de248b8 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:48.968128 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9e820-40ff-4b99-add6-cef716c567e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:48.968712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9e820-40ff-4b99-add6-cef716c567e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:48.968993 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9e820-40ff-4b99-add6-cef716c567e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:48.969269 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9e820-40ff-4b99-add6-cef716c567e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:48.969919 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9e820-40ff-4b99-add6-cef716c567e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:14:48.970225 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9e820-40ff-4b99-add6-cef716c567e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:48.971245 dv-cinder-859193-2-smb devstack@keystone.service[81599]: WARNING py.warnings [None req-adf9e820-40ff-4b99-add6-cef716c567e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:14:48.971245 dv-cinder-859193-2-smb devstack@keystone.service[81599]: warnings.warn(msg) Sep 28 12:14:48.971245 dv-cinder-859193-2-smb devstack@keystone.service[81599]: Sep 28 12:14:48.972159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9e820-40ff-4b99-add6-cef716c567e9 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:48.979376 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-3153d32c-a346-4c77-9889-0ccf52543555 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:48.980620 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3153d32c-a346-4c77-9889-0ccf52543555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:48.991737 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 773/1553] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:14:48.991737 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f87f9-3f70-4e23-aa77-3951973004c8 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:48.991737 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f87f9-3f70-4e23-aa77-3951973004c8 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:48.991737 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f87f9-3f70-4e23-aa77-3951973004c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:48.992165 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 781/1554] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:48.992165 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153d32c-a346-4c77-9889-0ccf52543555 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.002135 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153d32c-a346-4c77-9889-0ccf52543555 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:49.006828 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab509b8-b999-46ad-bdea-37257a81e9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:49.007424 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab509b8-b999-46ad-bdea-37257a81e9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.007760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab509b8-b999-46ad-bdea-37257a81e9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.008036 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab509b8-b999-46ad-bdea-37257a81e9b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.008748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab509b8-b999-46ad-bdea-37257a81e9b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:14:49.008980 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab509b8-b999-46ad-bdea-37257a81e9b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:49.009601 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-437f87f9-3f70-4e23-aa77-3951973004c8 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:49.010564 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab509b8-b999-46ad-bdea-37257a81e9b6 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:49.010801 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-437f87f9-3f70-4e23-aa77-3951973004c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:49.019469 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 774/1555] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:49.020682 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697648f4-02bc-4974-892d-fe20b430a0a6 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.020967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697648f4-02bc-4974-892d-fe20b430a0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.021240 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697648f4-02bc-4974-892d-fe20b430a0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.023394 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 782/1556] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:14:49.024224 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab509b8-b999-46ad-bdea-37257a81e9b6 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.035813 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab509b8-b999-46ad-bdea-37257a81e9b6 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:49.040393 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5cdebe-686e-4776-9e84-6a3dcc421970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:49.040859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-697648f4-02bc-4974-892d-fe20b430a0a6 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:49.040987 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cdebe-686e-4776-9e84-6a3dcc421970 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.041230 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cdebe-686e-4776-9e84-6a3dcc421970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.041501 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cdebe-686e-4776-9e84-6a3dcc421970 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.042049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-697648f4-02bc-4974-892d-fe20b430a0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:49.042147 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5cdebe-686e-4776-9e84-6a3dcc421970 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:14:49.042423 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5cdebe-686e-4776-9e84-6a3dcc421970 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:49.044072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5cdebe-686e-4776-9e84-6a3dcc421970 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:49.050138 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 775/1557] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:49.050921 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697648f4-02bc-4974-892d-fe20b430a0a6 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.056383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 783/1558] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:14:49.057578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd515d-c6de-42c0-835a-55bec8557aae None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.057863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd515d-c6de-42c0-835a-55bec8557aae None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.058137 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd515d-c6de-42c0-835a-55bec8557aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.061955 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697648f4-02bc-4974-892d-fe20b430a0a6 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:49.067181 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fe34a-ffb9-46df-8a14-6f37307268b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:49.067814 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fe34a-ffb9-46df-8a14-6f37307268b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.068094 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fe34a-ffb9-46df-8a14-6f37307268b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.068361 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fe34a-ffb9-46df-8a14-6f37307268b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.068999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08fe34a-ffb9-46df-8a14-6f37307268b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:49.070589 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08fe34a-ffb9-46df-8a14-6f37307268b6 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:49.078912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-e6dd515d-c6de-42c0-835a-55bec8557aae None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:49.080136 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e6dd515d-c6de-42c0-835a-55bec8557aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:49.084187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 776/1559] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:14:49.084187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fe34a-ffb9-46df-8a14-6f37307268b6 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.088044 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 784/1560] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:49.088826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd515d-c6de-42c0-835a-55bec8557aae None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.094078 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fe34a-ffb9-46df-8a14-6f37307268b6 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:49.098361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd515d-c6de-42c0-835a-55bec8557aae None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:49.098837 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23daeb1f-c371-48c0-926b-46034deb276a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:49.099428 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daeb1f-c371-48c0-926b-46034deb276a admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.099748 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daeb1f-c371-48c0-926b-46034deb276a admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.100021 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daeb1f-c371-48c0-926b-46034deb276a admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.100636 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23daeb1f-c371-48c0-926b-46034deb276a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:49.102509 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23daeb1f-c371-48c0-926b-46034deb276a admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:49.102949 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c15fc-0b6b-43a6-be56-80c5ccf33156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:49.103570 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c15fc-0b6b-43a6-be56-80c5ccf33156 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.103848 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c15fc-0b6b-43a6-be56-80c5ccf33156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.104120 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c15fc-0b6b-43a6-be56-80c5ccf33156 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.104779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c15fc-0b6b-43a6-be56-80c5ccf33156 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:14:49.105066 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c15fc-0b6b-43a6-be56-80c5ccf33156 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:49.106662 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c15fc-0b6b-43a6-be56-80c5ccf33156 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:49.118478 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 785/1561] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:14:49.119349 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c15fc-0b6b-43a6-be56-80c5ccf33156 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.130013 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c15fc-0b6b-43a6-be56-80c5ccf33156 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:49.134877 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e32b3-aee1-471b-bc45-fb9f54a83931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:49.135524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e32b3-aee1-471b-bc45-fb9f54a83931 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.135804 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e32b3-aee1-471b-bc45-fb9f54a83931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.136075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e32b3-aee1-471b-bc45-fb9f54a83931 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.136707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e32b3-aee1-471b-bc45-fb9f54a83931 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:14:49.137032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e32b3-aee1-471b-bc45-fb9f54a83931 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:49.138396 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 777/1562] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:14:49 2022] POST /identity/v3/projects => generated 405 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:14:49.139210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e32b3-aee1-471b-bc45-fb9f54a83931 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:49.139633 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23daeb1f-c371-48c0-926b-46034deb276a admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.151584 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 786/1563] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:14:49.157841 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e32b3-aee1-471b-bc45-fb9f54a83931 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.175770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e32b3-aee1-471b-bc45-fb9f54a83931 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:49.195684 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:49.205894 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:49.219415 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23daeb1f-c371-48c0-926b-46034deb276a admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:49.224148 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74552084-4850-48e6-8007-5c46002ba37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:49.224750 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74552084-4850-48e6-8007-5c46002ba37b admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.225031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74552084-4850-48e6-8007-5c46002ba37b admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.225299 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74552084-4850-48e6-8007-5c46002ba37b admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.225914 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74552084-4850-48e6-8007-5c46002ba37b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:49.227830 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74552084-4850-48e6-8007-5c46002ba37b admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:49.234781 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdf302-b950-4ace-b91a-73bca6fbf2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:49.235387 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdf302-b950-4ace-b91a-73bca6fbf2aa admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.235696 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdf302-b950-4ace-b91a-73bca6fbf2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.235968 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdf302-b950-4ace-b91a-73bca6fbf2aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.236642 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdf302-b950-4ace-b91a-73bca6fbf2aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:14:49.236953 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdf302-b950-4ace-b91a-73bca6fbf2aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:49.238528 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdf302-b950-4ace-b91a-73bca6fbf2aa admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:49.251495 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 787/1564] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:14:49.252295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdf302-b950-4ace-b91a-73bca6fbf2aa admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.256346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 778/1565] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:14:49 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:14:49.257149 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74552084-4850-48e6-8007-5c46002ba37b admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.262281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdf302-b950-4ace-b91a-73bca6fbf2aa admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:49.320954 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a75355-38eb-4230-a862-c748ee3a6e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:49.321561 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a75355-38eb-4230-a862-c748ee3a6e1f admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.321837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a75355-38eb-4230-a862-c748ee3a6e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.322104 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a75355-38eb-4230-a862-c748ee3a6e1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.322758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74552084-4850-48e6-8007-5c46002ba37b admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:49.322882 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a75355-38eb-4230-a862-c748ee3a6e1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:49.323821 dv-cinder-859193-2-smb devstack@keystone.service[81598]: WARNING py.warnings [None req-99a75355-38eb-4230-a862-c748ee3a6e1f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:14:49.323821 dv-cinder-859193-2-smb devstack@keystone.service[81598]: warnings.warn(msg) Sep 28 12:14:49.323821 dv-cinder-859193-2-smb devstack@keystone.service[81598]: Sep 28 12:14:49.325140 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a75355-38eb-4230-a862-c748ee3a6e1f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:49.327716 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac887b-7b20-4f2f-9062-1de278b2c31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:49.328380 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac887b-7b20-4f2f-9062-1de278b2c31d admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.328723 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac887b-7b20-4f2f-9062-1de278b2c31d admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.329084 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac887b-7b20-4f2f-9062-1de278b2c31d admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.329813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac887b-7b20-4f2f-9062-1de278b2c31d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:49.331467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac887b-7b20-4f2f-9062-1de278b2c31d admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:49.342045 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 779/1566] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:14:49.342953 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac887b-7b20-4f2f-9062-1de278b2c31d admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.353665 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac887b-7b20-4f2f-9062-1de278b2c31d admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:49.353937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 788/1567] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:14:49 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:14:49.354841 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a75355-38eb-4230-a862-c748ee3a6e1f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.413192 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6cf9e6-dffa-424c-b15a-4bb0bf3d3a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:49.413830 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cf9e6-dffa-424c-b15a-4bb0bf3d3a65 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.414108 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cf9e6-dffa-424c-b15a-4bb0bf3d3a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.414373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cf9e6-dffa-424c-b15a-4bb0bf3d3a65 admin admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.415127 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6cf9e6-dffa-424c-b15a-4bb0bf3d3a65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:14:49.415341 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6cf9e6-dffa-424c-b15a-4bb0bf3d3a65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:49.416929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6cf9e6-dffa-424c-b15a-4bb0bf3d3a65 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:49.419059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a75355-38eb-4230-a862-c748ee3a6e1f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:49.426045 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845fa0f-bcdc-4e08-97fb-fa65d93e2078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:49.426660 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845fa0f-bcdc-4e08-97fb-fa65d93e2078 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.426941 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845fa0f-bcdc-4e08-97fb-fa65d93e2078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.427214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845fa0f-bcdc-4e08-97fb-fa65d93e2078 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.427892 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845fa0f-bcdc-4e08-97fb-fa65d93e2078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:49.429846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845fa0f-bcdc-4e08-97fb-fa65d93e2078 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:49.430782 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 780/1568] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:14:49.431614 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6cf9e6-dffa-424c-b15a-4bb0bf3d3a65 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.446731 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6cf9e6-dffa-424c-b15a-4bb0bf3d3a65 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:49.452008 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc152378-9745-42e0-b933-7905dbef9a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:49.452756 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc152378-9745-42e0-b933-7905dbef9a94 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.453037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc152378-9745-42e0-b933-7905dbef9a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.453306 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc152378-9745-42e0-b933-7905dbef9a94 admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.453921 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc152378-9745-42e0-b933-7905dbef9a94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:49.454928 dv-cinder-859193-2-smb devstack@keystone.service[81599]: WARNING py.warnings [None req-fc152378-9745-42e0-b933-7905dbef9a94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:14:49.454928 dv-cinder-859193-2-smb devstack@keystone.service[81599]: warnings.warn(msg) Sep 28 12:14:49.454928 dv-cinder-859193-2-smb devstack@keystone.service[81599]: Sep 28 12:14:49.456151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc152378-9745-42e0-b933-7905dbef9a94 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:49.460600 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 789/1569] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:14:49 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:14:49.460600 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845fa0f-bcdc-4e08-97fb-fa65d93e2078 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.480411 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 781/1570] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:14:49 2022] POST /identity/v3/users => generated 303 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:14:49.484111 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc152378-9745-42e0-b933-7905dbef9a94 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.493985 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc152378-9745-42e0-b933-7905dbef9a94 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:49.508729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:49.527258 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:49.534552 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845fa0f-bcdc-4e08-97fb-fa65d93e2078 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:49.539197 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1bedc-7f64-4b04-97fe-bd541a26182a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:49.539841 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1bedc-7f64-4b04-97fe-bd541a26182a admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.540119 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1bedc-7f64-4b04-97fe-bd541a26182a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.540393 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1bedc-7f64-4b04-97fe-bd541a26182a admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.541022 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1bedc-7f64-4b04-97fe-bd541a26182a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:49.542913 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1bedc-7f64-4b04-97fe-bd541a26182a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:49.551909 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b6e7a-5b39-4234-afa7-2b157fdc2cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:49.552523 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b6e7a-5b39-4234-afa7-2b157fdc2cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.552792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b6e7a-5b39-4234-afa7-2b157fdc2cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.553066 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b6e7a-5b39-4234-afa7-2b157fdc2cf4 admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.553684 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b6e7a-5b39-4234-afa7-2b157fdc2cf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:49.555632 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b6e7a-5b39-4234-afa7-2b157fdc2cf4 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:49.573709 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 790/1571] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:14:49 2022] POST /identity/v3/projects => generated 363 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:14:49.573709 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1bedc-7f64-4b04-97fe-bd541a26182a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.580743 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 782/1572] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:14:49 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:14:49.580743 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b6e7a-5b39-4234-afa7-2b157fdc2cf4 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.592062 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b6e7a-5b39-4234-afa7-2b157fdc2cf4 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:49.638059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1bedc-7f64-4b04-97fe-bd541a26182a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:49.642595 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3a1e8-6818-4403-8802-e69cd150e61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:49.643198 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3a1e8-6818-4403-8802-e69cd150e61c admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.643566 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3a1e8-6818-4403-8802-e69cd150e61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.643910 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3a1e8-6818-4403-8802-e69cd150e61c admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.644466 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3a1e8-6818-4403-8802-e69cd150e61c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:49.646348 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3a1e8-6818-4403-8802-e69cd150e61c admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:49.646911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4c6bf-68f8-401e-b2d4-16f9c4bbe5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:49.647597 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4c6bf-68f8-401e-b2d4-16f9c4bbe5af admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.647902 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4c6bf-68f8-401e-b2d4-16f9c4bbe5af admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.648169 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4c6bf-68f8-401e-b2d4-16f9c4bbe5af admin admin] PATH_INFO: `/v3/projects/20856e65882a41848e6be9b95074361b/users/d533e3caa6ec4c7c9343a8cefd3af8d4/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.663005 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4c6bf-68f8-401e-b2d4-16f9c4bbe5af admin admin] RBAC: Authorizing `identity:create_grant(project_id=20856e65882a41848e6be9b95074361b, user_id=d533e3caa6ec4c7c9343a8cefd3af8d4, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:49.666223 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4c6bf-68f8-401e-b2d4-16f9c4bbe5af admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:49.678283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 791/1573] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:14:49 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:14:49.678283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3a1e8-6818-4403-8802-e69cd150e61c admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.679853 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 783/1574] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:14:49 2022] PUT /identity/v3/projects/20856e65882a41848e6be9b95074361b/users/d533e3caa6ec4c7c9343a8cefd3af8d4/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:14:49.680904 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4c6bf-68f8-401e-b2d4-16f9c4bbe5af admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.741561 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3a1e8-6818-4403-8802-e69cd150e61c admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:49.746232 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945152b-a81f-4099-bfe6-a9508134619f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:49.747458 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945152b-a81f-4099-bfe6-a9508134619f admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.747608 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4c6bf-68f8-401e-b2d4-16f9c4bbe5af admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:49.747747 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945152b-a81f-4099-bfe6-a9508134619f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.748019 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945152b-a81f-4099-bfe6-a9508134619f admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.748648 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945152b-a81f-4099-bfe6-a9508134619f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:49.750587 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945152b-a81f-4099-bfe6-a9508134619f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:49.752253 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c95fe-2b4f-4efd-8741-e073493d8642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:49.752922 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c95fe-2b4f-4efd-8741-e073493d8642 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.753200 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c95fe-2b4f-4efd-8741-e073493d8642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.753468 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c95fe-2b4f-4efd-8741-e073493d8642 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.754087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c95fe-2b4f-4efd-8741-e073493d8642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:49.755997 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c95fe-2b4f-4efd-8741-e073493d8642 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:49.772943 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 792/1575] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:14:49 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:14:49.773606 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945152b-a81f-4099-bfe6-a9508134619f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.783802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945152b-a81f-4099-bfe6-a9508134619f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:49.784466 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 784/1576] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:14:49 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:14:49.788431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c95fe-2b4f-4efd-8741-e073493d8642 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.820657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:49.828363 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:49.847501 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544be4df-e0aa-441e-98aa-bee4633c8f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:49.848110 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544be4df-e0aa-441e-98aa-bee4633c8f70 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.848390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544be4df-e0aa-441e-98aa-bee4633c8f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.848663 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544be4df-e0aa-441e-98aa-bee4633c8f70 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.849290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544be4df-e0aa-441e-98aa-bee4633c8f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:49.851194 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544be4df-e0aa-441e-98aa-bee4633c8f70 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:49.857990 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c95fe-2b4f-4efd-8741-e073493d8642 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:49.862658 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1490e-e53f-4eaa-a687-271df3d15268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:49.863263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1490e-e53f-4eaa-a687-271df3d15268 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.863597 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1490e-e53f-4eaa-a687-271df3d15268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.863933 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1490e-e53f-4eaa-a687-271df3d15268 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.864648 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1490e-e53f-4eaa-a687-271df3d15268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:49.866857 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1490e-e53f-4eaa-a687-271df3d15268 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:49.873442 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 793/1577] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:14:49 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:14:49.874388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544be4df-e0aa-441e-98aa-bee4633c8f70 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.877541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 785/1578] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:14:49.878522 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1490e-e53f-4eaa-a687-271df3d15268 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.885491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544be4df-e0aa-441e-98aa-bee4633c8f70 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:49.887962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1490e-e53f-4eaa-a687-271df3d15268 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:49.890128 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7b8f4-d04d-4da7-b2a5-d5555a01c329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:49.890748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7b8f4-d04d-4da7-b2a5-d5555a01c329 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.891029 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7b8f4-d04d-4da7-b2a5-d5555a01c329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.891313 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7b8f4-d04d-4da7-b2a5-d5555a01c329 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.891955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7b8f4-d04d-4da7-b2a5-d5555a01c329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:49.893025 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de5083-a5be-4e93-81d3-3ca7ae617d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:49.893609 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de5083-a5be-4e93-81d3-3ca7ae617d20 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.893864 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7b8f4-d04d-4da7-b2a5-d5555a01c329 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:49.893983 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de5083-a5be-4e93-81d3-3ca7ae617d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.894144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de5083-a5be-4e93-81d3-3ca7ae617d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.894767 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de5083-a5be-4e93-81d3-3ca7ae617d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:49.896425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de5083-a5be-4e93-81d3-3ca7ae617d20 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:49.907371 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 786/1579] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:14:49.908035 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de5083-a5be-4e93-81d3-3ca7ae617d20 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.918357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de5083-a5be-4e93-81d3-3ca7ae617d20 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:49.919726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 794/1580] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:14:49 2022] POST /identity/v3/users => generated 282 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:14:49.920835 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5cb055-3314-47f0-a0ce-6429460c8f81 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.921150 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5cb055-3314-47f0-a0ce-6429460c8f81 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.921427 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5cb055-3314-47f0-a0ce-6429460c8f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.926724 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c529b5e-4fa2-4398-8519-bacc943ae69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:49.927320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c529b5e-4fa2-4398-8519-bacc943ae69f admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.927623 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c529b5e-4fa2-4398-8519-bacc943ae69f admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.927900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c529b5e-4fa2-4398-8519-bacc943ae69f admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.928522 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c529b5e-4fa2-4398-8519-bacc943ae69f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:49.930462 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c529b5e-4fa2-4398-8519-bacc943ae69f admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:49.941428 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-0e5cb055-3314-47f0-a0ce-6429460c8f81 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:49.942759 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0e5cb055-3314-47f0-a0ce-6429460c8f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:49.951014 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 795/1581] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:49.951838 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5cb055-3314-47f0-a0ce-6429460c8f81 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.952886 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 787/1582] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:14:49 2022] POST /identity/v3/users => generated 293 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:14:49.953520 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c529b5e-4fa2-4398-8519-bacc943ae69f admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.961860 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5cb055-3314-47f0-a0ce-6429460c8f81 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:49.963047 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c529b5e-4fa2-4398-8519-bacc943ae69f admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:49.967380 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e24194-fa13-4c8e-9322-e954055fc5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:49.968067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e24194-fa13-4c8e-9322-e954055fc5cd admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.968351 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e24194-fa13-4c8e-9322-e954055fc5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.968677 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e24194-fa13-4c8e-9322-e954055fc5cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.968901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb3a45-c665-4e97-99c3-c1d50128888f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:49.969328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e24194-fa13-4c8e-9322-e954055fc5cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:49.969501 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb3a45-c665-4e97-99c3-c1d50128888f admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.969780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb3a45-c665-4e97-99c3-c1d50128888f admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.970052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb3a45-c665-4e97-99c3-c1d50128888f admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.970672 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb3a45-c665-4e97-99c3-c1d50128888f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:49.970927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e24194-fa13-4c8e-9322-e954055fc5cd admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:49.972613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb3a45-c665-4e97-99c3-c1d50128888f admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:49.983476 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 796/1583] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:14:49.987062 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e24194-fa13-4c8e-9322-e954055fc5cd admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.998926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 788/1584] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:14:49 2022] POST /identity/v3/users => generated 297 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:14:49.998926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb3a45-c665-4e97-99c3-c1d50128888f admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.999196 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e24194-fa13-4c8e-9322-e954055fc5cd admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:50.002810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295446f2-93a5-4687-8118-afeafcf20191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:50.003405 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295446f2-93a5-4687-8118-afeafcf20191 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:50.003725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295446f2-93a5-4687-8118-afeafcf20191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:50.003996 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295446f2-93a5-4687-8118-afeafcf20191 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:50.004628 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295446f2-93a5-4687-8118-afeafcf20191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:50.006202 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295446f2-93a5-4687-8118-afeafcf20191 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:50.006800 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb3a45-c665-4e97-99c3-c1d50128888f admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:50.011449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e25f0-50a9-4eb0-a7cc-eea0c9c46b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:50.012046 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e25f0-50a9-4eb0-a7cc-eea0c9c46b30 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:50.012460 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e25f0-50a9-4eb0-a7cc-eea0c9c46b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:50.012732 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e25f0-50a9-4eb0-a7cc-eea0c9c46b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:50.013361 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e25f0-50a9-4eb0-a7cc-eea0c9c46b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:50.014929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e25f0-50a9-4eb0-a7cc-eea0c9c46b30 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:50.016733 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 797/1585] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:14:50.017575 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295446f2-93a5-4687-8118-afeafcf20191 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:50.029283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 789/1586] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:14:50.029283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e25f0-50a9-4eb0-a7cc-eea0c9c46b30 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:50.029549 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295446f2-93a5-4687-8118-afeafcf20191 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:50.032481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc77386-65d8-48b7-aac3-ef2534ec2e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:50.033068 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc77386-65d8-48b7-aac3-ef2534ec2e20 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:50.033347 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc77386-65d8-48b7-aac3-ef2534ec2e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:50.033620 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc77386-65d8-48b7-aac3-ef2534ec2e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:50.034259 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc77386-65d8-48b7-aac3-ef2534ec2e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:50.035862 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc77386-65d8-48b7-aac3-ef2534ec2e20 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:50.036511 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e25f0-50a9-4eb0-a7cc-eea0c9c46b30 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:50.041101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b54f35-0630-4f72-bb16-e1fc8040fcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:50.041671 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b54f35-0630-4f72-bb16-e1fc8040fcad admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:50.041956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b54f35-0630-4f72-bb16-e1fc8040fcad admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:50.042228 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b54f35-0630-4f72-bb16-e1fc8040fcad admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:50.042853 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b54f35-0630-4f72-bb16-e1fc8040fcad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:50.044536 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b54f35-0630-4f72-bb16-e1fc8040fcad admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:50.049678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 798/1587] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:14:50.049678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc77386-65d8-48b7-aac3-ef2534ec2e20 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:50.056136 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc77386-65d8-48b7-aac3-ef2534ec2e20 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:50.060882 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 790/1588] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:14:50.060882 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b54f35-0630-4f72-bb16-e1fc8040fcad admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:50.061468 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd995326-b8a4-4483-b969-f21d1732f55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:50.062048 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd995326-b8a4-4483-b969-f21d1732f55f admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:50.062325 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd995326-b8a4-4483-b969-f21d1732f55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:50.062592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd995326-b8a4-4483-b969-f21d1732f55f admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:50.063220 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd995326-b8a4-4483-b969-f21d1732f55f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:50.064833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd995326-b8a4-4483-b969-f21d1732f55f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:50.074619 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 799/1589] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:14:50.075546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd995326-b8a4-4483-b969-f21d1732f55f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:50.085403 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd995326-b8a4-4483-b969-f21d1732f55f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:50.090036 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed8891-a4a5-4484-b7ef-6b4a132a637a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:50.091135 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed8891-a4a5-4484-b7ef-6b4a132a637a admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:50.091412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed8891-a4a5-4484-b7ef-6b4a132a637a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:50.091713 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed8891-a4a5-4484-b7ef-6b4a132a637a admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:50.092347 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed8891-a4a5-4484-b7ef-6b4a132a637a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:50.093904 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed8891-a4a5-4484-b7ef-6b4a132a637a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:50.103853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 800/1590] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:14:50.104638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed8891-a4a5-4484-b7ef-6b4a132a637a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:50.114246 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed8891-a4a5-4484-b7ef-6b4a132a637a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:50.117673 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b54f35-0630-4f72-bb16-e1fc8040fcad admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:50.119066 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58e625-b933-4bf1-a712-2c190aede3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:50.119743 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58e625-b933-4bf1-a712-2c190aede3ae admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:50.120028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58e625-b933-4bf1-a712-2c190aede3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:50.120297 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58e625-b933-4bf1-a712-2c190aede3ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:50.120919 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58e625-b933-4bf1-a712-2c190aede3ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:50.121355 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d655da-c032-4ce6-98c3-12fa5645d42c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:50.122482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d655da-c032-4ce6-98c3-12fa5645d42c service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:50.122760 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d655da-c032-4ce6-98c3-12fa5645d42c service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:50.123003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58e625-b933-4bf1-a712-2c190aede3ae admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:50.123109 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d655da-c032-4ce6-98c3-12fa5645d42c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:50.135929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 801/1591] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:14:50.138475 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58e625-b933-4bf1-a712-2c190aede3ae admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:50.139725 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d655da-c032-4ce6-98c3-12fa5645d42c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:50.141184 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d655da-c032-4ce6-98c3-12fa5645d42c service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:50.148606 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58e625-b933-4bf1-a712-2c190aede3ae admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:50.152263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 791/1592] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:14:50.153056 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d655da-c032-4ce6-98c3-12fa5645d42c service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:50.156771 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7eaa29-25c7-4d6e-887d-2ab15e6282dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:50.157380 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7eaa29-25c7-4d6e-887d-2ab15e6282dd admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:50.157776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7eaa29-25c7-4d6e-887d-2ab15e6282dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:50.157955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7eaa29-25c7-4d6e-887d-2ab15e6282dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:50.158548 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7eaa29-25c7-4d6e-887d-2ab15e6282dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:50.160251 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7eaa29-25c7-4d6e-887d-2ab15e6282dd admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:50.163034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d655da-c032-4ce6-98c3-12fa5645d42c service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:50.168503 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47260e5b-3cf4-4106-aa48-996f63083fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:50.169834 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47260e5b-3cf4-4106-aa48-996f63083fba admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:50.170113 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47260e5b-3cf4-4106-aa48-996f63083fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:50.170388 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47260e5b-3cf4-4106-aa48-996f63083fba admin admin] PATH_INFO: `/v3/projects/a94013a9723944a4b30e2bded1c58c9c/users/f9bbb5f8c32848a09ce49d2b2959ce88/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:50.171495 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 802/1593] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:14:50.172332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7eaa29-25c7-4d6e-887d-2ab15e6282dd admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:50.185770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7eaa29-25c7-4d6e-887d-2ab15e6282dd admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:50.189648 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47260e5b-3cf4-4106-aa48-996f63083fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a94013a9723944a4b30e2bded1c58c9c, user_id=f9bbb5f8c32848a09ce49d2b2959ce88, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:50.191461 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a35d94-02ba-4322-b7e7-03319f81d9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:50.192204 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a35d94-02ba-4322-b7e7-03319f81d9a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:50.192330 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47260e5b-3cf4-4106-aa48-996f63083fba admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:50.192584 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a35d94-02ba-4322-b7e7-03319f81d9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:50.192924 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a35d94-02ba-4322-b7e7-03319f81d9a0 admin admin] PATH_INFO: `/v3/projects/399af453ac3741968d9af04c080bfb58/users/a1f7c9ea93684f498e0b223d91382a1c/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:50.206426 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 792/1594] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:14:50 2022] PUT /identity/v3/projects/a94013a9723944a4b30e2bded1c58c9c/users/f9bbb5f8c32848a09ce49d2b2959ce88/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:14:50.208895 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a35d94-02ba-4322-b7e7-03319f81d9a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=399af453ac3741968d9af04c080bfb58, user_id=a1f7c9ea93684f498e0b223d91382a1c, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:50.210064 dv-cinder-859193-2-smb devstack@keystone.service[81598]: WARNING py.warnings [None req-b6a35d94-02ba-4322-b7e7-03319f81d9a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:14:50.210064 dv-cinder-859193-2-smb devstack@keystone.service[81598]: warnings.warn(msg) Sep 28 12:14:50.210064 dv-cinder-859193-2-smb devstack@keystone.service[81598]: Sep 28 12:14:50.212270 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a35d94-02ba-4322-b7e7-03319f81d9a0 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:50.218142 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47260e5b-3cf4-4106-aa48-996f63083fba admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:50.228915 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 803/1595] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:14:50 2022] PUT /identity/v3/projects/399af453ac3741968d9af04c080bfb58/users/a1f7c9ea93684f498e0b223d91382a1c/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:14:50.229961 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a35d94-02ba-4322-b7e7-03319f81d9a0 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:50.277582 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:50.302130 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47260e5b-3cf4-4106-aa48-996f63083fba admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:50.307477 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f111d-8155-4700-9012-8bae67c4c961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:50.308322 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f111d-8155-4700-9012-8bae67c4c961 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:50.308465 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a35d94-02ba-4322-b7e7-03319f81d9a0 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:50.308723 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f111d-8155-4700-9012-8bae67c4c961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:50.309112 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f111d-8155-4700-9012-8bae67c4c961 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:50.309848 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f111d-8155-4700-9012-8bae67c4c961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:50.311627 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f111d-8155-4700-9012-8bae67c4c961 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:50.313983 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe26c7-1540-46ed-b497-16f38983067a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:50.314803 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe26c7-1540-46ed-b497-16f38983067a admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:50.315164 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe26c7-1540-46ed-b497-16f38983067a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:50.315598 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe26c7-1540-46ed-b497-16f38983067a admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:50.316305 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe26c7-1540-46ed-b497-16f38983067a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:50.318000 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe26c7-1540-46ed-b497-16f38983067a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:50.319468 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:50.327626 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 793/1596] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:14:50.327626 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f111d-8155-4700-9012-8bae67c4c961 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:50.335022 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 804/1597] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:14:50.335580 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe26c7-1540-46ed-b497-16f38983067a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:50.336056 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f111d-8155-4700-9012-8bae67c4c961 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:50.340989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465cc79-e594-41a4-9c00-9ca270c31774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:50.341649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465cc79-e594-41a4-9c00-9ca270c31774 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:50.341932 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465cc79-e594-41a4-9c00-9ca270c31774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:50.342210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465cc79-e594-41a4-9c00-9ca270c31774 admin admin] PATH_INFO: `/v3/projects/b9be0965856f4d51bc018467c040d986/users/2e413419aba94a5ba1122213dc57a41e/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:50.345913 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe26c7-1540-46ed-b497-16f38983067a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:50.351025 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9d029-8788-4819-ad33-6de5434bb112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:50.351982 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9d029-8788-4819-ad33-6de5434bb112 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:50.351982 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9d029-8788-4819-ad33-6de5434bb112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:50.352301 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9d029-8788-4819-ad33-6de5434bb112 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:50.352905 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9d029-8788-4819-ad33-6de5434bb112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:50.354503 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9d029-8788-4819-ad33-6de5434bb112 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:50.359842 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c465cc79-e594-41a4-9c00-9ca270c31774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9be0965856f4d51bc018467c040d986, user_id=2e413419aba94a5ba1122213dc57a41e, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:50.362619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c465cc79-e594-41a4-9c00-9ca270c31774 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:50.365330 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 805/1598] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:14:50.366389 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9d029-8788-4819-ad33-6de5434bb112 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:50.380613 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9d029-8788-4819-ad33-6de5434bb112 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:50.380721 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 794/1599] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:14:50 2022] PUT /identity/v3/projects/b9be0965856f4d51bc018467c040d986/users/2e413419aba94a5ba1122213dc57a41e/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:14:50.393637 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906975b-3ef4-4cef-8e15-426fb6e8b747 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:50.393972 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906975b-3ef4-4cef-8e15-426fb6e8b747 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:50.394181 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906975b-3ef4-4cef-8e15-426fb6e8b747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:50.428890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-6906975b-3ef4-4cef-8e15-426fb6e8b747 None None] MFA Rules not processed for user `f9bbb5f8c32848a09ce49d2b2959ce88`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:50.430328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-6906975b-3ef4-4cef-8e15-426fb6e8b747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:50.454057 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22187a10-3d4a-4d59-8c84-36c874896b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:50.454733 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22187a10-3d4a-4d59-8c84-36c874896b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:50.455014 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22187a10-3d4a-4d59-8c84-36c874896b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:50.455289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22187a10-3d4a-4d59-8c84-36c874896b8c admin admin] PATH_INFO: `/v3/projects/67a808b5a9cf40dda8dfbcaa318de273/users/a42521faa4fe4e6c88e9692a1bbfa87b/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:50.471515 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22187a10-3d4a-4d59-8c84-36c874896b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=67a808b5a9cf40dda8dfbcaa318de273, user_id=a42521faa4fe4e6c88e9692a1bbfa87b, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:50.474778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22187a10-3d4a-4d59-8c84-36c874896b8c admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:50.501832 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 806/1600] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:14:50 2022] PUT /identity/v3/projects/67a808b5a9cf40dda8dfbcaa318de273/users/a42521faa4fe4e6c88e9692a1bbfa87b/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:14:50.501832 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608a2b7-9f58-4977-9ca4-6d54dc0024ad None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:50.501832 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608a2b7-9f58-4977-9ca4-6d54dc0024ad None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:50.501832 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608a2b7-9f58-4977-9ca4-6d54dc0024ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:50.518968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 795/1601] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:50 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:50.518968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906975b-3ef4-4cef-8e15-426fb6e8b747 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:50.532831 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906975b-3ef4-4cef-8e15-426fb6e8b747 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:50.533699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-3608a2b7-9f58-4977-9ca4-6d54dc0024ad None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:50.535121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3608a2b7-9f58-4977-9ca4-6d54dc0024ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:50.606345 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c12bfe-6ec1-4fc4-be5f-a1b30180aff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:50.607980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c12bfe-6ec1-4fc4-be5f-a1b30180aff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:50.608335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c12bfe-6ec1-4fc4-be5f-a1b30180aff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:50.608527 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c12bfe-6ec1-4fc4-be5f-a1b30180aff1 admin admin] PATH_INFO: `/v3/projects/2ce042c912bf4db1b62c1c19e52fb91f/users/245db39c295f4bfca762cee84278adf0/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:50.617749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 807/1602] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:50.618898 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608a2b7-9f58-4977-9ca4-6d54dc0024ad None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:50.630956 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608a2b7-9f58-4977-9ca4-6d54dc0024ad None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:50.633611 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c12bfe-6ec1-4fc4-be5f-a1b30180aff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ce042c912bf4db1b62c1c19e52fb91f, user_id=245db39c295f4bfca762cee84278adf0, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:50.636467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c12bfe-6ec1-4fc4-be5f-a1b30180aff1 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:50.636762 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ce75b-67e7-4996-875e-7ba61aa171ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:50.638160 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ce75b-67e7-4996-875e-7ba61aa171ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:50.638644 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ce75b-67e7-4996-875e-7ba61aa171ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:50.639083 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ce75b-67e7-4996-875e-7ba61aa171ca admin admin] PATH_INFO: `/v3/projects/d16d1fb16c3e47ba973826cced4ff0dd/users/bb71e0c02b4647b28ed6a6194d270d35/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:50.656958 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 796/1603] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:14:50 2022] PUT /identity/v3/projects/2ce042c912bf4db1b62c1c19e52fb91f/users/245db39c295f4bfca762cee84278adf0/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:14:50.658369 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ce75b-67e7-4996-875e-7ba61aa171ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d16d1fb16c3e47ba973826cced4ff0dd, user_id=bb71e0c02b4647b28ed6a6194d270d35, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:50.658508 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c12bfe-6ec1-4fc4-be5f-a1b30180aff1 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:50.661540 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ce75b-67e7-4996-875e-7ba61aa171ca admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:50.678861 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 808/1604] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:14:50 2022] PUT /identity/v3/projects/d16d1fb16c3e47ba973826cced4ff0dd/users/bb71e0c02b4647b28ed6a6194d270d35/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:14:50.680055 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ea0d9-0637-4c66-bece-9a8e256e5447 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:50.680347 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ea0d9-0637-4c66-bece-9a8e256e5447 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:50.680625 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ea0d9-0637-4c66-bece-9a8e256e5447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:50.691712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:50.717403 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-a49ea0d9-0637-4c66-bece-9a8e256e5447 None None] MFA Rules not processed for user `2e413419aba94a5ba1122213dc57a41e`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:50.718778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a49ea0d9-0637-4c66-bece-9a8e256e5447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:50.743292 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c12bfe-6ec1-4fc4-be5f-a1b30180aff1 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:50.762076 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:50.807586 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 809/1605] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:50.807586 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d18b6-7031-4d74-bf81-aef601897ddb None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:50.807586 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d18b6-7031-4d74-bf81-aef601897ddb None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:50.807586 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d18b6-7031-4d74-bf81-aef601897ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:50.819254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4e366-6b5c-47bb-9a99-546a91e01eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:50.819960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4e366-6b5c-47bb-9a99-546a91e01eba admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:50.820238 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4e366-6b5c-47bb-9a99-546a91e01eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:50.820498 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4e366-6b5c-47bb-9a99-546a91e01eba admin admin] PATH_INFO: `/v3/projects/a33d8c6816ca4713a0657f0c65d2a1c4/users/90794e56c3f9486fbace8c39018233b2/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:50.841456 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4e366-6b5c-47bb-9a99-546a91e01eba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a33d8c6816ca4713a0657f0c65d2a1c4, user_id=90794e56c3f9486fbace8c39018233b2, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:50.844813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4e366-6b5c-47bb-9a99-546a91e01eba admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:50.846923 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-350d18b6-7031-4d74-bf81-aef601897ddb None None] MFA Rules not processed for user `a42521faa4fe4e6c88e9692a1bbfa87b`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:50.848492 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-350d18b6-7031-4d74-bf81-aef601897ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:50.860975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 797/1606] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:14:50 2022] PUT /identity/v3/projects/a33d8c6816ca4713a0657f0c65d2a1c4/users/90794e56c3f9486fbace8c39018233b2/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:14:50.861996 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4e366-6b5c-47bb-9a99-546a91e01eba admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:50.958446 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 810/1607] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:50.961171 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738bf42-402b-4e99-8033-3a7a6a719312 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:50.961459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738bf42-402b-4e99-8033-3a7a6a719312 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:50.963502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738bf42-402b-4e99-8033-3a7a6a719312 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:50.965145 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 811/1608] 10.222.0.16 () {54 vars in 964 bytes} [Wed Sep 28 12:14:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:14:50.969170 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e180b-6e8e-4687-9b91-9af2870d665d None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:50.970234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4e366-6b5c-47bb-9a99-546a91e01eba admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:50.970376 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e180b-6e8e-4687-9b91-9af2870d665d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:50.971350 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e180b-6e8e-4687-9b91-9af2870d665d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:50.975936 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3cf3d-cd47-4f65-9579-12ebe2b81df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:50.976736 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3cf3d-cd47-4f65-9579-12ebe2b81df7 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:50.977420 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3cf3d-cd47-4f65-9579-12ebe2b81df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:50.977758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3cf3d-cd47-4f65-9579-12ebe2b81df7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:50.978557 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3cf3d-cd47-4f65-9579-12ebe2b81df7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:50.984346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3cf3d-cd47-4f65-9579-12ebe2b81df7 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:51.024819 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 798/1609] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:14:50 2022] POST /identity/v3/projects => generated 405 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:14:51.024819 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1fe736-b7d1-41c7-88c9-a50e6129bd73 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:51.024819 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1fe736-b7d1-41c7-88c9-a50e6129bd73 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:51.024819 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1fe736-b7d1-41c7-88c9-a50e6129bd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:51.026438 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b77e180b-6e8e-4687-9b91-9af2870d665d None None] MFA Rules not processed for user `245db39c295f4bfca762cee84278adf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:51.028133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b77e180b-6e8e-4687-9b91-9af2870d665d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:51.050735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-6c1fe736-b7d1-41c7-88c9-a50e6129bd73 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:51.052020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-6c1fe736-b7d1-41c7-88c9-a50e6129bd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:51.092764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:51.114208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 812/1610] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:51.118034 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e180b-6e8e-4687-9b91-9af2870d665d None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:51.141043 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 799/1611] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:51.142327 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba174a15-6c09-42c1-a042-e5e58c5352c6 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:51.142616 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba174a15-6c09-42c1-a042-e5e58c5352c6 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:51.142889 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba174a15-6c09-42c1-a042-e5e58c5352c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:51.175314 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-ba174a15-6c09-42c1-a042-e5e58c5352c6 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:51.177874 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-ba174a15-6c09-42c1-a042-e5e58c5352c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:51.192714 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e180b-6e8e-4687-9b91-9af2870d665d None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:51.194829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e858ee7-5502-4cde-b05e-fbc04ed22eb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:51.195669 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e858ee7-5502-4cde-b05e-fbc04ed22eb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:51.195959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e858ee7-5502-4cde-b05e-fbc04ed22eb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:51.196231 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e858ee7-5502-4cde-b05e-fbc04ed22eb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:51.200107 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 800/1612] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:51.201833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00894f1c-349a-49e8-a42d-34e7ca2d450e None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:51.202502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:51.203096 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00894f1c-349a-49e8-a42d-34e7ca2d450e None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:51.203874 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00894f1c-349a-49e8-a42d-34e7ca2d450e None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:51.206071 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 801/1613] 10.222.0.16 () {54 vars in 961 bytes} [Wed Sep 28 12:14:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:14:51.206976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00894f1c-349a-49e8-a42d-34e7ca2d450e None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:51.225095 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00894f1c-349a-49e8-a42d-34e7ca2d450e None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:51.230582 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb94ebe-ce54-405d-855b-fea33c93c43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:51.232049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb94ebe-ce54-405d-855b-fea33c93c43d admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:51.232540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb94ebe-ce54-405d-855b-fea33c93c43d admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:51.232990 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb94ebe-ce54-405d-855b-fea33c93c43d admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:51.233998 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb94ebe-ce54-405d-855b-fea33c93c43d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:51.237244 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb94ebe-ce54-405d-855b-fea33c93c43d admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:51.266550 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 802/1614] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:14:51 2022] POST /identity/v3/users => generated 309 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:14:51.267746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb94ebe-ce54-405d-855b-fea33c93c43d admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:51.268514 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e858ee7-5502-4cde-b05e-fbc04ed22eb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:51.271141 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e858ee7-5502-4cde-b05e-fbc04ed22eb7 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:51.287598 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 813/1615] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:14:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:14:51.288865 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e858ee7-5502-4cde-b05e-fbc04ed22eb7 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:51.298285 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb94ebe-ce54-405d-855b-fea33c93c43d admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:51.310062 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a0fc8-a35d-4c00-b733-f81590639561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:51.311786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a0fc8-a35d-4c00-b733-f81590639561 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:51.311991 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a0fc8-a35d-4c00-b733-f81590639561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:51.312262 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a0fc8-a35d-4c00-b733-f81590639561 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:51.312906 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a0fc8-a35d-4c00-b733-f81590639561 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:51.318799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a0fc8-a35d-4c00-b733-f81590639561 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:51.381003 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 803/1616] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:14:51 2022] POST /identity/v3/projects => generated 361 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:14:51.383808 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a0fc8-a35d-4c00-b733-f81590639561 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:51.419544 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e858ee7-5502-4cde-b05e-fbc04ed22eb7 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:51.519771 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a0fc8-a35d-4c00-b733-f81590639561 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:51.530508 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3f5be-7881-4802-81fb-11634454c8e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:51.531144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3f5be-7881-4802-81fb-11634454c8e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:51.531427 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3f5be-7881-4802-81fb-11634454c8e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:51.531723 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3f5be-7881-4802-81fb-11634454c8e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:51.538151 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed492b-405e-4536-8844-618e3337ab97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:51.538696 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed492b-405e-4536-8844-618e3337ab97 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:51.538814 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed492b-405e-4536-8844-618e3337ab97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:51.539078 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed492b-405e-4536-8844-618e3337ab97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:51.659507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3f5be-7881-4802-81fb-11634454c8e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:51.661634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3f5be-7881-4802-81fb-11634454c8e8 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:51.662305 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed492b-405e-4536-8844-618e3337ab97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:51.663999 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed492b-405e-4536-8844-618e3337ab97 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:51.673237 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 804/1617] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:14:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:14:51.686447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 814/1618] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:14:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:14:51.686837 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306ea42-ac85-4e38-ab0a-d9ebabd62adc None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:51.687039 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306ea42-ac85-4e38-ab0a-d9ebabd62adc None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:51.687146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed492b-405e-4536-8844-618e3337ab97 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:51.687245 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306ea42-ac85-4e38-ab0a-d9ebabd62adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:51.707269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed492b-405e-4536-8844-618e3337ab97 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:51.713639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0513d93-4baa-4aef-aba5-a9f335dae75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:51.714341 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0513d93-4baa-4aef-aba5-a9f335dae75a admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:51.714626 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0513d93-4baa-4aef-aba5-a9f335dae75a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:51.714942 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0513d93-4baa-4aef-aba5-a9f335dae75a admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:51.717294 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0513d93-4baa-4aef-aba5-a9f335dae75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:51.718196 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0513d93-4baa-4aef-aba5-a9f335dae75a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:51.731120 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 815/1619] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:14:51.732860 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce585a20-7e59-44d2-a41f-177da6119e57 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:51.733156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce585a20-7e59-44d2-a41f-177da6119e57 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:51.733432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce585a20-7e59-44d2-a41f-177da6119e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:51.746024 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:51.769387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-9306ea42-ac85-4e38-ab0a-d9ebabd62adc None None] MFA Rules not processed for user `0e81804e04514ae882a1fd93789db025`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:51.770506 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-9306ea42-ac85-4e38-ab0a-d9ebabd62adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:51.805901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-ce585a20-7e59-44d2-a41f-177da6119e57 None None] MFA Rules not processed for user `ca51ff621664452db7dd991714462e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:51.807582 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ce585a20-7e59-44d2-a41f-177da6119e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:51.825968 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 816/1620] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Sep 28 12:14:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:51.826944 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce585a20-7e59-44d2-a41f-177da6119e57 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:51.828641 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:51.851963 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce585a20-7e59-44d2-a41f-177da6119e57 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:51.866996 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b129ca0-75a7-4063-b58f-e78c7bfe6156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:51.867839 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b129ca0-75a7-4063-b58f-e78c7bfe6156 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:51.868121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b129ca0-75a7-4063-b58f-e78c7bfe6156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:51.868538 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b129ca0-75a7-4063-b58f-e78c7bfe6156 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:51.869444 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b129ca0-75a7-4063-b58f-e78c7bfe6156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:51.871139 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b129ca0-75a7-4063-b58f-e78c7bfe6156 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:51.910507 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 817/1621] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:14:51 2022] POST /identity/v3/users => generated 287 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:14:51.911534 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b129ca0-75a7-4063-b58f-e78c7bfe6156 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:51.932927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 805/1622] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Sep 28 12:14:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:51.934774 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b129ca0-75a7-4063-b58f-e78c7bfe6156 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:51.945619 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d0fbb-7d47-439b-bb6a-d417b19b5a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:51.946907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d0fbb-7d47-439b-bb6a-d417b19b5a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:51.947726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d0fbb-7d47-439b-bb6a-d417b19b5a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:51.947929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306ea42-ac85-4e38-ab0a-d9ebabd62adc None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:51.948606 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d0fbb-7d47-439b-bb6a-d417b19b5a3b admin admin] PATH_INFO: `/v3/projects/9f2ad31314694dc692b541dc82f5e0e3/users/f74e5545efbb4cbc805f57f9058305e7/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:51.963384 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306ea42-ac85-4e38-ab0a-d9ebabd62adc None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:51.971980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772d2cb-c67d-4c9a-8285-53f6dfc5e143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:51.972976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772d2cb-c67d-4c9a-8285-53f6dfc5e143 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:51.973358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772d2cb-c67d-4c9a-8285-53f6dfc5e143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:51.973633 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772d2cb-c67d-4c9a-8285-53f6dfc5e143 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:51.974457 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772d2cb-c67d-4c9a-8285-53f6dfc5e143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:51.976202 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d0fbb-7d47-439b-bb6a-d417b19b5a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f2ad31314694dc692b541dc82f5e0e3, user_id=f74e5545efbb4cbc805f57f9058305e7, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:51.979721 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d0fbb-7d47-439b-bb6a-d417b19b5a3b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:51.982489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772d2cb-c67d-4c9a-8285-53f6dfc5e143 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:51.997981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 806/1623] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:14:51.999017 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772d2cb-c67d-4c9a-8285-53f6dfc5e143 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:52.006979 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 818/1624] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:14:51 2022] PUT /identity/v3/projects/9f2ad31314694dc692b541dc82f5e0e3/users/f74e5545efbb4cbc805f57f9058305e7/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:14:52.008038 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d0fbb-7d47-439b-bb6a-d417b19b5a3b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:52.024547 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772d2cb-c67d-4c9a-8285-53f6dfc5e143 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:52.112144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206093d-815b-44b0-9d1f-ba37e72f0647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:52.112881 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206093d-815b-44b0-9d1f-ba37e72f0647 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:52.113267 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206093d-815b-44b0-9d1f-ba37e72f0647 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:52.113631 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206093d-815b-44b0-9d1f-ba37e72f0647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:52.278968 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d0fbb-7d47-439b-bb6a-d417b19b5a3b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:52.281934 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8d65d-628e-4c4c-9dd4-c28728b670cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:52.286533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8d65d-628e-4c4c-9dd4-c28728b670cf service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:52.288625 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8d65d-628e-4c4c-9dd4-c28728b670cf service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:52.289848 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8d65d-628e-4c4c-9dd4-c28728b670cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:52.369536 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206093d-815b-44b0-9d1f-ba37e72f0647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:52.371405 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206093d-815b-44b0-9d1f-ba37e72f0647 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:52.399715 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 807/1625] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:14:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:14:52.400426 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206093d-815b-44b0-9d1f-ba37e72f0647 service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:52.425598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206093d-815b-44b0-9d1f-ba37e72f0647 service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:52.438794 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11dbc07-e184-460b-9e3c-bbe682020a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:52.439487 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11dbc07-e184-460b-9e3c-bbe682020a8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:52.439777 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11dbc07-e184-460b-9e3c-bbe682020a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:52.440054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11dbc07-e184-460b-9e3c-bbe682020a8a admin admin] PATH_INFO: `/v3/projects/b84d3a013f6049799df32f29e858e2c7/users/e489d092e6c04e829301786d69f72847/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:52.459923 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8d65d-628e-4c4c-9dd4-c28728b670cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:52.462358 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8d65d-628e-4c4c-9dd4-c28728b670cf service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:52.477649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11dbc07-e184-460b-9e3c-bbe682020a8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b84d3a013f6049799df32f29e858e2c7, user_id=e489d092e6c04e829301786d69f72847, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:52.487097 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11dbc07-e184-460b-9e3c-bbe682020a8a admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:52.489945 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 819/1626] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:14:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:14:52.491162 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8d65d-628e-4c4c-9dd4-c28728b670cf service nova] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:52.511959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8d65d-628e-4c4c-9dd4-c28728b670cf service nova] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:52.513989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 808/1627] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:14:52 2022] PUT /identity/v3/projects/b84d3a013f6049799df32f29e858e2c7/users/e489d092e6c04e829301786d69f72847/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:14:52.517864 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11dbc07-e184-460b-9e3c-bbe682020a8a admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:52.595519 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:52.624491 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:52.658451 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11dbc07-e184-460b-9e3c-bbe682020a8a admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:52.661057 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a699930-f9b3-4db7-b0c3-4c1a1f5f2a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:52.661715 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a699930-f9b3-4db7-b0c3-4c1a1f5f2a50 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:52.661984 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a699930-f9b3-4db7-b0c3-4c1a1f5f2a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:52.662255 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a699930-f9b3-4db7-b0c3-4c1a1f5f2a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:52.662911 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a699930-f9b3-4db7-b0c3-4c1a1f5f2a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:52.664696 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a699930-f9b3-4db7-b0c3-4c1a1f5f2a50 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:52.668247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661ebbd-0faf-4175-9222-61a6a33d67b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:52.669811 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661ebbd-0faf-4175-9222-61a6a33d67b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:52.670170 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661ebbd-0faf-4175-9222-61a6a33d67b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:52.671446 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661ebbd-0faf-4175-9222-61a6a33d67b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:52.672174 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661ebbd-0faf-4175-9222-61a6a33d67b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:52.678799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661ebbd-0faf-4175-9222-61a6a33d67b3 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:52.697958 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 820/1628] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:14:52.698939 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a699930-f9b3-4db7-b0c3-4c1a1f5f2a50 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:52.720671 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 809/1629] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:14:52.721659 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a699930-f9b3-4db7-b0c3-4c1a1f5f2a50 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:52.721800 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661ebbd-0faf-4175-9222-61a6a33d67b3 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:52.726620 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a363f-1b51-418d-ac92-2c45b67bca64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:52.727301 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a363f-1b51-418d-ac92-2c45b67bca64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:52.728030 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a363f-1b51-418d-ac92-2c45b67bca64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:52.728312 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a363f-1b51-418d-ac92-2c45b67bca64 admin admin] PATH_INFO: `/v3/projects/9f2ad31314694dc692b541dc82f5e0e3/users/f74e5545efbb4cbc805f57f9058305e7/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:52.736991 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a363f-1b51-418d-ac92-2c45b67bca64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f2ad31314694dc692b541dc82f5e0e3, user_id=f74e5545efbb4cbc805f57f9058305e7, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:52.737299 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661ebbd-0faf-4175-9222-61a6a33d67b3 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:52.739948 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a363f-1b51-418d-ac92-2c45b67bca64 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:52.743880 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f46cdc-8dac-4340-90dd-2a937226e5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:52.744794 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f46cdc-8dac-4340-90dd-2a937226e5b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:52.745291 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f46cdc-8dac-4340-90dd-2a937226e5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:52.745759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f46cdc-8dac-4340-90dd-2a937226e5b6 admin admin] PATH_INFO: `/v3/projects/b84d3a013f6049799df32f29e858e2c7/users/e489d092e6c04e829301786d69f72847/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:52.748544 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f46cdc-8dac-4340-90dd-2a937226e5b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b84d3a013f6049799df32f29e858e2c7, user_id=e489d092e6c04e829301786d69f72847, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:52.751646 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f46cdc-8dac-4340-90dd-2a937226e5b6 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:52.765085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 821/1630] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:14:52 2022] PUT /identity/v3/projects/9f2ad31314694dc692b541dc82f5e0e3/users/f74e5545efbb4cbc805f57f9058305e7/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:14:52.775551 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe1c80-c626-4f6f-993a-15adbfe1811f None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:52.775835 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe1c80-c626-4f6f-993a-15adbfe1811f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:52.776114 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe1c80-c626-4f6f-993a-15adbfe1811f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:52.806649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 810/1631] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:14:52 2022] PUT /identity/v3/projects/b84d3a013f6049799df32f29e858e2c7/users/e489d092e6c04e829301786d69f72847/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:14:52.810527 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6f4f8-da8b-43e1-b856-75a8ad59c974 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:52.812008 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6f4f8-da8b-43e1-b856-75a8ad59c974 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:52.812379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6f4f8-da8b-43e1-b856-75a8ad59c974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:52.870962 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-65fe1c80-c626-4f6f-993a-15adbfe1811f None None] MFA Rules not processed for user `f74e5545efbb4cbc805f57f9058305e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:52.873181 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-65fe1c80-c626-4f6f-993a-15adbfe1811f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:52.908276 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-e0c6f4f8-da8b-43e1-b856-75a8ad59c974 None None] MFA Rules not processed for user `e489d092e6c04e829301786d69f72847`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:52.935233 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-e0c6f4f8-da8b-43e1-b856-75a8ad59c974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:53.052237 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 822/1632] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:52 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:14:53.065416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe1c80-c626-4f6f-993a-15adbfe1811f None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:53.190592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe1c80-c626-4f6f-993a-15adbfe1811f None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:53.196256 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 811/1633] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:52 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:53.203295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b1ba0-1bcf-4ac6-908e-3a29016d35b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:53.203963 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b1ba0-1bcf-4ac6-908e-3a29016d35b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:53.204247 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b1ba0-1bcf-4ac6-908e-3a29016d35b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:53.204525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b1ba0-1bcf-4ac6-908e-3a29016d35b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:53.210480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6f4f8-da8b-43e1-b856-75a8ad59c974 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:53.224668 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6f4f8-da8b-43e1-b856-75a8ad59c974 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:53.234109 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b1ba0-1bcf-4ac6-908e-3a29016d35b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:53.237613 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b1ba0-1bcf-4ac6-908e-3a29016d35b1 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:53.242341 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7bdfa-70c9-4371-92aa-9aeee54b89eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:53.243073 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7bdfa-70c9-4371-92aa-9aeee54b89eb service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:53.243250 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7bdfa-70c9-4371-92aa-9aeee54b89eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:53.243545 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7bdfa-70c9-4371-92aa-9aeee54b89eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:53.279748 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7bdfa-70c9-4371-92aa-9aeee54b89eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:53.279748 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7bdfa-70c9-4371-92aa-9aeee54b89eb service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:53.279935 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 823/1634] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:14:53 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:14:53.299021 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 812/1635] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:14:53 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:14:53.422014 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d39ec3-23f1-4a97-b31c-2f81cedca8a5 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:53.422728 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d39ec3-23f1-4a97-b31c-2f81cedca8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:53.423256 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d39ec3-23f1-4a97-b31c-2f81cedca8a5 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:53.425224 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 824/1636] 10.222.0.16 () {54 vars in 961 bytes} [Wed Sep 28 12:14:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:14:53.455635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e1b63-e0db-4f8c-8859-25cca6f30e1c None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:53.455922 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e1b63-e0db-4f8c-8859-25cca6f30e1c None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:53.456196 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e1b63-e0db-4f8c-8859-25cca6f30e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:53.522160 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-ce9e1b63-e0db-4f8c-8859-25cca6f30e1c None None] MFA Rules not processed for user `0e81804e04514ae882a1fd93789db025`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:53.526071 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-ce9e1b63-e0db-4f8c-8859-25cca6f30e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:53.652662 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ad37c-b194-4fe4-8a36-739fb5d4ed1d None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:53.655616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ad37c-b194-4fe4-8a36-739fb5d4ed1d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:53.655921 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ad37c-b194-4fe4-8a36-739fb5d4ed1d None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:53.661365 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 825/1637] 10.222.0.16 () {54 vars in 912 bytes} [Wed Sep 28 12:14:53 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:14:53.664379 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4ada4-d29a-469c-87f3-5fdd0a350949 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:53.664669 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4ada4-d29a-469c-87f3-5fdd0a350949 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:53.664993 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4ada4-d29a-469c-87f3-5fdd0a350949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:53.727757 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-84c4ada4-d29a-469c-87f3-5fdd0a350949 None None] MFA Rules not processed for user `0e81804e04514ae882a1fd93789db025`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:53.730535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-84c4ada4-d29a-469c-87f3-5fdd0a350949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:53.754371 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 813/1638] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Sep 28 12:14:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:14:53.755982 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e1b63-e0db-4f8c-8859-25cca6f30e1c None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:53.763764 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 826/1639] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 28 12:14:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:53.766683 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a3e4d-5442-4964-b465-347059b6b776 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:53.767089 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a3e4d-5442-4964-b465-347059b6b776 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:53.767980 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a3e4d-5442-4964-b465-347059b6b776 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:53.772770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 827/1640] 10.222.0.16 () {54 vars in 912 bytes} [Wed Sep 28 12:14:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:14:53.776793 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a3e4d-5442-4964-b465-347059b6b776 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:53.807968 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a3e4d-5442-4964-b465-347059b6b776 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:53.823862 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994cd2a1-7048-48df-92e9-036a4170d29d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:53.825283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cd2a1-7048-48df-92e9-036a4170d29d service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:53.826839 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cd2a1-7048-48df-92e9-036a4170d29d service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:53.827656 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cd2a1-7048-48df-92e9-036a4170d29d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:53.839627 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:53.855669 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994cd2a1-7048-48df-92e9-036a4170d29d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:53.858670 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994cd2a1-7048-48df-92e9-036a4170d29d service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:53.883819 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 828/1641] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:14:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:14:53.885624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cd61e-fb42-47f9-876b-d6bbbedf8004 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:53.886124 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cd61e-fb42-47f9-876b-d6bbbedf8004 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:53.886521 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cd61e-fb42-47f9-876b-d6bbbedf8004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:53.929714 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-385cd61e-fb42-47f9-876b-d6bbbedf8004 None None] MFA Rules not processed for user `0e81804e04514ae882a1fd93789db025`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:53.933339 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-385cd61e-fb42-47f9-876b-d6bbbedf8004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:53.939384 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e1b63-e0db-4f8c-8859-25cca6f30e1c None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:53.955427 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48860007-99a8-47c2-8abd-629481ee5cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:53.956139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48860007-99a8-47c2-8abd-629481ee5cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:53.956422 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48860007-99a8-47c2-8abd-629481ee5cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:53.956684 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48860007-99a8-47c2-8abd-629481ee5cec admin admin] PATH_INFO: `/v3/users/f9bbb5f8c32848a09ce49d2b2959ce88` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:53.957924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48860007-99a8-47c2-8abd-629481ee5cec admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9bbb5f8c32848a09ce49d2b2959ce88)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:53.959994 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48860007-99a8-47c2-8abd-629481ee5cec admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:53.967646 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 829/1642] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 28 12:14:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:54.025068 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cd61e-fb42-47f9-876b-d6bbbedf8004 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:54.040986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cd61e-fb42-47f9-876b-d6bbbedf8004 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:54.046724 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6326f-613f-4de0-885e-915d39097699 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:54.047849 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6326f-613f-4de0-885e-915d39097699 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:54.048463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6326f-613f-4de0-885e-915d39097699 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:54.048840 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6326f-613f-4de0-885e-915d39097699 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:54.061770 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-48860007-99a8-47c2-8abd-629481ee5cec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9bbb5f8c32848a09ce49d2b2959ce88'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:54.063158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6326f-613f-4de0-885e-915d39097699 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:54.065320 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6326f-613f-4de0-885e-915d39097699 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:54.081677 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 830/1643] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:14:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:14:54.094184 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-48860007-99a8-47c2-8abd-629481ee5cec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9bbb5f8c32848a09ce49d2b2959ce88'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:54.097031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-48860007-99a8-47c2-8abd-629481ee5cec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9bbb5f8c32848a09ce49d2b2959ce88'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:54.135571 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-48860007-99a8-47c2-8abd-629481ee5cec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9bbb5f8c32848a09ce49d2b2959ce88'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:54.144124 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-48860007-99a8-47c2-8abd-629481ee5cec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9bbb5f8c32848a09ce49d2b2959ce88'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:54.157232 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 814/1644] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:14:53 2022] DELETE /identity/v3/users/f9bbb5f8c32848a09ce49d2b2959ce88 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:14:54.162447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14e9b9-e818-4a4d-83ba-833a91f65cc7 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:54.163221 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14e9b9-e818-4a4d-83ba-833a91f65cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:54.164128 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14e9b9-e818-4a4d-83ba-833a91f65cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:54.214151 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-9d14e9b9-e818-4a4d-83ba-833a91f65cc7 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:54.217260 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9d14e9b9-e818-4a4d-83ba-833a91f65cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:54.228902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:54.396048 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 831/1645] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:54.405371 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48860007-99a8-47c2-8abd-629481ee5cec admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:54.406877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-48860007-99a8-47c2-8abd-629481ee5cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:54.604191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48860007-99a8-47c2-8abd-629481ee5cec admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:54.613607 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7141e-fab5-4370-b8ee-970538059e64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:54.614234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7141e-fab5-4370-b8ee-970538059e64 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:54.614508 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7141e-fab5-4370-b8ee-970538059e64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:54.614919 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7141e-fab5-4370-b8ee-970538059e64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:54.636911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7141e-fab5-4370-b8ee-970538059e64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:54.638633 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7141e-fab5-4370-b8ee-970538059e64 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:54.647078 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14e9b9-e818-4a4d-83ba-833a91f65cc7 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:54.648199 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9d14e9b9-e818-4a4d-83ba-833a91f65cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:54.665494 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 815/1646] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:14:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:14:54.679191 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14e9b9-e818-4a4d-83ba-833a91f65cc7 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:54.719229 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81005514-6759-4717-ae2a-e44823118e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:54.720580 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81005514-6759-4717-ae2a-e44823118e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:54.722144 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81005514-6759-4717-ae2a-e44823118e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:54.726411 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81005514-6759-4717-ae2a-e44823118e73 admin admin] PATH_INFO: `/v3/users/a42521faa4fe4e6c88e9692a1bbfa87b` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:54.737912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81005514-6759-4717-ae2a-e44823118e73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a42521faa4fe4e6c88e9692a1bbfa87b)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:54.741645 dv-cinder-859193-2-smb devstack@keystone.service[81598]: WARNING py.warnings [None req-81005514-6759-4717-ae2a-e44823118e73 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:14:54.741645 dv-cinder-859193-2-smb devstack@keystone.service[81598]: warnings.warn(msg) Sep 28 12:14:54.741645 dv-cinder-859193-2-smb devstack@keystone.service[81598]: Sep 28 12:14:54.745040 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81005514-6759-4717-ae2a-e44823118e73 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:54.842990 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7141e-fab5-4370-b8ee-970538059e64 service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:54.844270 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-3df7141e-fab5-4370-b8ee-970538059e64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:54.869917 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7141e-fab5-4370-b8ee-970538059e64 service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:54.890527 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bf1e6-9a70-49d7-baad-12efd3fbca8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:54.891226 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bf1e6-9a70-49d7-baad-12efd3fbca8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:54.891540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bf1e6-9a70-49d7-baad-12efd3fbca8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:54.891830 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bf1e6-9a70-49d7-baad-12efd3fbca8d admin admin] PATH_INFO: `/v3/users/245db39c295f4bfca762cee84278adf0` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:54.897045 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334bf1e6-9a70-49d7-baad-12efd3fbca8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=245db39c295f4bfca762cee84278adf0)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:54.899246 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334bf1e6-9a70-49d7-baad-12efd3fbca8d admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:54.959473 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-81005514-6759-4717-ae2a-e44823118e73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a42521faa4fe4e6c88e9692a1bbfa87b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:54.961815 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-81005514-6759-4717-ae2a-e44823118e73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a42521faa4fe4e6c88e9692a1bbfa87b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:54.986152 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:54.993975 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-81005514-6759-4717-ae2a-e44823118e73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a42521faa4fe4e6c88e9692a1bbfa87b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:54.999825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-334bf1e6-9a70-49d7-baad-12efd3fbca8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '245db39c295f4bfca762cee84278adf0'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:55.016487 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-81005514-6759-4717-ae2a-e44823118e73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a42521faa4fe4e6c88e9692a1bbfa87b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:55.017093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-81005514-6759-4717-ae2a-e44823118e73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a42521faa4fe4e6c88e9692a1bbfa87b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:55.018317 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-334bf1e6-9a70-49d7-baad-12efd3fbca8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '245db39c295f4bfca762cee84278adf0'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:55.019808 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-334bf1e6-9a70-49d7-baad-12efd3fbca8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '245db39c295f4bfca762cee84278adf0'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:55.032911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-334bf1e6-9a70-49d7-baad-12efd3fbca8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '245db39c295f4bfca762cee84278adf0'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:55.045285 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-334bf1e6-9a70-49d7-baad-12efd3fbca8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '245db39c295f4bfca762cee84278adf0'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:55.054886 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 816/1647] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:14:54 2022] DELETE /identity/v3/users/245db39c295f4bfca762cee84278adf0 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:14:55.060751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163269e-6d29-497b-b8c6-4f4a54512bc2 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:55.061058 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163269e-6d29-497b-b8c6-4f4a54512bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:55.061341 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163269e-6d29-497b-b8c6-4f4a54512bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:55.079938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 832/1648] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:14:54 2022] DELETE /identity/v3/users/a42521faa4fe4e6c88e9692a1bbfa87b => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:14:55.084421 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c974a-6f0e-45d5-b3e3-c19776388819 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:55.084708 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c974a-6f0e-45d5-b3e3-c19776388819 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:55.084802 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-7163269e-6d29-497b-b8c6-4f4a54512bc2 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:55.085066 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c974a-6f0e-45d5-b3e3-c19776388819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:55.086846 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-7163269e-6d29-497b-b8c6-4f4a54512bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:55.124279 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-bc8c974a-6f0e-45d5-b3e3-c19776388819 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:55.126949 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-bc8c974a-6f0e-45d5-b3e3-c19776388819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:55.178231 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 817/1649] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:55.215317 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163269e-6d29-497b-b8c6-4f4a54512bc2 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:55.217614 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-7163269e-6d29-497b-b8c6-4f4a54512bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:55.278590 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 833/1650] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:55.302160 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163269e-6d29-497b-b8c6-4f4a54512bc2 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:55.306517 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71f9de-ffe5-4b17-9fb8-6c3cc3fb60c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:55.307146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71f9de-ffe5-4b17-9fb8-6c3cc3fb60c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:55.307418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71f9de-ffe5-4b17-9fb8-6c3cc3fb60c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:55.307767 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71f9de-ffe5-4b17-9fb8-6c3cc3fb60c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:55.328755 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71f9de-ffe5-4b17-9fb8-6c3cc3fb60c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:55.330883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71f9de-ffe5-4b17-9fb8-6c3cc3fb60c9 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:55.341034 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c974a-6f0e-45d5-b3e3-c19776388819 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:55.344402 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 818/1651] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:14:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:14:55.357492 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c974a-6f0e-45d5-b3e3-c19776388819 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:55.363627 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80ba02-7d53-416f-91b1-b7b199fbc1bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:55.364377 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80ba02-7d53-416f-91b1-b7b199fbc1bc service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:55.364755 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80ba02-7d53-416f-91b1-b7b199fbc1bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:55.365123 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80ba02-7d53-416f-91b1-b7b199fbc1bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:55.378659 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80ba02-7d53-416f-91b1-b7b199fbc1bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:55.381008 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80ba02-7d53-416f-91b1-b7b199fbc1bc service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:55.394887 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 834/1652] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:14:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:14:55.587183 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71f9de-ffe5-4b17-9fb8-6c3cc3fb60c9 service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:55.589020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-db71f9de-ffe5-4b17-9fb8-6c3cc3fb60c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:55.625397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71f9de-ffe5-4b17-9fb8-6c3cc3fb60c9 service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:55.636699 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ea3b5-7628-4a6a-8c19-111762678cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:55.637413 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ea3b5-7628-4a6a-8c19-111762678cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:55.637691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ea3b5-7628-4a6a-8c19-111762678cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:55.637960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ea3b5-7628-4a6a-8c19-111762678cd7 admin admin] PATH_INFO: `/v3/projects/a94013a9723944a4b30e2bded1c58c9c` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:55.639101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ea3b5-7628-4a6a-8c19-111762678cd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a94013a9723944a4b30e2bded1c58c9c)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:55.640165 dv-cinder-859193-2-smb devstack@keystone.service[81599]: WARNING py.warnings [None req-c97ea3b5-7628-4a6a-8c19-111762678cd7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:14:55.640165 dv-cinder-859193-2-smb devstack@keystone.service[81599]: warnings.warn(msg) Sep 28 12:14:55.640165 dv-cinder-859193-2-smb devstack@keystone.service[81599]: Sep 28 12:14:55.641816 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ea3b5-7628-4a6a-8c19-111762678cd7 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:55.800130 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c97ea3b5-7628-4a6a-8c19-111762678cd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a94013a9723944a4b30e2bded1c58c9c', 'request_id': 'req-c97ea3b5-7628-4a6a-8c19-111762678cd7'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:55.822040 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c97ea3b5-7628-4a6a-8c19-111762678cd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a94013a9723944a4b30e2bded1c58c9c', 'request_id': 'req-c97ea3b5-7628-4a6a-8c19-111762678cd7'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:55.835007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:55.873187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c97ea3b5-7628-4a6a-8c19-111762678cd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a94013a9723944a4b30e2bded1c58c9c', 'request_id': 'req-c97ea3b5-7628-4a6a-8c19-111762678cd7'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:55.938248 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c97ea3b5-7628-4a6a-8c19-111762678cd7 admin admin] The token cache is being invalidate because project a94013a9723944a4b30e2bded1c58c9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:14:55.938574 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c97ea3b5-7628-4a6a-8c19-111762678cd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:55.940466 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c97ea3b5-7628-4a6a-8c19-111762678cd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:55.954907 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 819/1653] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:14:55 2022] DELETE /identity/v3/projects/a94013a9723944a4b30e2bded1c58c9c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:14:55.958822 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80ba02-7d53-416f-91b1-b7b199fbc1bc service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:55.973107 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80ba02-7d53-416f-91b1-b7b199fbc1bc service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:55.991233 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:56.114790 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c7488-1c38-4c13-995a-6f99de1e0f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:56.120352 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c7488-1c38-4c13-995a-6f99de1e0f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:56.120958 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c7488-1c38-4c13-995a-6f99de1e0f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:56.121250 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c7488-1c38-4c13-995a-6f99de1e0f8b admin admin] PATH_INFO: `/v3/users/f74e5545efbb4cbc805f57f9058305e7` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:56.124327 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c7488-1c38-4c13-995a-6f99de1e0f8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f74e5545efbb4cbc805f57f9058305e7)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:56.126501 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c7488-1c38-4c13-995a-6f99de1e0f8b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:56.272775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-484c7488-1c38-4c13-995a-6f99de1e0f8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f74e5545efbb4cbc805f57f9058305e7'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:56.275274 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-484c7488-1c38-4c13-995a-6f99de1e0f8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f74e5545efbb4cbc805f57f9058305e7'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:56.300195 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-484c7488-1c38-4c13-995a-6f99de1e0f8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f74e5545efbb4cbc805f57f9058305e7'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:56.318614 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-484c7488-1c38-4c13-995a-6f99de1e0f8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f74e5545efbb4cbc805f57f9058305e7'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:56.319293 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-484c7488-1c38-4c13-995a-6f99de1e0f8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f74e5545efbb4cbc805f57f9058305e7'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:56.343912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 835/1654] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:14:55 2022] DELETE /identity/v3/users/f74e5545efbb4cbc805f57f9058305e7 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:14:57.164080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ea3b5-7628-4a6a-8c19-111762678cd7 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:57.165647 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-c97ea3b5-7628-4a6a-8c19-111762678cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:57.189746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ea3b5-7628-4a6a-8c19-111762678cd7 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:57.343170 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f884163-2fe1-4b84-91cd-af8b7ca530b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:57.344887 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f884163-2fe1-4b84-91cd-af8b7ca530b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:57.345645 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f884163-2fe1-4b84-91cd-af8b7ca530b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:57.346413 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f884163-2fe1-4b84-91cd-af8b7ca530b8 admin admin] PATH_INFO: `/v3/projects/67a808b5a9cf40dda8dfbcaa318de273` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:57.352743 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f884163-2fe1-4b84-91cd-af8b7ca530b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67a808b5a9cf40dda8dfbcaa318de273)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:57.357661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f884163-2fe1-4b84-91cd-af8b7ca530b8 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:57.458827 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-8f884163-2fe1-4b84-91cd-af8b7ca530b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67a808b5a9cf40dda8dfbcaa318de273', 'request_id': 'req-8f884163-2fe1-4b84-91cd-af8b7ca530b8'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:57.484552 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-8f884163-2fe1-4b84-91cd-af8b7ca530b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67a808b5a9cf40dda8dfbcaa318de273', 'request_id': 'req-8f884163-2fe1-4b84-91cd-af8b7ca530b8'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:57.506671 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-8f884163-2fe1-4b84-91cd-af8b7ca530b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67a808b5a9cf40dda8dfbcaa318de273', 'request_id': 'req-8f884163-2fe1-4b84-91cd-af8b7ca530b8'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:57.532054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-8f884163-2fe1-4b84-91cd-af8b7ca530b8 admin admin] The token cache is being invalidate because project 67a808b5a9cf40dda8dfbcaa318de273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:14:57.532549 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-8f884163-2fe1-4b84-91cd-af8b7ca530b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:57.533951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-8f884163-2fe1-4b84-91cd-af8b7ca530b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:57.536685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 820/1655] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:14:57 2022] DELETE /identity/v3/projects/67a808b5a9cf40dda8dfbcaa318de273 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:14:57.541324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c5ff7-bebf-45bd-8f28-7f9ef80048ae None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:57.542269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c5ff7-bebf-45bd-8f28-7f9ef80048ae None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:57.542747 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c5ff7-bebf-45bd-8f28-7f9ef80048ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:57.572595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f884163-2fe1-4b84-91cd-af8b7ca530b8 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:57.580021 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-8f884163-2fe1-4b84-91cd-af8b7ca530b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:57.618589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-663c5ff7-bebf-45bd-8f28-7f9ef80048ae None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:57.620151 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-663c5ff7-bebf-45bd-8f28-7f9ef80048ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:57.764040 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 836/1656] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:14:57.765075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c5ff7-bebf-45bd-8f28-7f9ef80048ae None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:57.771199 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-663c5ff7-bebf-45bd-8f28-7f9ef80048ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:57.779518 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f884163-2fe1-4b84-91cd-af8b7ca530b8 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:57.796852 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290553f-58f5-47f5-b7c7-24a29d37f273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:57.797630 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c5ff7-bebf-45bd-8f28-7f9ef80048ae None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:57.798073 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290553f-58f5-47f5-b7c7-24a29d37f273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:57.798935 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290553f-58f5-47f5-b7c7-24a29d37f273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:57.799841 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290553f-58f5-47f5-b7c7-24a29d37f273 admin admin] PATH_INFO: `/v3/projects/9f2ad31314694dc692b541dc82f5e0e3` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:57.801215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290553f-58f5-47f5-b7c7-24a29d37f273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f2ad31314694dc692b541dc82f5e0e3)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:57.806006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290553f-58f5-47f5-b7c7-24a29d37f273 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:57.809713 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccae3ae-c36f-48d4-9adf-d411d0365dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:57.810315 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccae3ae-c36f-48d4-9adf-d411d0365dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:57.810606 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccae3ae-c36f-48d4-9adf-d411d0365dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:57.811074 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccae3ae-c36f-48d4-9adf-d411d0365dac admin admin] PATH_INFO: `/v3/projects/2ce042c912bf4db1b62c1c19e52fb91f` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:57.815514 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccae3ae-c36f-48d4-9adf-d411d0365dac admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ce042c912bf4db1b62c1c19e52fb91f)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:57.817290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccae3ae-c36f-48d4-9adf-d411d0365dac admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:57.867044 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:57.890215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:57.942220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-8290553f-58f5-47f5-b7c7-24a29d37f273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f2ad31314694dc692b541dc82f5e0e3', 'request_id': 'req-8290553f-58f5-47f5-b7c7-24a29d37f273'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:57.952872 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-8290553f-58f5-47f5-b7c7-24a29d37f273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f2ad31314694dc692b541dc82f5e0e3', 'request_id': 'req-8290553f-58f5-47f5-b7c7-24a29d37f273'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:57.954976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cccae3ae-c36f-48d4-9adf-d411d0365dac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ce042c912bf4db1b62c1c19e52fb91f', 'request_id': 'req-cccae3ae-c36f-48d4-9adf-d411d0365dac'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:57.964605 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-8290553f-58f5-47f5-b7c7-24a29d37f273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f2ad31314694dc692b541dc82f5e0e3', 'request_id': 'req-8290553f-58f5-47f5-b7c7-24a29d37f273'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:57.973705 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cccae3ae-c36f-48d4-9adf-d411d0365dac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ce042c912bf4db1b62c1c19e52fb91f', 'request_id': 'req-cccae3ae-c36f-48d4-9adf-d411d0365dac'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:57.986504 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cccae3ae-c36f-48d4-9adf-d411d0365dac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ce042c912bf4db1b62c1c19e52fb91f', 'request_id': 'req-cccae3ae-c36f-48d4-9adf-d411d0365dac'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:57.987560 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-8290553f-58f5-47f5-b7c7-24a29d37f273 admin admin] The token cache is being invalidate because project 9f2ad31314694dc692b541dc82f5e0e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:14:57.998332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-8290553f-58f5-47f5-b7c7-24a29d37f273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:58.004233 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-8290553f-58f5-47f5-b7c7-24a29d37f273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:58.007554 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 821/1657] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:14:57 2022] DELETE /identity/v3/projects/9f2ad31314694dc692b541dc82f5e0e3 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:14:58.009643 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aff147-37d6-4a37-a65e-13abf69ab692 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:58.010134 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aff147-37d6-4a37-a65e-13abf69ab692 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:58.010650 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aff147-37d6-4a37-a65e-13abf69ab692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:58.021925 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cccae3ae-c36f-48d4-9adf-d411d0365dac admin admin] The token cache is being invalidate because project 2ce042c912bf4db1b62c1c19e52fb91f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:14:58.022229 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cccae3ae-c36f-48d4-9adf-d411d0365dac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:58.023989 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cccae3ae-c36f-48d4-9adf-d411d0365dac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:58.031800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 837/1658] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:14:57 2022] DELETE /identity/v3/projects/2ce042c912bf4db1b62c1c19e52fb91f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:14:58.033410 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e2746-845d-4a31-b1de-4920590351f7 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:58.033707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e2746-845d-4a31-b1de-4920590351f7 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:58.034127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e2746-845d-4a31-b1de-4920590351f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:58.044680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-e9aff147-37d6-4a37-a65e-13abf69ab692 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:58.046545 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-e9aff147-37d6-4a37-a65e-13abf69ab692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:58.077647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b19e2746-845d-4a31-b1de-4920590351f7 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:58.078903 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b19e2746-845d-4a31-b1de-4920590351f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:58.147293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 822/1659] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:58.150781 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aff147-37d6-4a37-a65e-13abf69ab692 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:58.152917 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-e9aff147-37d6-4a37-a65e-13abf69ab692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:58.190638 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aff147-37d6-4a37-a65e-13abf69ab692 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:58.209599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db00a10-786d-44c6-8af0-c87b6ec7145d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:58.210266 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db00a10-786d-44c6-8af0-c87b6ec7145d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:58.210544 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db00a10-786d-44c6-8af0-c87b6ec7145d admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:58.210816 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db00a10-786d-44c6-8af0-c87b6ec7145d admin admin] PATH_INFO: `/v3/users/e489d092e6c04e829301786d69f72847` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:58.220370 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db00a10-786d-44c6-8af0-c87b6ec7145d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e489d092e6c04e829301786d69f72847)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:58.222349 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db00a10-786d-44c6-8af0-c87b6ec7145d admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:58.235065 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 838/1660] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:58.244297 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e2746-845d-4a31-b1de-4920590351f7 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:58.273310 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e2746-845d-4a31-b1de-4920590351f7 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:58.285364 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea3fd2-1eb1-44bd-b018-f28160804fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:58.286009 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea3fd2-1eb1-44bd-b018-f28160804fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:58.286290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea3fd2-1eb1-44bd-b018-f28160804fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:58.286567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea3fd2-1eb1-44bd-b018-f28160804fe3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:58.287288 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea3fd2-1eb1-44bd-b018-f28160804fe3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:14:58.287561 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea3fd2-1eb1-44bd-b018-f28160804fe3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:58.289362 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea3fd2-1eb1-44bd-b018-f28160804fe3 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:58.311938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 839/1661] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:14:58.311938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da414a-b9c8-4f06-9b26-3b7616a9a535 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:58.311938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da414a-b9c8-4f06-9b26-3b7616a9a535 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:58.311938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da414a-b9c8-4f06-9b26-3b7616a9a535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:58.345955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b4da414a-b9c8-4f06-9b26-3b7616a9a535 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:58.348695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b4da414a-b9c8-4f06-9b26-3b7616a9a535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:58.352643 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-9db00a10-786d-44c6-8af0-c87b6ec7145d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e489d092e6c04e829301786d69f72847'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:58.385507 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 840/1662] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:58.385507 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da414a-b9c8-4f06-9b26-3b7616a9a535 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:58.385759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-9db00a10-786d-44c6-8af0-c87b6ec7145d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e489d092e6c04e829301786d69f72847'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:58.386509 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-9db00a10-786d-44c6-8af0-c87b6ec7145d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e489d092e6c04e829301786d69f72847'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:58.402133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da414a-b9c8-4f06-9b26-3b7616a9a535 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:58.412071 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-9db00a10-786d-44c6-8af0-c87b6ec7145d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e489d092e6c04e829301786d69f72847'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:58.432296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-9db00a10-786d-44c6-8af0-c87b6ec7145d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e489d092e6c04e829301786d69f72847'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:14:58.440130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50558c-b6cc-4fc5-9bcb-1389f9ef2a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:58.440776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50558c-b6cc-4fc5-9bcb-1389f9ef2a1f admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:58.441060 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50558c-b6cc-4fc5-9bcb-1389f9ef2a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:58.441332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50558c-b6cc-4fc5-9bcb-1389f9ef2a1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:58.441979 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50558c-b6cc-4fc5-9bcb-1389f9ef2a1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:58.443987 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50558c-b6cc-4fc5-9bcb-1389f9ef2a1f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:58.447540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 823/1663] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:14:58 2022] DELETE /identity/v3/users/e489d092e6c04e829301786d69f72847 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:14:58.448850 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db00a10-786d-44c6-8af0-c87b6ec7145d admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:58.452080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-9db00a10-786d-44c6-8af0-c87b6ec7145d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:58.479350 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:58.524656 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 841/1664] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:14:58 2022] POST /identity/v3/projects => generated 361 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:14:58.530516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50558c-b6cc-4fc5-9bcb-1389f9ef2a1f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:58.536266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-dd50558c-b6cc-4fc5-9bcb-1389f9ef2a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:58.585727 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db00a10-786d-44c6-8af0-c87b6ec7145d admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:58.679066 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50558c-b6cc-4fc5-9bcb-1389f9ef2a1f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:58.686257 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c20ee-491e-4daf-ad5d-84b6ecbde4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:58.687166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c20ee-491e-4daf-ad5d-84b6ecbde4fa admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:58.687689 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c20ee-491e-4daf-ad5d-84b6ecbde4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:58.688150 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c20ee-491e-4daf-ad5d-84b6ecbde4fa admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:58.688977 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c20ee-491e-4daf-ad5d-84b6ecbde4fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:58.691212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c20ee-491e-4daf-ad5d-84b6ecbde4fa admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:58.714845 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:58.722091 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73680da6-0531-40e9-a2eb-7fd464420510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:58.723562 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73680da6-0531-40e9-a2eb-7fd464420510 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:58.724015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73680da6-0531-40e9-a2eb-7fd464420510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:58.724589 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73680da6-0531-40e9-a2eb-7fd464420510 admin admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:58.725425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73680da6-0531-40e9-a2eb-7fd464420510 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:14:58.725889 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73680da6-0531-40e9-a2eb-7fd464420510 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:58.729084 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73680da6-0531-40e9-a2eb-7fd464420510 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:58.736636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 842/1665] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:14:58 2022] POST /identity/v3/users => generated 281 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:14:58.738260 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c20ee-491e-4daf-ad5d-84b6ecbde4fa admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:58.754651 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 824/1666] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:14:58.756406 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73680da6-0531-40e9-a2eb-7fd464420510 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:58.770021 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c20ee-491e-4daf-ad5d-84b6ecbde4fa admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:58.771394 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73680da6-0531-40e9-a2eb-7fd464420510 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:58.778841 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0689f-d8a7-426a-b5de-c3d285c47db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:58.779766 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0689f-d8a7-426a-b5de-c3d285c47db8 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:58.780207 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0689f-d8a7-426a-b5de-c3d285c47db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:58.780631 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0689f-d8a7-426a-b5de-c3d285c47db8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:58.781427 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0689f-d8a7-426a-b5de-c3d285c47db8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:58.789482 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab46e88-297b-4ee1-95ea-fadcd8f29f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:58.789772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab46e88-297b-4ee1-95ea-fadcd8f29f6f admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:58.790055 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab46e88-297b-4ee1-95ea-fadcd8f29f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:58.790330 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab46e88-297b-4ee1-95ea-fadcd8f29f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:58.790982 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab46e88-297b-4ee1-95ea-fadcd8f29f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:58.791090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0689f-d8a7-426a-b5de-c3d285c47db8 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:58.797948 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab46e88-297b-4ee1-95ea-fadcd8f29f6f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:58.820946 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 843/1667] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:14:58.825484 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab46e88-297b-4ee1-95ea-fadcd8f29f6f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:58.852721 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 825/1668] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:14:58 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:14:58.853869 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0689f-d8a7-426a-b5de-c3d285c47db8 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:58.855078 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab46e88-297b-4ee1-95ea-fadcd8f29f6f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:59.033016 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0689f-d8a7-426a-b5de-c3d285c47db8 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:59.039678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5888e-0a62-4dd7-8f1e-7a762a5c6990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:59.040760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5888e-0a62-4dd7-8f1e-7a762a5c6990 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:59.041608 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5888e-0a62-4dd7-8f1e-7a762a5c6990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:59.045469 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5888e-0a62-4dd7-8f1e-7a762a5c6990 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:59.046022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1705e-4aaa-4daf-a0fe-ca0d99b66059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:59.046673 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1705e-4aaa-4daf-a0fe-ca0d99b66059 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:59.046960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1705e-4aaa-4daf-a0fe-ca0d99b66059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:59.050377 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1705e-4aaa-4daf-a0fe-ca0d99b66059 admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:59.051105 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1705e-4aaa-4daf-a0fe-ca0d99b66059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:59.051227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5888e-0a62-4dd7-8f1e-7a762a5c6990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:59.053148 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5888e-0a62-4dd7-8f1e-7a762a5c6990 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:59.056954 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1705e-4aaa-4daf-a0fe-ca0d99b66059 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:59.091251 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 844/1669] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:14:59.097143 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5888e-0a62-4dd7-8f1e-7a762a5c6990 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:59.123829 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 826/1670] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:14:58 2022] POST /identity/v3/users => generated 287 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:14:59.127061 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1705e-4aaa-4daf-a0fe-ca0d99b66059 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:59.128546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5888e-0a62-4dd7-8f1e-7a762a5c6990 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:59.149150 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad38188-b902-450b-838c-a341c858dee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:59.150209 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad38188-b902-450b-838c-a341c858dee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:59.151037 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad38188-b902-450b-838c-a341c858dee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:59.151037 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad38188-b902-450b-838c-a341c858dee6 admin admin] PATH_INFO: `/v3/projects/f5342a4200e444b18110f52657431714/users/564d647b44344f909e237ff1210fa2a0/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:59.166744 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1705e-4aaa-4daf-a0fe-ca0d99b66059 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:59.183682 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c907926-0945-4d5d-974b-8d4a35d5afed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:59.184471 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c907926-0945-4d5d-974b-8d4a35d5afed admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:59.184945 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c907926-0945-4d5d-974b-8d4a35d5afed admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:59.185048 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c907926-0945-4d5d-974b-8d4a35d5afed admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:59.185129 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad38188-b902-450b-838c-a341c858dee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5342a4200e444b18110f52657431714, user_id=564d647b44344f909e237ff1210fa2a0, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:59.185678 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c907926-0945-4d5d-974b-8d4a35d5afed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:59.187291 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c907926-0945-4d5d-974b-8d4a35d5afed admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:59.188217 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad38188-b902-450b-838c-a341c858dee6 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:59.215495 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 845/1672] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:14:59 2022] PUT /identity/v3/projects/f5342a4200e444b18110f52657431714/users/564d647b44344f909e237ff1210fa2a0/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:14:59.215495 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad38188-b902-450b-838c-a341c858dee6 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:59.215764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 827/1672] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:14:59.229716 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080e95e-41dc-405c-a821-096c0f677055 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:59.230210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080e95e-41dc-405c-a821-096c0f677055 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:59.230672 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080e95e-41dc-405c-a821-096c0f677055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:59.302354 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-3080e95e-41dc-405c-a821-096c0f677055 None None] MFA Rules not processed for user `564d647b44344f909e237ff1210fa2a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:59.302354 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-3080e95e-41dc-405c-a821-096c0f677055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:59.311712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:59.351469 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad38188-b902-450b-838c-a341c858dee6 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:59.359314 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6eb5a-6d92-42aa-b426-f761ba85ca72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:59.360061 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6eb5a-6d92-42aa-b426-f761ba85ca72 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:59.360408 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6eb5a-6d92-42aa-b426-f761ba85ca72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:59.360753 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6eb5a-6d92-42aa-b426-f761ba85ca72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:59.361493 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6eb5a-6d92-42aa-b426-f761ba85ca72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:59.369363 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6eb5a-6d92-42aa-b426-f761ba85ca72 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:59.396687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 846/1673] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:14:59.398259 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6eb5a-6d92-42aa-b426-f761ba85ca72 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:59.421551 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6eb5a-6d92-42aa-b426-f761ba85ca72 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:59.428491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710bbe7-9fab-46d8-98c2-d982092cbcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:59.429267 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710bbe7-9fab-46d8-98c2-d982092cbcdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:59.429615 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710bbe7-9fab-46d8-98c2-d982092cbcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:59.429962 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710bbe7-9fab-46d8-98c2-d982092cbcdf admin admin] PATH_INFO: `/v3/projects/8645e3c35d694d4ab24d596f8412a0f0/users/e79c1baf555d491e95bd830e1204af1e/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:59.457595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 828/1674] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:59.463203 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080e95e-41dc-405c-a821-096c0f677055 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:59.466122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710bbe7-9fab-46d8-98c2-d982092cbcdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8645e3c35d694d4ab24d596f8412a0f0, user_id=e79c1baf555d491e95bd830e1204af1e, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:59.476366 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710bbe7-9fab-46d8-98c2-d982092cbcdf admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:59.504706 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 847/1675] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:14:59 2022] PUT /identity/v3/projects/8645e3c35d694d4ab24d596f8412a0f0/users/e79c1baf555d491e95bd830e1204af1e/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:14:59.514358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080e95e-41dc-405c-a821-096c0f677055 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:59.515893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59db6eb-3c84-4c94-a8e6-a7db869a2152 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:59.516277 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59db6eb-3c84-4c94-a8e6-a7db869a2152 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:59.516645 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59db6eb-3c84-4c94-a8e6-a7db869a2152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:59.571685 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-f59db6eb-3c84-4c94-a8e6-a7db869a2152 None None] MFA Rules not processed for user `e79c1baf555d491e95bd830e1204af1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:59.573054 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f59db6eb-3c84-4c94-a8e6-a7db869a2152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:59.634713 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:59.672777 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b56fd4-1e26-4b0c-a667-1170a8df5225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:59.673285 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b56fd4-1e26-4b0c-a667-1170a8df5225 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:59.673569 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b56fd4-1e26-4b0c-a667-1170a8df5225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:59.673841 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b56fd4-1e26-4b0c-a667-1170a8df5225 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:59.675150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b56fd4-1e26-4b0c-a667-1170a8df5225 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:59.678408 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b56fd4-1e26-4b0c-a667-1170a8df5225 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:59.759708 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 848/1676] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:14:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:14:59.763414 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59db6eb-3c84-4c94-a8e6-a7db869a2152 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:59.774355 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 829/1677] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:14:59 2022] POST /identity/v3/projects => generated 365 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:14:59.775366 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b56fd4-1e26-4b0c-a667-1170a8df5225 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:59.796158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59db6eb-3c84-4c94-a8e6-a7db869a2152 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:59.954189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b56fd4-1e26-4b0c-a667-1170a8df5225 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:59.961528 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb640e6-68ad-4eaf-b650-56dd00737b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:59.964100 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c186f22-6a83-4e04-b167-f8f5b868fb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:59.964730 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb640e6-68ad-4eaf-b650-56dd00737b4a admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:59.965204 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb640e6-68ad-4eaf-b650-56dd00737b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:59.966498 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c186f22-6a83-4e04-b167-f8f5b868fb33 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:59.966784 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c186f22-6a83-4e04-b167-f8f5b868fb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:59.967051 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c186f22-6a83-4e04-b167-f8f5b868fb33 admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:59.968888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb640e6-68ad-4eaf-b650-56dd00737b4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:59.969555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb640e6-68ad-4eaf-b650-56dd00737b4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:59.976788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c186f22-6a83-4e04-b167-f8f5b868fb33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:59.985819 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb640e6-68ad-4eaf-b650-56dd00737b4a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:59.985988 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c186f22-6a83-4e04-b167-f8f5b868fb33 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:00.062704 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 830/1678] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:14:59 2022] POST /identity/v3/users => generated 289 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:00.063784 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c186f22-6a83-4e04-b167-f8f5b868fb33 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:00.081076 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 849/1679] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:14:59 2022] POST /identity/v3/projects => generated 373 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:00.082216 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb640e6-68ad-4eaf-b650-56dd00737b4a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:00.091881 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c186f22-6a83-4e04-b167-f8f5b868fb33 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:00.154947 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:00.289288 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac0ecd-9f55-4a16-979f-6f1ad0ee847e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:00.290767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb640e6-68ad-4eaf-b650-56dd00737b4a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:00.291619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac0ecd-9f55-4a16-979f-6f1ad0ee847e admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:00.296243 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac0ecd-9f55-4a16-979f-6f1ad0ee847e admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:00.296931 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac0ecd-9f55-4a16-979f-6f1ad0ee847e admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:00.298507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac0ecd-9f55-4a16-979f-6f1ad0ee847e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:00.306456 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac0ecd-9f55-4a16-979f-6f1ad0ee847e admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:00.320227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bb02a-6ab8-41d1-be20-e648f355546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:00.321608 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bb02a-6ab8-41d1-be20-e648f355546e admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:00.323720 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bb02a-6ab8-41d1-be20-e648f355546e admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:00.324125 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bb02a-6ab8-41d1-be20-e648f355546e admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:00.325603 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bb02a-6ab8-41d1-be20-e648f355546e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:00.332805 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bb02a-6ab8-41d1-be20-e648f355546e admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:00.350467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 831/1680] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:00.352541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac0ecd-9f55-4a16-979f-6f1ad0ee847e admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:00.393481 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac0ecd-9f55-4a16-979f-6f1ad0ee847e admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:00.395426 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 850/1681] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:00 2022] POST /identity/v3/users => generated 293 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:00.396958 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bb02a-6ab8-41d1-be20-e648f355546e admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:00.403991 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2dfa00-b006-4d22-a3ef-c7e491136a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:00.405453 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2dfa00-b006-4d22-a3ef-c7e491136a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:00.405895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2dfa00-b006-4d22-a3ef-c7e491136a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:00.406269 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2dfa00-b006-4d22-a3ef-c7e491136a6e admin admin] PATH_INFO: `/v3/projects/73ba1e725718419aa5a58b82b6b0b4f5/users/f28f0b2053654edabe5d78f487c49068/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:00.430587 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bb02a-6ab8-41d1-be20-e648f355546e admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:00.442784 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca9716-e354-46e5-8338-ae77ae13c404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:00.445006 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca9716-e354-46e5-8338-ae77ae13c404 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:00.445596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca9716-e354-46e5-8338-ae77ae13c404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:00.446543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca9716-e354-46e5-8338-ae77ae13c404 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:00.447858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca9716-e354-46e5-8338-ae77ae13c404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:00.450475 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca9716-e354-46e5-8338-ae77ae13c404 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:00.450897 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2dfa00-b006-4d22-a3ef-c7e491136a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ba1e725718419aa5a58b82b6b0b4f5, user_id=f28f0b2053654edabe5d78f487c49068, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:00.458118 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2dfa00-b006-4d22-a3ef-c7e491136a6e admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:00.473904 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 851/1682] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:00.483902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca9716-e354-46e5-8338-ae77ae13c404 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:00.494016 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 832/1683] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:00 2022] PUT /identity/v3/projects/73ba1e725718419aa5a58b82b6b0b4f5/users/f28f0b2053654edabe5d78f487c49068/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:00.495943 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2dfa00-b006-4d22-a3ef-c7e491136a6e admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:00.521134 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca9716-e354-46e5-8338-ae77ae13c404 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:00.580933 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:00.667052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2dfa00-b006-4d22-a3ef-c7e491136a6e admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:00.672907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074b5c8-29d3-46a9-b153-d1d406b7dcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:00.676583 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074b5c8-29d3-46a9-b153-d1d406b7dcd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:00.676875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074b5c8-29d3-46a9-b153-d1d406b7dcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:00.677156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074b5c8-29d3-46a9-b153-d1d406b7dcd0 admin admin] PATH_INFO: `/v3/projects/58ea5cb422bc438c851714c27a9bebc7/users/e560966272c74aa999a0b90eb2ab2d08/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:00.680797 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4933f-73b6-4ea8-ad4a-20d8a5edbcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:00.681362 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4933f-73b6-4ea8-ad4a-20d8a5edbcfe admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:00.681642 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4933f-73b6-4ea8-ad4a-20d8a5edbcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:00.681914 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4933f-73b6-4ea8-ad4a-20d8a5edbcfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:00.682568 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4933f-73b6-4ea8-ad4a-20d8a5edbcfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:00.688348 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4933f-73b6-4ea8-ad4a-20d8a5edbcfe admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:00.720694 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074b5c8-29d3-46a9-b153-d1d406b7dcd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58ea5cb422bc438c851714c27a9bebc7, user_id=e560966272c74aa999a0b90eb2ab2d08, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:00.722359 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 833/1684] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:00.723297 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4933f-73b6-4ea8-ad4a-20d8a5edbcfe admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:00.725296 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074b5c8-29d3-46a9-b153-d1d406b7dcd0 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:00.748188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4933f-73b6-4ea8-ad4a-20d8a5edbcfe admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:00.755429 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 852/1685] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:00 2022] PUT /identity/v3/projects/58ea5cb422bc438c851714c27a9bebc7/users/e560966272c74aa999a0b90eb2ab2d08/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:00.762676 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074b5c8-29d3-46a9-b153-d1d406b7dcd0 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:00.874006 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074b5c8-29d3-46a9-b153-d1d406b7dcd0 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:00.881672 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1445add-f7fb-4317-9575-e102629d339a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:00.882441 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1445add-f7fb-4317-9575-e102629d339a admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:00.882795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1445add-f7fb-4317-9575-e102629d339a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:00.883204 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1445add-f7fb-4317-9575-e102629d339a admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:00.884039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1445add-f7fb-4317-9575-e102629d339a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:00.886071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1445add-f7fb-4317-9575-e102629d339a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:00.890615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8466a11-f802-4461-9a89-f3a309f41506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:00.892845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8466a11-f802-4461-9a89-f3a309f41506 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:00.893389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8466a11-f802-4461-9a89-f3a309f41506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:00.893742 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8466a11-f802-4461-9a89-f3a309f41506 admin admin] PATH_INFO: `/v3/projects/73ba1e725718419aa5a58b82b6b0b4f5/users/f28f0b2053654edabe5d78f487c49068/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:00.900617 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8466a11-f802-4461-9a89-f3a309f41506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ba1e725718419aa5a58b82b6b0b4f5, user_id=f28f0b2053654edabe5d78f487c49068, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:00.908112 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8466a11-f802-4461-9a89-f3a309f41506 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:00.909691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 853/1686] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:00.913653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1445add-f7fb-4317-9575-e102629d339a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:00.928794 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1445add-f7fb-4317-9575-e102629d339a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:00.936964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 834/1687] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:00 2022] PUT /identity/v3/projects/73ba1e725718419aa5a58b82b6b0b4f5/users/f28f0b2053654edabe5d78f487c49068/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:00.948151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ec6db-0941-4ca5-b85a-6cb0a081ce33 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:00.954617 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ec6db-0941-4ca5-b85a-6cb0a081ce33 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:00.954788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ec6db-0941-4ca5-b85a-6cb0a081ce33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:01.016427 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-f86ec6db-0941-4ca5-b85a-6cb0a081ce33 None None] MFA Rules not processed for user `f28f0b2053654edabe5d78f487c49068`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:01.023271 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-f86ec6db-0941-4ca5-b85a-6cb0a081ce33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:01.045083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:01.054286 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b3cb2-c991-46ce-9fcf-7ccf67daa9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:01.054912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b3cb2-c991-46ce-9fcf-7ccf67daa9ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:01.055103 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b3cb2-c991-46ce-9fcf-7ccf67daa9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:01.055283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b3cb2-c991-46ce-9fcf-7ccf67daa9ed admin admin] PATH_INFO: `/v3/projects/58ea5cb422bc438c851714c27a9bebc7/users/e560966272c74aa999a0b90eb2ab2d08/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:01.066162 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b3cb2-c991-46ce-9fcf-7ccf67daa9ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=58ea5cb422bc438c851714c27a9bebc7, user_id=e560966272c74aa999a0b90eb2ab2d08, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:01.068888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b3cb2-c991-46ce-9fcf-7ccf67daa9ed admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:01.092818 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 854/1688] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:00 2022] PUT /identity/v3/projects/58ea5cb422bc438c851714c27a9bebc7/users/e560966272c74aa999a0b90eb2ab2d08/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:01.103228 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fb55a-d8fb-4c39-90cf-b76524bbce0f None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:01.103544 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fb55a-d8fb-4c39-90cf-b76524bbce0f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:01.103819 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fb55a-d8fb-4c39-90cf-b76524bbce0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:01.205101 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-da3fb55a-d8fb-4c39-90cf-b76524bbce0f None None] MFA Rules not processed for user `e560966272c74aa999a0b90eb2ab2d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:01.206360 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-da3fb55a-d8fb-4c39-90cf-b76524bbce0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:01.209118 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 835/1689] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:00 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:01.210246 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ec6db-0941-4ca5-b85a-6cb0a081ce33 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:01.213031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-f86ec6db-0941-4ca5-b85a-6cb0a081ce33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:01.317939 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:01.352660 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ec6db-0941-4ca5-b85a-6cb0a081ce33 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:01.441281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 855/1690] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:01.462441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f83e5e-150b-45a4-a8c9-d1b9adcfd69f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:01.463236 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f83e5e-150b-45a4-a8c9-d1b9adcfd69f service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:01.463568 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f83e5e-150b-45a4-a8c9-d1b9adcfd69f service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:01.463834 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f83e5e-150b-45a4-a8c9-d1b9adcfd69f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:01.562897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fb55a-d8fb-4c39-90cf-b76524bbce0f None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:01.565489 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-da3fb55a-d8fb-4c39-90cf-b76524bbce0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:01.588819 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fb55a-d8fb-4c39-90cf-b76524bbce0f None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:01.613064 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746f8b4-fc3b-4330-8fac-eb2791519301 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:01.615190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746f8b4-fc3b-4330-8fac-eb2791519301 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:01.616003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746f8b4-fc3b-4330-8fac-eb2791519301 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:01.616003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746f8b4-fc3b-4330-8fac-eb2791519301 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:01.641444 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746f8b4-fc3b-4330-8fac-eb2791519301 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:01.642891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746f8b4-fc3b-4330-8fac-eb2791519301 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:01.652038 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f83e5e-150b-45a4-a8c9-d1b9adcfd69f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:01.653558 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f83e5e-150b-45a4-a8c9-d1b9adcfd69f service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:01.677315 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 856/1691] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:15:01.693011 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 836/1692] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:01 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:01.957037 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746f8b4-fc3b-4330-8fac-eb2791519301 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:01.969821 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746f8b4-fc3b-4330-8fac-eb2791519301 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:01.978200 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e30c97-73a9-4f7e-9270-4a88d81532b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:01.979196 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e30c97-73a9-4f7e-9270-4a88d81532b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:01.979975 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e30c97-73a9-4f7e-9270-4a88d81532b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:01.980446 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e30c97-73a9-4f7e-9270-4a88d81532b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:02.144894 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e30c97-73a9-4f7e-9270-4a88d81532b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:02.148499 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e30c97-73a9-4f7e-9270-4a88d81532b2 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:02.182190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 857/1693] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:02.622513 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f83e5e-150b-45a4-a8c9-d1b9adcfd69f service cinder] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:02.624149 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-07f83e5e-150b-45a4-a8c9-d1b9adcfd69f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:02.651947 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:02.794049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f83e5e-150b-45a4-a8c9-d1b9adcfd69f service cinder] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:02.803589 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f8813-00b3-4f17-a60a-a53f7d7df540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:02.804519 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f8813-00b3-4f17-a60a-a53f7d7df540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:02.804646 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f8813-00b3-4f17-a60a-a53f7d7df540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:02.804830 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f8813-00b3-4f17-a60a-a53f7d7df540 admin admin] PATH_INFO: `/v3/projects/b84d3a013f6049799df32f29e858e2c7` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:02.809593 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f8813-00b3-4f17-a60a-a53f7d7df540 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b84d3a013f6049799df32f29e858e2c7)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:02.817041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f8813-00b3-4f17-a60a-a53f7d7df540 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:02.833573 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e30c97-73a9-4f7e-9270-4a88d81532b2 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:02.856982 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e30c97-73a9-4f7e-9270-4a88d81532b2 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:02.870831 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b0bec-cbf3-4a28-bf78-d75e074aea78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:02.872042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b0bec-cbf3-4a28-bf78-d75e074aea78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:02.872328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b0bec-cbf3-4a28-bf78-d75e074aea78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:02.872896 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b0bec-cbf3-4a28-bf78-d75e074aea78 admin admin] PATH_INFO: `/v3/users/e79c1baf555d491e95bd830e1204af1e` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:02.880494 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b0bec-cbf3-4a28-bf78-d75e074aea78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e79c1baf555d491e95bd830e1204af1e)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:02.883804 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b0bec-cbf3-4a28-bf78-d75e074aea78 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:02.916608 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-558f8813-00b3-4f17-a60a-a53f7d7df540 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b84d3a013f6049799df32f29e858e2c7', 'request_id': 'req-558f8813-00b3-4f17-a60a-a53f7d7df540'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:02.931392 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-558f8813-00b3-4f17-a60a-a53f7d7df540 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b84d3a013f6049799df32f29e858e2c7', 'request_id': 'req-558f8813-00b3-4f17-a60a-a53f7d7df540'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:02.981656 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-558f8813-00b3-4f17-a60a-a53f7d7df540 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b84d3a013f6049799df32f29e858e2c7', 'request_id': 'req-558f8813-00b3-4f17-a60a-a53f7d7df540'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:03.008449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-558f8813-00b3-4f17-a60a-a53f7d7df540 admin admin] The token cache is being invalidate because project b84d3a013f6049799df32f29e858e2c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:03.008900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-558f8813-00b3-4f17-a60a-a53f7d7df540 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:03.011777 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-558f8813-00b3-4f17-a60a-a53f7d7df540 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:03.013928 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 837/1694] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:02 2022] DELETE /identity/v3/projects/b84d3a013f6049799df32f29e858e2c7 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:03.015958 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade06b04-331a-4694-b784-140c8cf55473 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:03.016283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade06b04-331a-4694-b784-140c8cf55473 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:03.016603 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade06b04-331a-4694-b784-140c8cf55473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:03.039027 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-d79b0bec-cbf3-4a28-bf78-d75e074aea78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e79c1baf555d491e95bd830e1204af1e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:03.040204 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-d79b0bec-cbf3-4a28-bf78-d75e074aea78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e79c1baf555d491e95bd830e1204af1e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:03.060386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-d79b0bec-cbf3-4a28-bf78-d75e074aea78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e79c1baf555d491e95bd830e1204af1e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:03.072973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-ade06b04-331a-4694-b784-140c8cf55473 None None] MFA Rules not processed for user `d533e3caa6ec4c7c9343a8cefd3af8d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:03.074736 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-ade06b04-331a-4694-b784-140c8cf55473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:03.077610 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-d79b0bec-cbf3-4a28-bf78-d75e074aea78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e79c1baf555d491e95bd830e1204af1e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:03.078319 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-d79b0bec-cbf3-4a28-bf78-d75e074aea78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e79c1baf555d491e95bd830e1204af1e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:03.131080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 858/1695] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:02 2022] DELETE /identity/v3/users/e79c1baf555d491e95bd830e1204af1e => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:03.131080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbdb5f-3190-4d18-b683-17d29cad6720 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:03.131080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbdb5f-3190-4d18-b683-17d29cad6720 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:03.131080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbdb5f-3190-4d18-b683-17d29cad6720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:03.154567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-e6bbdb5f-3190-4d18-b683-17d29cad6720 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:03.156158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e6bbdb5f-3190-4d18-b683-17d29cad6720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:03.201247 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:03.247169 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 838/1696] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:03.247169 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade06b04-331a-4694-b784-140c8cf55473 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:03.247169 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-ade06b04-331a-4694-b784-140c8cf55473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:03.328107 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 859/1697] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:03.328107 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375f9f4-b862-4f37-b31f-3b8cda93919b None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:03.328107 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375f9f4-b862-4f37-b31f-3b8cda93919b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:03.328107 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375f9f4-b862-4f37-b31f-3b8cda93919b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:03.344815 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:03.374079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-4375f9f4-b862-4f37-b31f-3b8cda93919b None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:03.376263 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-4375f9f4-b862-4f37-b31f-3b8cda93919b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:03.402200 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 860/1698] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:03.403932 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375f9f4-b862-4f37-b31f-3b8cda93919b None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:03.406988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-4375f9f4-b862-4f37-b31f-3b8cda93919b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:03.412954 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade06b04-331a-4694-b784-140c8cf55473 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:03.423845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c2763-f57b-4d0b-a4a5-a6376c9425bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:03.424498 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c2763-f57b-4d0b-a4a5-a6376c9425bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:03.424774 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c2763-f57b-4d0b-a4a5-a6376c9425bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:03.425563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c2763-f57b-4d0b-a4a5-a6376c9425bc admin admin] PATH_INFO: `/v3/users/2e413419aba94a5ba1122213dc57a41e` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:03.426360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c2763-f57b-4d0b-a4a5-a6376c9425bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e413419aba94a5ba1122213dc57a41e)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:03.438279 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c2763-f57b-4d0b-a4a5-a6376c9425bc admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:03.693260 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-976c2763-f57b-4d0b-a4a5-a6376c9425bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e413419aba94a5ba1122213dc57a41e'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:03.722055 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375f9f4-b862-4f37-b31f-3b8cda93919b None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:03.724012 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-976c2763-f57b-4d0b-a4a5-a6376c9425bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e413419aba94a5ba1122213dc57a41e'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:03.729358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-976c2763-f57b-4d0b-a4a5-a6376c9425bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e413419aba94a5ba1122213dc57a41e'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:03.748335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-976c2763-f57b-4d0b-a4a5-a6376c9425bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e413419aba94a5ba1122213dc57a41e'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:03.754494 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91ca97-80ec-4816-95c7-0320900ba65f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:03.755615 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91ca97-80ec-4816-95c7-0320900ba65f service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:03.755899 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91ca97-80ec-4816-95c7-0320900ba65f service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:03.760172 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91ca97-80ec-4816-95c7-0320900ba65f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:03.766112 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-976c2763-f57b-4d0b-a4a5-a6376c9425bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e413419aba94a5ba1122213dc57a41e'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:03.774687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9e91ca97-80ec-4816-95c7-0320900ba65f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:03.777114 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 839/1699] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:03 2022] DELETE /identity/v3/users/2e413419aba94a5ba1122213dc57a41e => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:03.778583 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131fca9-807b-4429-805f-ecc303122c9c None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:03.778870 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131fca9-807b-4429-805f-ecc303122c9c None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:03.779639 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131fca9-807b-4429-805f-ecc303122c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:03.845363 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-f131fca9-807b-4429-805f-ecc303122c9c None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:03.850417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-f131fca9-807b-4429-805f-ecc303122c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:03.973037 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91ca97-80ec-4816-95c7-0320900ba65f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:03.975897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91ca97-80ec-4816-95c7-0320900ba65f service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:04.002026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 861/1700] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:04.003993 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91ca97-80ec-4816-95c7-0320900ba65f service nova] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:04.006530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9e91ca97-80ec-4816-95c7-0320900ba65f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:04.048553 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 840/1701] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:04.054616 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58631f14-0751-4cb3-95f9-afd721afccc4 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:04.054616 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58631f14-0751-4cb3-95f9-afd721afccc4 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:04.054873 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58631f14-0751-4cb3-95f9-afd721afccc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:04.117912 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-58631f14-0751-4cb3-95f9-afd721afccc4 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:04.123270 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-58631f14-0751-4cb3-95f9-afd721afccc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:04.149643 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 841/1702] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:04.150222 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91ca97-80ec-4816-95c7-0320900ba65f service nova] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:04.153187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58631f14-0751-4cb3-95f9-afd721afccc4 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:04.168230 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:04.181918 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58631f14-0751-4cb3-95f9-afd721afccc4 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:04.195479 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a94f7-51da-426f-9910-fcd70ba1c870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:04.196060 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a94f7-51da-426f-9910-fcd70ba1c870 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:04.196339 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a94f7-51da-426f-9910-fcd70ba1c870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:04.197068 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a94f7-51da-426f-9910-fcd70ba1c870 admin admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:04.197744 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a94f7-51da-426f-9910-fcd70ba1c870 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:15:04.199214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a94f7-51da-426f-9910-fcd70ba1c870 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:04.207861 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a94f7-51da-426f-9910-fcd70ba1c870 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:04.236489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 842/1703] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:15:04.237431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a94f7-51da-426f-9910-fcd70ba1c870 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:04.329943 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c7775-b2bc-46d1-9bd9-7b5625615667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:04.330188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c7775-b2bc-46d1-9bd9-7b5625615667 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:04.330702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c7775-b2bc-46d1-9bd9-7b5625615667 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:04.330814 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c7775-b2bc-46d1-9bd9-7b5625615667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:04.334248 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:04.335882 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f58c7775-b2bc-46d1-9bd9-7b5625615667 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:04.368474 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c7775-b2bc-46d1-9bd9-7b5625615667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:04.370488 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c7775-b2bc-46d1-9bd9-7b5625615667 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:04.393686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a94f7-51da-426f-9910-fcd70ba1c870 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:04.399634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2feb1e-2308-4722-85a7-17a01061d1e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:04.400733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2feb1e-2308-4722-85a7-17a01061d1e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:04.401386 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2feb1e-2308-4722-85a7-17a01061d1e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:04.402336 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2feb1e-2308-4722-85a7-17a01061d1e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:04.412620 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 862/1704] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:04.417177 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c7775-b2bc-46d1-9bd9-7b5625615667 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:04.433211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2feb1e-2308-4722-85a7-17a01061d1e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:04.435846 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2feb1e-2308-4722-85a7-17a01061d1e0 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:04.450869 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 843/1705] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:04.464446 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c7775-b2bc-46d1-9bd9-7b5625615667 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:04.487337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d79ebd-925e-4a51-82c4-eb842a6dee0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:04.488075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d79ebd-925e-4a51-82c4-eb842a6dee0f admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:04.488425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d79ebd-925e-4a51-82c4-eb842a6dee0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:04.488760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d79ebd-925e-4a51-82c4-eb842a6dee0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:04.490473 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d79ebd-925e-4a51-82c4-eb842a6dee0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:04.494968 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d79ebd-925e-4a51-82c4-eb842a6dee0f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:04.573355 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 863/1706] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:04 2022] POST /identity/v3/projects => generated 357 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:04.574308 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2feb1e-2308-4722-85a7-17a01061d1e0 service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:04.588006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2feb1e-2308-4722-85a7-17a01061d1e0 service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:04.673572 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8578602-b7a9-4c87-9587-c0b1346a4b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:04.674041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8578602-b7a9-4c87-9587-c0b1346a4b00 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:04.674424 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8578602-b7a9-4c87-9587-c0b1346a4b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:04.674705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8578602-b7a9-4c87-9587-c0b1346a4b00 admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:04.675377 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8578602-b7a9-4c87-9587-c0b1346a4b00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:04.677467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8578602-b7a9-4c87-9587-c0b1346a4b00 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:04.718627 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 844/1707] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:04 2022] POST /identity/v3/users => generated 279 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:15:04.720727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d79ebd-925e-4a51-82c4-eb842a6dee0f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:04.736915 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d79ebd-925e-4a51-82c4-eb842a6dee0f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:04.749260 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8653a-fa34-403a-8306-f6ff24efd770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:04.749909 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8653a-fa34-403a-8306-f6ff24efd770 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:04.750191 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8653a-fa34-403a-8306-f6ff24efd770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:04.750470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8653a-fa34-403a-8306-f6ff24efd770 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:04.751214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8653a-fa34-403a-8306-f6ff24efd770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:04.752854 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8653a-fa34-403a-8306-f6ff24efd770 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:04.786027 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 864/1708] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:04.787876 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8578602-b7a9-4c87-9587-c0b1346a4b00 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:04.800171 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8578602-b7a9-4c87-9587-c0b1346a4b00 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:04.818567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30dfd54-9d1a-4fb3-aa16-13f311ab3f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:04.819217 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30dfd54-9d1a-4fb3-aa16-13f311ab3f79 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:04.819530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30dfd54-9d1a-4fb3-aa16-13f311ab3f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:04.819807 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30dfd54-9d1a-4fb3-aa16-13f311ab3f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:04.822825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30dfd54-9d1a-4fb3-aa16-13f311ab3f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:04.827187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30dfd54-9d1a-4fb3-aa16-13f311ab3f79 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:04.862432 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 845/1709] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:04.863016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8653a-fa34-403a-8306-f6ff24efd770 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:04.877344 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8653a-fa34-403a-8306-f6ff24efd770 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:04.888329 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4269c54-8faf-43d6-9543-d0b3695c4df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:04.889447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4269c54-8faf-43d6-9543-d0b3695c4df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:04.889924 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4269c54-8faf-43d6-9543-d0b3695c4df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:04.890384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4269c54-8faf-43d6-9543-d0b3695c4df1 admin admin] PATH_INFO: `/v3/projects/3efa5cb9e39649ccbdf069578aa48102/users/628f2a27689c4723aa13f0390ee310ee/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:04.920087 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4269c54-8faf-43d6-9543-d0b3695c4df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3efa5cb9e39649ccbdf069578aa48102, user_id=628f2a27689c4723aa13f0390ee310ee, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:04.924520 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4269c54-8faf-43d6-9543-d0b3695c4df1 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:04.951524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 865/1710] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:04 2022] PUT /identity/v3/projects/3efa5cb9e39649ccbdf069578aa48102/users/628f2a27689c4723aa13f0390ee310ee/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:04.961010 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609bf61-5f9e-4f59-b40f-cb696ae3dc57 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:04.961314 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609bf61-5f9e-4f59-b40f-cb696ae3dc57 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:04.961567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609bf61-5f9e-4f59-b40f-cb696ae3dc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:05.015847 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-e609bf61-5f9e-4f59-b40f-cb696ae3dc57 None None] MFA Rules not processed for user `628f2a27689c4723aa13f0390ee310ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:05.017505 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-e609bf61-5f9e-4f59-b40f-cb696ae3dc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:05.164219 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 846/1711] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:05.165112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4269c54-8faf-43d6-9543-d0b3695c4df1 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:05.310363 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4269c54-8faf-43d6-9543-d0b3695c4df1 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:05.324365 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3e01f-dfaf-4c71-8858-3d3b9e8d07c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:05.325755 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3e01f-dfaf-4c71-8858-3d3b9e8d07c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:05.326173 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3e01f-dfaf-4c71-8858-3d3b9e8d07c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:05.326576 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3e01f-dfaf-4c71-8858-3d3b9e8d07c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:05.328715 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3e01f-dfaf-4c71-8858-3d3b9e8d07c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:05.331309 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3e01f-dfaf-4c71-8858-3d3b9e8d07c2 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:05.399016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 866/1712] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:05 2022] POST /identity/v3/projects => generated 357 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:15:05.403465 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609bf61-5f9e-4f59-b40f-cb696ae3dc57 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:05.422924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609bf61-5f9e-4f59-b40f-cb696ae3dc57 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:05.514311 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:05.551228 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5987d-a380-4526-a554-fee8b9880473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:05.551873 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5987d-a380-4526-a554-fee8b9880473 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:05.552479 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5987d-a380-4526-a554-fee8b9880473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:05.552479 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5987d-a380-4526-a554-fee8b9880473 admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:05.553119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5987d-a380-4526-a554-fee8b9880473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:05.555098 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5987d-a380-4526-a554-fee8b9880473 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:05.632362 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 847/1713] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:05 2022] POST /identity/v3/users => generated 285 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:15:05.633817 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3e01f-dfaf-4c71-8858-3d3b9e8d07c2 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:05.650373 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3e01f-dfaf-4c71-8858-3d3b9e8d07c2 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:05.678978 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b82d8-fce7-4325-a113-b93cf972988f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:05.680226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b82d8-fce7-4325-a113-b93cf972988f admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:05.680511 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b82d8-fce7-4325-a113-b93cf972988f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:05.680786 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b82d8-fce7-4325-a113-b93cf972988f admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:05.681623 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b82d8-fce7-4325-a113-b93cf972988f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:05.686928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b82d8-fce7-4325-a113-b93cf972988f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:05.720256 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 867/1714] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:05.721599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5987d-a380-4526-a554-fee8b9880473 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:05.737577 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5987d-a380-4526-a554-fee8b9880473 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:05.749527 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef01b67-9a23-4c50-a05b-e0f4b7867385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:05.750669 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef01b67-9a23-4c50-a05b-e0f4b7867385 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:05.751253 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef01b67-9a23-4c50-a05b-e0f4b7867385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:05.751676 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef01b67-9a23-4c50-a05b-e0f4b7867385 admin admin] PATH_INFO: `/v3/projects/4b9b12d275864298bb25d75b3b928671/users/9a02ffab47e749f1b2b58cdec8b72751/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:05.808491 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef01b67-9a23-4c50-a05b-e0f4b7867385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b9b12d275864298bb25d75b3b928671, user_id=9a02ffab47e749f1b2b58cdec8b72751, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:05.811424 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef01b67-9a23-4c50-a05b-e0f4b7867385 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:05.831506 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 848/1715] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:05 2022] PUT /identity/v3/projects/4b9b12d275864298bb25d75b3b928671/users/9a02ffab47e749f1b2b58cdec8b72751/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:05.835695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b82d8-fce7-4325-a113-b93cf972988f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:05.849279 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b82d8-fce7-4325-a113-b93cf972988f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:05.917794 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:06.001381 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1face1a9-1dda-4e6d-9f8b-0b691c768c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:06.007544 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1face1a9-1dda-4e6d-9f8b-0b691c768c6a admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:06.007986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1face1a9-1dda-4e6d-9f8b-0b691c768c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:06.008254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1face1a9-1dda-4e6d-9f8b-0b691c768c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:06.009022 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1face1a9-1dda-4e6d-9f8b-0b691c768c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:06.014674 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1face1a9-1dda-4e6d-9f8b-0b691c768c6a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:06.032970 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef01b67-9a23-4c50-a05b-e0f4b7867385 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:06.033416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 868/1716] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:15:06.049966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef01b67-9a23-4c50-a05b-e0f4b7867385 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:06.059159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d201018-7935-4526-ad14-e2a837b24c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:06.061428 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d201018-7935-4526-ad14-e2a837b24c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:06.061874 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d201018-7935-4526-ad14-e2a837b24c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:06.062246 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d201018-7935-4526-ad14-e2a837b24c98 admin admin] PATH_INFO: `/v3/projects/4b9b12d275864298bb25d75b3b928671/users/9a02ffab47e749f1b2b58cdec8b72751/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:06.064623 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d201018-7935-4526-ad14-e2a837b24c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b9b12d275864298bb25d75b3b928671, user_id=9a02ffab47e749f1b2b58cdec8b72751, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:06.068476 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d201018-7935-4526-ad14-e2a837b24c98 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:06.087608 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 849/1717] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:06 2022] PUT /identity/v3/projects/4b9b12d275864298bb25d75b3b928671/users/9a02ffab47e749f1b2b58cdec8b72751/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:06.095726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536dd88-ac8b-4510-92ca-e9f93bcbdabb None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:06.096115 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536dd88-ac8b-4510-92ca-e9f93bcbdabb None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:06.097018 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536dd88-ac8b-4510-92ca-e9f93bcbdabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:06.155142 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d0af2-fb10-44e1-a88a-4f420939b226 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:06.155676 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d0af2-fb10-44e1-a88a-4f420939b226 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:06.156094 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d0af2-fb10-44e1-a88a-4f420939b226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:06.173655 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-5536dd88-ac8b-4510-92ca-e9f93bcbdabb None None] MFA Rules not processed for user `9a02ffab47e749f1b2b58cdec8b72751`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:06.176012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5536dd88-ac8b-4510-92ca-e9f93bcbdabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:06.234755 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-b27d0af2-fb10-44e1-a88a-4f420939b226 None None] MFA Rules not processed for user `bb71e0c02b4647b28ed6a6194d270d35`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:06.241295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b27d0af2-fb10-44e1-a88a-4f420939b226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:06.400738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 869/1718] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:06 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:06.412025 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536dd88-ac8b-4510-92ca-e9f93bcbdabb None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:06.414207 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5536dd88-ac8b-4510-92ca-e9f93bcbdabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:06.547464 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 850/1719] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:15:06.558733 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536dd88-ac8b-4510-92ca-e9f93bcbdabb None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:06.572192 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d0af2-fb10-44e1-a88a-4f420939b226 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:06.572555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a4ca0-4ab0-4eca-8ffe-496d8843b269 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:06.573376 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a4ca0-4ab0-4eca-8ffe-496d8843b269 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:06.574505 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b27d0af2-fb10-44e1-a88a-4f420939b226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:06.575849 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a4ca0-4ab0-4eca-8ffe-496d8843b269 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:06.576124 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a4ca0-4ab0-4eca-8ffe-496d8843b269 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:06.613445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a4ca0-4ab0-4eca-8ffe-496d8843b269 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:06.616353 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a4ca0-4ab0-4eca-8ffe-496d8843b269 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:06.658808 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 870/1720] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:06 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:15:06.659834 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a4ca0-4ab0-4eca-8ffe-496d8843b269 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:06.665769 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-706a4ca0-4ab0-4eca-8ffe-496d8843b269 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:06.890601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:06.898440 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d0af2-fb10-44e1-a88a-4f420939b226 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:06.910622 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a4ca0-4ab0-4eca-8ffe-496d8843b269 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:06.916752 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901199eb-c661-4ec8-9d33-62befc7a0c5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:06.917742 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901199eb-c661-4ec8-9d33-62befc7a0c5e service nova] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:06.919917 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901199eb-c661-4ec8-9d33-62befc7a0c5e service nova] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:06.920430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901199eb-c661-4ec8-9d33-62befc7a0c5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:06.930779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a450ac7-bc5d-4c47-ad3d-386d70d88f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:06.931892 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a450ac7-bc5d-4c47-ad3d-386d70d88f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:06.932173 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a450ac7-bc5d-4c47-ad3d-386d70d88f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:06.937860 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a450ac7-bc5d-4c47-ad3d-386d70d88f1e admin admin] PATH_INFO: `/v3/projects/8645e3c35d694d4ab24d596f8412a0f0` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:06.942849 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901199eb-c661-4ec8-9d33-62befc7a0c5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:06.943018 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a450ac7-bc5d-4c47-ad3d-386d70d88f1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8645e3c35d694d4ab24d596f8412a0f0)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:06.945607 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a450ac7-bc5d-4c47-ad3d-386d70d88f1e admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:06.951338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901199eb-c661-4ec8-9d33-62befc7a0c5e service nova] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:07.007448 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 851/1721] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:07.008206 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901199eb-c661-4ec8-9d33-62befc7a0c5e service nova] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:07.020240 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-901199eb-c661-4ec8-9d33-62befc7a0c5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:07.031235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-6a450ac7-bc5d-4c47-ad3d-386d70d88f1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8645e3c35d694d4ab24d596f8412a0f0', 'request_id': 'req-6a450ac7-bc5d-4c47-ad3d-386d70d88f1e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:07.052313 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-6a450ac7-bc5d-4c47-ad3d-386d70d88f1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8645e3c35d694d4ab24d596f8412a0f0', 'request_id': 'req-6a450ac7-bc5d-4c47-ad3d-386d70d88f1e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:07.068963 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-6a450ac7-bc5d-4c47-ad3d-386d70d88f1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8645e3c35d694d4ab24d596f8412a0f0', 'request_id': 'req-6a450ac7-bc5d-4c47-ad3d-386d70d88f1e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:07.082714 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901199eb-c661-4ec8-9d33-62befc7a0c5e service nova] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:07.094741 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-6a450ac7-bc5d-4c47-ad3d-386d70d88f1e admin admin] The token cache is being invalidate because project 8645e3c35d694d4ab24d596f8412a0f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:07.098384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-6a450ac7-bc5d-4c47-ad3d-386d70d88f1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:07.099469 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-6a450ac7-bc5d-4c47-ad3d-386d70d88f1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:07.107072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 871/1722] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:06 2022] DELETE /identity/v3/projects/8645e3c35d694d4ab24d596f8412a0f0 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:07.109326 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a450ac7-bc5d-4c47-ad3d-386d70d88f1e admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:07.117948 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:07.125421 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6a450ac7-bc5d-4c47-ad3d-386d70d88f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:07.330203 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a29af7-d3a9-4123-9cac-8a903c7a96ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:07.332910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a29af7-d3a9-4123-9cac-8a903c7a96ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:07.333646 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a29af7-d3a9-4123-9cac-8a903c7a96ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:07.333993 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a29af7-d3a9-4123-9cac-8a903c7a96ef admin admin] PATH_INFO: `/v3/projects/b9be0965856f4d51bc018467c040d986` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:07.337031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a29af7-d3a9-4123-9cac-8a903c7a96ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9be0965856f4d51bc018467c040d986)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:07.342755 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a29af7-d3a9-4123-9cac-8a903c7a96ef admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:07.383085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a450ac7-bc5d-4c47-ad3d-386d70d88f1e admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:07.400396 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2f5cf-1d38-4141-b598-e365822401e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:07.401046 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2f5cf-1d38-4141-b598-e365822401e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:07.404574 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2f5cf-1d38-4141-b598-e365822401e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:07.404875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2f5cf-1d38-4141-b598-e365822401e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:07.411718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-74a2f5cf-1d38-4141-b598-e365822401e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:07.463118 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-25a29af7-d3a9-4123-9cac-8a903c7a96ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9be0965856f4d51bc018467c040d986', 'request_id': 'req-25a29af7-d3a9-4123-9cac-8a903c7a96ef'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:07.471227 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-25a29af7-d3a9-4123-9cac-8a903c7a96ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9be0965856f4d51bc018467c040d986', 'request_id': 'req-25a29af7-d3a9-4123-9cac-8a903c7a96ef'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:07.483816 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-25a29af7-d3a9-4123-9cac-8a903c7a96ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9be0965856f4d51bc018467c040d986', 'request_id': 'req-25a29af7-d3a9-4123-9cac-8a903c7a96ef'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:07.528869 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-25a29af7-d3a9-4123-9cac-8a903c7a96ef admin admin] The token cache is being invalidate because project b9be0965856f4d51bc018467c040d986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:07.529388 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-25a29af7-d3a9-4123-9cac-8a903c7a96ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:07.530481 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-25a29af7-d3a9-4123-9cac-8a903c7a96ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:07.538571 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 852/1723] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:07 2022] DELETE /identity/v3/projects/b9be0965856f4d51bc018467c040d986 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:07.540241 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a29af7-d3a9-4123-9cac-8a903c7a96ef admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:07.542054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-25a29af7-d3a9-4123-9cac-8a903c7a96ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:07.557929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2f5cf-1d38-4141-b598-e365822401e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:07.562685 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2f5cf-1d38-4141-b598-e365822401e3 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:07.587362 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 872/1724] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:07.599343 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73051d90-0caa-407c-87bf-a4426fb7233f None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:07.599656 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73051d90-0caa-407c-87bf-a4426fb7233f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:07.599929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73051d90-0caa-407c-87bf-a4426fb7233f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:07.662999 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-73051d90-0caa-407c-87bf-a4426fb7233f None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:07.666327 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-73051d90-0caa-407c-87bf-a4426fb7233f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:07.693701 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a29af7-d3a9-4123-9cac-8a903c7a96ef admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:07.710533 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a8932-4b1a-4948-afda-5ea906c1e15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:07.711137 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a8932-4b1a-4948-afda-5ea906c1e15d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:07.711426 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a8932-4b1a-4948-afda-5ea906c1e15d admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:07.711734 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a8932-4b1a-4948-afda-5ea906c1e15d admin admin] PATH_INFO: `/v3/users/e560966272c74aa999a0b90eb2ab2d08` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:07.717084 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a8932-4b1a-4948-afda-5ea906c1e15d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e560966272c74aa999a0b90eb2ab2d08)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:07.726832 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a8932-4b1a-4948-afda-5ea906c1e15d admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:07.765884 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:07.831978 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 873/1725] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:07.839596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea7582-2f98-4ca8-9a95-5590334fa764 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:07.839888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea7582-2f98-4ca8-9a95-5590334fa764 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:07.840421 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea7582-2f98-4ca8-9a95-5590334fa764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:07.900945 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:07.910003 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-951a8932-4b1a-4948-afda-5ea906c1e15d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e560966272c74aa999a0b90eb2ab2d08'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:07.912770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-92ea7582-2f98-4ca8-9a95-5590334fa764 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:07.914609 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-92ea7582-2f98-4ca8-9a95-5590334fa764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:07.931599 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 874/1726] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:07.938683 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea7582-2f98-4ca8-9a95-5590334fa764 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:07.944513 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-951a8932-4b1a-4948-afda-5ea906c1e15d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e560966272c74aa999a0b90eb2ab2d08'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:07.946267 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-951a8932-4b1a-4948-afda-5ea906c1e15d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e560966272c74aa999a0b90eb2ab2d08'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:07.960261 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-951a8932-4b1a-4948-afda-5ea906c1e15d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e560966272c74aa999a0b90eb2ab2d08'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:07.974002 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea7582-2f98-4ca8-9a95-5590334fa764 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:07.984742 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-951a8932-4b1a-4948-afda-5ea906c1e15d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e560966272c74aa999a0b90eb2ab2d08'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:07.992173 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc09d1-d872-4cfd-b72a-7ab846250b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:07.993097 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc09d1-d872-4cfd-b72a-7ab846250b12 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:07.993585 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc09d1-d872-4cfd-b72a-7ab846250b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:07.994984 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc09d1-d872-4cfd-b72a-7ab846250b12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:07.995879 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc09d1-d872-4cfd-b72a-7ab846250b12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:15:07.997173 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc09d1-d872-4cfd-b72a-7ab846250b12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:08.002836 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc09d1-d872-4cfd-b72a-7ab846250b12 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:08.010697 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 853/1727] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:07 2022] DELETE /identity/v3/users/e560966272c74aa999a0b90eb2ab2d08 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:08.043917 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 875/1728] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:15:08.048161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a8932-4b1a-4948-afda-5ea906c1e15d admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:08.050313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-951a8932-4b1a-4948-afda-5ea906c1e15d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:08.234998 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a8932-4b1a-4948-afda-5ea906c1e15d admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:08.250734 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4896bb-f331-4f70-a0c4-40e06aa1e86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:08.251398 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4896bb-f331-4f70-a0c4-40e06aa1e86c admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:08.251711 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4896bb-f331-4f70-a0c4-40e06aa1e86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:08.252256 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4896bb-f331-4f70-a0c4-40e06aa1e86c admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:08.253186 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4896bb-f331-4f70-a0c4-40e06aa1e86c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:08.255401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4896bb-f331-4f70-a0c4-40e06aa1e86c admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:08.336215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 854/1729] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:08 2022] POST /identity/v3/projects => generated 391 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:08.339368 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc09d1-d872-4cfd-b72a-7ab846250b12 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:08.354420 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc09d1-d872-4cfd-b72a-7ab846250b12 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:08.473698 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f4f0f-1f99-46d3-bc5f-1d23a9a69153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:08.475104 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f4f0f-1f99-46d3-bc5f-1d23a9a69153 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:08.475592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f4f0f-1f99-46d3-bc5f-1d23a9a69153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:08.476013 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f4f0f-1f99-46d3-bc5f-1d23a9a69153 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:08.477450 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f4f0f-1f99-46d3-bc5f-1d23a9a69153 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:08.479653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f4f0f-1f99-46d3-bc5f-1d23a9a69153 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:08.530635 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 876/1730] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:08 2022] POST /identity/v3/users => generated 296 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:08.536088 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4896bb-f331-4f70-a0c4-40e06aa1e86c admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:08.552554 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4896bb-f331-4f70-a0c4-40e06aa1e86c admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:08.562892 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111e875-f7ab-4d67-a135-5070b3de3bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:08.563560 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111e875-f7ab-4d67-a135-5070b3de3bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:08.563838 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111e875-f7ab-4d67-a135-5070b3de3bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:08.564108 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111e875-f7ab-4d67-a135-5070b3de3bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:08.564760 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111e875-f7ab-4d67-a135-5070b3de3bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:08.566374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111e875-f7ab-4d67-a135-5070b3de3bc4 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:08.593905 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 855/1731] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:08.598166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f4f0f-1f99-46d3-bc5f-1d23a9a69153 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:08.612140 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f4f0f-1f99-46d3-bc5f-1d23a9a69153 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:08.633778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d71996-d232-42f5-a89f-e1949c58d66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:08.634828 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d71996-d232-42f5-a89f-e1949c58d66f admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:08.635258 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d71996-d232-42f5-a89f-e1949c58d66f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:08.635853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d71996-d232-42f5-a89f-e1949c58d66f admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:08.636696 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d71996-d232-42f5-a89f-e1949c58d66f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:08.639473 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d71996-d232-42f5-a89f-e1949c58d66f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:08.654186 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 877/1732] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:08.658508 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111e875-f7ab-4d67-a135-5070b3de3bc4 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:08.676589 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111e875-f7ab-4d67-a135-5070b3de3bc4 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:08.691150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45de656-0170-45af-8244-e053d396a744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:08.692117 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45de656-0170-45af-8244-e053d396a744 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:08.692220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45de656-0170-45af-8244-e053d396a744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:08.692501 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45de656-0170-45af-8244-e053d396a744 admin admin] PATH_INFO: `/v3/projects/ffa7d7ff0356438ead09a3ff93cdee3f/users/00a875107736428e8509a9c9cc3f03ce/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:08.745507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45de656-0170-45af-8244-e053d396a744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffa7d7ff0356438ead09a3ff93cdee3f, user_id=00a875107736428e8509a9c9cc3f03ce, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:08.748747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45de656-0170-45af-8244-e053d396a744 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:08.796698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 856/1733] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:08 2022] PUT /identity/v3/projects/ffa7d7ff0356438ead09a3ff93cdee3f/users/00a875107736428e8509a9c9cc3f03ce/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:08.798576 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cce88-3e69-4482-a58f-c336ba612dc5 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:08.799524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cce88-3e69-4482-a58f-c336ba612dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:08.800563 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cce88-3e69-4482-a58f-c336ba612dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:08.868769 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-3f0cce88-3e69-4482-a58f-c336ba612dc5 None None] MFA Rules not processed for user `00a875107736428e8509a9c9cc3f03ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:08.870431 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3f0cce88-3e69-4482-a58f-c336ba612dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:09.058995 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 878/1734] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:09.063108 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45de656-0170-45af-8244-e053d396a744 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:09.311812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45de656-0170-45af-8244-e053d396a744 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:09.333140 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e58ef-1249-41e2-87e1-5dd8e32fb857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:09.333779 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e58ef-1249-41e2-87e1-5dd8e32fb857 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:09.334057 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e58ef-1249-41e2-87e1-5dd8e32fb857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:09.334328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e58ef-1249-41e2-87e1-5dd8e32fb857 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:09.334986 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e58ef-1249-41e2-87e1-5dd8e32fb857 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:09.349004 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e58ef-1249-41e2-87e1-5dd8e32fb857 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:09.415054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:09.441165 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 857/1735] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:09 2022] POST /identity/v3/projects => generated 393 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:09.441569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cce88-3e69-4482-a58f-c336ba612dc5 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:09.461431 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cce88-3e69-4482-a58f-c336ba612dc5 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:09.546256 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:09.622525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afc452-9702-4490-86b3-b245fde0c209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:09.623399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afc452-9702-4490-86b3-b245fde0c209 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:09.623979 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afc452-9702-4490-86b3-b245fde0c209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:09.624245 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afc452-9702-4490-86b3-b245fde0c209 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:09.625170 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afc452-9702-4490-86b3-b245fde0c209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:09.627785 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afc452-9702-4490-86b3-b245fde0c209 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:09.680742 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 879/1736] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:09 2022] POST /identity/v3/users => generated 303 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:15:09.684625 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e58ef-1249-41e2-87e1-5dd8e32fb857 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:09.706812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e58ef-1249-41e2-87e1-5dd8e32fb857 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:09.714674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342e069-656a-42c8-adb3-14fb1e4eba5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:09.715913 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342e069-656a-42c8-adb3-14fb1e4eba5b admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:09.716195 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342e069-656a-42c8-adb3-14fb1e4eba5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:09.716470 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342e069-656a-42c8-adb3-14fb1e4eba5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:09.717276 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342e069-656a-42c8-adb3-14fb1e4eba5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:09.718745 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342e069-656a-42c8-adb3-14fb1e4eba5b admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:09.772724 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 858/1737] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:09.774659 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afc452-9702-4490-86b3-b245fde0c209 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:09.807991 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afc452-9702-4490-86b3-b245fde0c209 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:09.822582 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfba68-d220-4d2f-b68a-e16ac3102c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:09.823113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfba68-d220-4d2f-b68a-e16ac3102c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:09.823388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfba68-d220-4d2f-b68a-e16ac3102c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:09.827540 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfba68-d220-4d2f-b68a-e16ac3102c5f admin admin] PATH_INFO: `/v3/projects/f2c687518a05486d9c4e7e57878a0f75/users/5257cc318f3d4b98abbe9f79ed4ab55f/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:09.910238 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dfba68-d220-4d2f-b68a-e16ac3102c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2c687518a05486d9c4e7e57878a0f75, user_id=5257cc318f3d4b98abbe9f79ed4ab55f, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:09.931394 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dfba68-d220-4d2f-b68a-e16ac3102c5f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:09.949517 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617de51-2d54-43a7-b840-038a7ce41682 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:09.950051 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617de51-2d54-43a7-b840-038a7ce41682 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:09.950521 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617de51-2d54-43a7-b840-038a7ce41682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:09.995857 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 880/1738] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:09 2022] PUT /identity/v3/projects/f2c687518a05486d9c4e7e57878a0f75/users/5257cc318f3d4b98abbe9f79ed4ab55f/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:09.999711 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfba68-d220-4d2f-b68a-e16ac3102c5f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:10.018285 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-c617de51-2d54-43a7-b840-038a7ce41682 None None] MFA Rules not processed for user `d533e3caa6ec4c7c9343a8cefd3af8d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:10.019591 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-c617de51-2d54-43a7-b840-038a7ce41682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:10.203010 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 859/1739] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:10.221259 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfba68-d220-4d2f-b68a-e16ac3102c5f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:10.237797 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bfb77-750f-439d-a9e8-55ccaabd8600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:10.238438 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bfb77-750f-439d-a9e8-55ccaabd8600 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:10.238723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bfb77-750f-439d-a9e8-55ccaabd8600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:10.239000 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bfb77-750f-439d-a9e8-55ccaabd8600 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:10.239691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bfb77-750f-439d-a9e8-55ccaabd8600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:10.241578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bfb77-750f-439d-a9e8-55ccaabd8600 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:10.281704 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 881/1740] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:10.281936 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617de51-2d54-43a7-b840-038a7ce41682 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:10.305501 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617de51-2d54-43a7-b840-038a7ce41682 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:10.329198 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899652f-6d9d-48ef-a135-7579f2796681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:10.330131 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899652f-6d9d-48ef-a135-7579f2796681 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:10.330598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899652f-6d9d-48ef-a135-7579f2796681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:10.331056 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899652f-6d9d-48ef-a135-7579f2796681 admin admin] PATH_INFO: `/v3/projects/f2c687518a05486d9c4e7e57878a0f75/users/5257cc318f3d4b98abbe9f79ed4ab55f/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:10.336918 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899652f-6d9d-48ef-a135-7579f2796681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2c687518a05486d9c4e7e57878a0f75, user_id=5257cc318f3d4b98abbe9f79ed4ab55f, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:10.343353 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899652f-6d9d-48ef-a135-7579f2796681 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:10.399072 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 860/1741] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:10 2022] PUT /identity/v3/projects/f2c687518a05486d9c4e7e57878a0f75/users/5257cc318f3d4b98abbe9f79ed4ab55f/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:10.400031 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c24ff-a297-4e56-8218-49043a384972 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:10.400340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c24ff-a297-4e56-8218-49043a384972 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:10.400618 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c24ff-a297-4e56-8218-49043a384972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:10.480353 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-810c24ff-a297-4e56-8218-49043a384972 None None] MFA Rules not processed for user `5257cc318f3d4b98abbe9f79ed4ab55f`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:10.482143 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-810c24ff-a297-4e56-8218-49043a384972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:10.651036 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899652f-6d9d-48ef-a135-7579f2796681 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:10.652049 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 882/1742] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:10 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:10.655939 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-1899652f-6d9d-48ef-a135-7579f2796681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:10.665095 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c24ff-a297-4e56-8218-49043a384972 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:10.669551 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-810c24ff-a297-4e56-8218-49043a384972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:10.736482 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:10.869765 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899652f-6d9d-48ef-a135-7579f2796681 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:10.881518 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727139f-9f5e-4b10-94fa-335fa95e7a87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:10.882654 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727139f-9f5e-4b10-94fa-335fa95e7a87 service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:10.883632 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727139f-9f5e-4b10-94fa-335fa95e7a87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:10.884260 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727139f-9f5e-4b10-94fa-335fa95e7a87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:10.902981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c24ff-a297-4e56-8218-49043a384972 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:10.908078 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c727139f-9f5e-4b10-94fa-335fa95e7a87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:10.909720 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c727139f-9f5e-4b10-94fa-335fa95e7a87 service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:10.924544 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea50db-aba0-499c-88e5-51f922413d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:10.925255 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea50db-aba0-499c-88e5-51f922413d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:10.925636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea50db-aba0-499c-88e5-51f922413d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:10.926014 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea50db-aba0-499c-88e5-51f922413d73 admin admin] PATH_INFO: `/v3/projects/58ea5cb422bc438c851714c27a9bebc7` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:10.928796 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea50db-aba0-499c-88e5-51f922413d73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58ea5cb422bc438c851714c27a9bebc7)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:10.945013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 861/1743] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:10 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:10.945870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea50db-aba0-499c-88e5-51f922413d73 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:11.083418 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-48ea50db-aba0-499c-88e5-51f922413d73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58ea5cb422bc438c851714c27a9bebc7', 'request_id': 'req-48ea50db-aba0-499c-88e5-51f922413d73'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:11.094600 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-48ea50db-aba0-499c-88e5-51f922413d73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58ea5cb422bc438c851714c27a9bebc7', 'request_id': 'req-48ea50db-aba0-499c-88e5-51f922413d73'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:11.107937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-48ea50db-aba0-499c-88e5-51f922413d73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58ea5cb422bc438c851714c27a9bebc7', 'request_id': 'req-48ea50db-aba0-499c-88e5-51f922413d73'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:11.128238 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727139f-9f5e-4b10-94fa-335fa95e7a87 service cinder] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:11.132290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-48ea50db-aba0-499c-88e5-51f922413d73 admin admin] The token cache is being invalidate because project 58ea5cb422bc438c851714c27a9bebc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:11.132870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-48ea50db-aba0-499c-88e5-51f922413d73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:11.134563 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-48ea50db-aba0-499c-88e5-51f922413d73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:11.137156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 883/1744] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:10 2022] DELETE /identity/v3/projects/58ea5cb422bc438c851714c27a9bebc7 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:11.142828 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45782ec7-7ec9-4e67-9b37-9703aa42ba24 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:11.143550 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727139f-9f5e-4b10-94fa-335fa95e7a87 service cinder] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:11.143792 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45782ec7-7ec9-4e67-9b37-9703aa42ba24 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:11.144273 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45782ec7-7ec9-4e67-9b37-9703aa42ba24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:11.207954 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-45782ec7-7ec9-4e67-9b37-9703aa42ba24 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:11.209520 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-45782ec7-7ec9-4e67-9b37-9703aa42ba24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:11.274350 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f8649-586e-48cc-8e66-ff1dc54f58ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:11.278863 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f8649-586e-48cc-8e66-ff1dc54f58ed service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:11.279210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f8649-586e-48cc-8e66-ff1dc54f58ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:11.279552 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f8649-586e-48cc-8e66-ff1dc54f58ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:11.289072 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b28f8649-586e-48cc-8e66-ff1dc54f58ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:11.400199 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 884/1745] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:15:11.401982 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702b2a1-7569-4779-9183-831d6018125e None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:11.426146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702b2a1-7569-4779-9183-831d6018125e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:11.427127 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:11.430507 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702b2a1-7569-4779-9183-831d6018125e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:11.505364 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b702b2a1-7569-4779-9183-831d6018125e None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:11.506737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b702b2a1-7569-4779-9183-831d6018125e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:11.520730 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 885/1746] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:11.538356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702b2a1-7569-4779-9183-831d6018125e None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:11.546790 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f8649-586e-48cc-8e66-ff1dc54f58ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:11.555247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f8649-586e-48cc-8e66-ff1dc54f58ed service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:11.559541 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702b2a1-7569-4779-9183-831d6018125e None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:11.567160 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc1f6a-f809-4771-933c-c2baf7a8647c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:11.568248 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc1f6a-f809-4771-933c-c2baf7a8647c admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:11.568778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc1f6a-f809-4771-933c-c2baf7a8647c admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:11.569265 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc1f6a-f809-4771-933c-c2baf7a8647c admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:11.570204 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc1f6a-f809-4771-933c-c2baf7a8647c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:15:11.570785 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc1f6a-f809-4771-933c-c2baf7a8647c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:11.573473 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc1f6a-f809-4771-933c-c2baf7a8647c admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:11.592683 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 886/1747] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:15:11.593797 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc1f6a-f809-4771-933c-c2baf7a8647c admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:11.609714 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc1f6a-f809-4771-933c-c2baf7a8647c admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:11.615117 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c9969-a736-458d-8283-2e95e34768a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:11.616185 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c9969-a736-458d-8283-2e95e34768a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:11.616622 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c9969-a736-458d-8283-2e95e34768a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:11.616998 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c9969-a736-458d-8283-2e95e34768a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:11.617826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c9969-a736-458d-8283-2e95e34768a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:11.621410 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c9969-a736-458d-8283-2e95e34768a1 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:11.623105 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 862/1748] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:11 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:11.625505 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0625c62-d43f-44f1-b146-5807717502f8 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:11.629489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0625c62-d43f-44f1-b146-5807717502f8 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:11.630627 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0625c62-d43f-44f1-b146-5807717502f8 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:11.643961 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 863/1749] 10.222.0.16 () {54 vars in 912 bytes} [Wed Sep 28 12:15:11 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:15:11.654323 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68aa257-f0ab-4cd2-a92f-9f7c0db89493 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:11.655241 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68aa257-f0ab-4cd2-a92f-9f7c0db89493 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:11.655950 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68aa257-f0ab-4cd2-a92f-9f7c0db89493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:11.677369 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 887/1750] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:11 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:11.690558 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c9969-a736-458d-8283-2e95e34768a1 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:11.707703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:11.711468 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-f68aa257-f0ab-4cd2-a92f-9f7c0db89493 None None] MFA Rules not processed for user `ca51ff621664452db7dd991714462e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:11.719468 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-f68aa257-f0ab-4cd2-a92f-9f7c0db89493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:11.877777 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 864/1751] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 28 12:15:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:11.888343 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68aa257-f0ab-4cd2-a92f-9f7c0db89493 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:11.893719 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-f68aa257-f0ab-4cd2-a92f-9f7c0db89493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:11.917060 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68aa257-f0ab-4cd2-a92f-9f7c0db89493 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:11.920254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c9969-a736-458d-8283-2e95e34768a1 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:11.928085 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0a8d8-9127-424b-bf2a-788c23582b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:11.929030 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0a8d8-9127-424b-bf2a-788c23582b91 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:11.929268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0a8d8-9127-424b-bf2a-788c23582b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:11.929551 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0a8d8-9127-424b-bf2a-788c23582b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:11.929914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc5e85-500b-4cd0-9d16-c599996b3319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:11.930967 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc5e85-500b-4cd0-9d16-c599996b3319 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:11.932977 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc5e85-500b-4cd0-9d16-c599996b3319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:11.933449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc5e85-500b-4cd0-9d16-c599996b3319 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:11.936019 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc5e85-500b-4cd0-9d16-c599996b3319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:11.939020 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc5e85-500b-4cd0-9d16-c599996b3319 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:11.957770 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0a8d8-9127-424b-bf2a-788c23582b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:11.966937 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0a8d8-9127-424b-bf2a-788c23582b91 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:11.991606 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 865/1752] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:11.992988 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0a8d8-9127-424b-bf2a-788c23582b91 service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:11.994434 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-6ee0a8d8-9127-424b-bf2a-788c23582b91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:12.007755 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 888/1753] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:11 2022] POST /identity/v3/users => generated 293 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:12.021616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc5e85-500b-4cd0-9d16-c599996b3319 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:12.045945 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc5e85-500b-4cd0-9d16-c599996b3319 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:12.053490 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93a0e8-01bc-42eb-8fb9-a11bc977a7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:12.054004 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0a8d8-9127-424b-bf2a-788c23582b91 service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:12.057254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93a0e8-01bc-42eb-8fb9-a11bc977a7af admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:12.057926 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93a0e8-01bc-42eb-8fb9-a11bc977a7af admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:12.060240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93a0e8-01bc-42eb-8fb9-a11bc977a7af admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:12.061503 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93a0e8-01bc-42eb-8fb9-a11bc977a7af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:12.063915 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93a0e8-01bc-42eb-8fb9-a11bc977a7af admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:12.068504 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f58b9-fc4f-4858-ba5d-2fdb577971bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:12.075776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f58b9-fc4f-4858-ba5d-2fdb577971bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:12.076083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f58b9-fc4f-4858-ba5d-2fdb577971bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:12.076368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f58b9-fc4f-4858-ba5d-2fdb577971bb admin admin] PATH_INFO: `/v3/users/564d647b44344f909e237ff1210fa2a0` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:12.080072 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f58b9-fc4f-4858-ba5d-2fdb577971bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=564d647b44344f909e237ff1210fa2a0)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:12.082050 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f58b9-fc4f-4858-ba5d-2fdb577971bb admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:12.103540 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 889/1754] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:12.106496 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93a0e8-01bc-42eb-8fb9-a11bc977a7af admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:12.140990 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93a0e8-01bc-42eb-8fb9-a11bc977a7af admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:12.153892 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691fdfc-f350-4e6e-b3a6-d6f2d3c8a281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:12.154757 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691fdfc-f350-4e6e-b3a6-d6f2d3c8a281 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:12.155131 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691fdfc-f350-4e6e-b3a6-d6f2d3c8a281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:12.155694 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691fdfc-f350-4e6e-b3a6-d6f2d3c8a281 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:12.156852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691fdfc-f350-4e6e-b3a6-d6f2d3c8a281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:12.161685 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691fdfc-f350-4e6e-b3a6-d6f2d3c8a281 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:12.209559 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 890/1755] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:12.215671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691fdfc-f350-4e6e-b3a6-d6f2d3c8a281 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:12.249153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691fdfc-f350-4e6e-b3a6-d6f2d3c8a281 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:12.264479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b749c2b-d105-48d8-9c1c-0a537b4c7b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:12.265760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b749c2b-d105-48d8-9c1c-0a537b4c7b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:12.266133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b749c2b-d105-48d8-9c1c-0a537b4c7b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:12.266521 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b749c2b-d105-48d8-9c1c-0a537b4c7b20 admin admin] PATH_INFO: `/v3/projects/f5545a6266bf4f9281084acb47da84fe/users/8c73047d05ca4ff9b3a2a64f99e3734e/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:12.280535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4e0f58b9-fc4f-4858-ba5d-2fdb577971bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '564d647b44344f909e237ff1210fa2a0'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:12.316689 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b749c2b-d105-48d8-9c1c-0a537b4c7b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5545a6266bf4f9281084acb47da84fe, user_id=8c73047d05ca4ff9b3a2a64f99e3734e, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:12.326070 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b749c2b-d105-48d8-9c1c-0a537b4c7b20 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:12.341697 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4e0f58b9-fc4f-4858-ba5d-2fdb577971bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '564d647b44344f909e237ff1210fa2a0'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:12.342518 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4e0f58b9-fc4f-4858-ba5d-2fdb577971bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '564d647b44344f909e237ff1210fa2a0'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:12.352776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 891/1756] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:12 2022] PUT /identity/v3/projects/f5545a6266bf4f9281084acb47da84fe/users/8c73047d05ca4ff9b3a2a64f99e3734e/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:12.372171 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48767d5e-2d6c-45cc-a53b-a4bd2ebc76cf None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:12.372605 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48767d5e-2d6c-45cc-a53b-a4bd2ebc76cf None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:12.373351 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48767d5e-2d6c-45cc-a53b-a4bd2ebc76cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:12.378400 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4e0f58b9-fc4f-4858-ba5d-2fdb577971bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '564d647b44344f909e237ff1210fa2a0'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:12.407003 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4e0f58b9-fc4f-4858-ba5d-2fdb577971bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '564d647b44344f909e237ff1210fa2a0'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:12.445721 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 866/1757] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:11 2022] DELETE /identity/v3/users/564d647b44344f909e237ff1210fa2a0 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:12.458349 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a96e3-5b43-4c93-9a47-f9fb42a3c1e6 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:12.468057 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a96e3-5b43-4c93-9a47-f9fb42a3c1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:12.468351 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a96e3-5b43-4c93-9a47-f9fb42a3c1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:12.512796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-a17a96e3-5b43-4c93-9a47-f9fb42a3c1e6 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:12.523140 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-48767d5e-2d6c-45cc-a53b-a4bd2ebc76cf None None] MFA Rules not processed for user `8c73047d05ca4ff9b3a2a64f99e3734e`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:12.523336 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-a17a96e3-5b43-4c93-9a47-f9fb42a3c1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:12.524246 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-48767d5e-2d6c-45cc-a53b-a4bd2ebc76cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:12.685957 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 892/1758] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:12.687988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48767d5e-2d6c-45cc-a53b-a4bd2ebc76cf None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:12.690723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-48767d5e-2d6c-45cc-a53b-a4bd2ebc76cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:12.709917 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:12.763543 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 867/1759] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:12.773677 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a96e3-5b43-4c93-9a47-f9fb42a3c1e6 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:12.775487 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-a17a96e3-5b43-4c93-9a47-f9fb42a3c1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:12.832253 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:12.875671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48767d5e-2d6c-45cc-a53b-a4bd2ebc76cf None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:12.882325 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307776f9-d2a5-4958-8f51-d79e222bba41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:12.883395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307776f9-d2a5-4958-8f51-d79e222bba41 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:12.883928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307776f9-d2a5-4958-8f51-d79e222bba41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:12.884309 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307776f9-d2a5-4958-8f51-d79e222bba41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:12.885065 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307776f9-d2a5-4958-8f51-d79e222bba41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:12.888064 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307776f9-d2a5-4958-8f51-d79e222bba41 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:12.933893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 893/1760] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:12 2022] POST /identity/v3/projects => generated 387 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:12.939218 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a96e3-5b43-4c93-9a47-f9fb42a3c1e6 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:12.943329 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307776f9-d2a5-4958-8f51-d79e222bba41 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:13.048474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97d487-ad30-4f56-8d6e-0ea331ea3110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:13.049823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97d487-ad30-4f56-8d6e-0ea331ea3110 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:13.050285 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97d487-ad30-4f56-8d6e-0ea331ea3110 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:13.050696 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97d487-ad30-4f56-8d6e-0ea331ea3110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:13.106930 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307776f9-d2a5-4958-8f51-d79e222bba41 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:13.130836 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aeb051-c427-45b3-b7b2-5707717ae50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:13.131698 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aeb051-c427-45b3-b7b2-5707717ae50a admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:13.132191 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aeb051-c427-45b3-b7b2-5707717ae50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:13.132920 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aeb051-c427-45b3-b7b2-5707717ae50a admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:13.134035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aeb051-c427-45b3-b7b2-5707717ae50a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:13.137809 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aeb051-c427-45b3-b7b2-5707717ae50a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:13.177577 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97d487-ad30-4f56-8d6e-0ea331ea3110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:13.179736 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97d487-ad30-4f56-8d6e-0ea331ea3110 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:13.193801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 894/1761] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:12 2022] POST /identity/v3/users => generated 294 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:13.194732 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aeb051-c427-45b3-b7b2-5707717ae50a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:13.196098 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 868/1762] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:15:13.197842 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97d487-ad30-4f56-8d6e-0ea331ea3110 service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:13.199903 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-42aeb051-c427-45b3-b7b2-5707717ae50a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:13.225567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97d487-ad30-4f56-8d6e-0ea331ea3110 service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:13.240091 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafba99-c243-47f0-9682-e3f5190beda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:13.240713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafba99-c243-47f0-9682-e3f5190beda9 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:13.241338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafba99-c243-47f0-9682-e3f5190beda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:13.241738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafba99-c243-47f0-9682-e3f5190beda9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:13.242546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafba99-c243-47f0-9682-e3f5190beda9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:13.244900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafba99-c243-47f0-9682-e3f5190beda9 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:13.277113 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 869/1763] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:13.281418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafba99-c243-47f0-9682-e3f5190beda9 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:13.293388 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafba99-c243-47f0-9682-e3f5190beda9 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:13.299594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79800a3f-1d0d-4a8b-bbc7-eb3b54f0b985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:13.300690 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79800a3f-1d0d-4a8b-bbc7-eb3b54f0b985 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:13.300690 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79800a3f-1d0d-4a8b-bbc7-eb3b54f0b985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:13.302065 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79800a3f-1d0d-4a8b-bbc7-eb3b54f0b985 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:13.302065 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79800a3f-1d0d-4a8b-bbc7-eb3b54f0b985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:13.303924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79800a3f-1d0d-4a8b-bbc7-eb3b54f0b985 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:13.321062 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 870/1764] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:15:13.322118 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79800a3f-1d0d-4a8b-bbc7-eb3b54f0b985 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:13.342435 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79800a3f-1d0d-4a8b-bbc7-eb3b54f0b985 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:13.349105 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac1472-bc57-454e-84d5-e2063d4234ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:13.349901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac1472-bc57-454e-84d5-e2063d4234ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:13.350281 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac1472-bc57-454e-84d5-e2063d4234ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:13.350636 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac1472-bc57-454e-84d5-e2063d4234ff admin admin] PATH_INFO: `/v3/projects/d7d8d3ed5dcd42518762e6e001f51579/users/3987ad4588f54314a27999c8e889b695/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:13.372424 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac1472-bc57-454e-84d5-e2063d4234ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7d8d3ed5dcd42518762e6e001f51579, user_id=3987ad4588f54314a27999c8e889b695, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:13.375747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac1472-bc57-454e-84d5-e2063d4234ff admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:13.414916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 871/1765] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:13 2022] PUT /identity/v3/projects/d7d8d3ed5dcd42518762e6e001f51579/users/3987ad4588f54314a27999c8e889b695/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:13.417005 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d980e6f-fd44-4b34-8da0-9e2979b3a7cb None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:13.417395 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d980e6f-fd44-4b34-8da0-9e2979b3a7cb None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:13.417735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d980e6f-fd44-4b34-8da0-9e2979b3a7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:13.427818 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:13.430721 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aeb051-c427-45b3-b7b2-5707717ae50a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:13.470180 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-1d980e6f-fd44-4b34-8da0-9e2979b3a7cb None None] MFA Rules not processed for user `3987ad4588f54314a27999c8e889b695`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:13.471769 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-1d980e6f-fd44-4b34-8da0-9e2979b3a7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:13.592549 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:13.641151 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee438aa-c4eb-495c-805b-989add05d868 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09e495edc6fd47c892679bb908c3f5bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:13.642374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee438aa-c4eb-495c-805b-989add05d868 service placement] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:13.642675 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee438aa-c4eb-495c-805b-989add05d868 service placement] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:13.642950 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee438aa-c4eb-495c-805b-989add05d868 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:13.644837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0ee438aa-c4eb-495c-805b-989add05d868 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:13.665542 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 872/1766] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:13.683251 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee438aa-c4eb-495c-805b-989add05d868 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:13.685410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d980e6f-fd44-4b34-8da0-9e2979b3a7cb None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:13.697122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee438aa-c4eb-495c-805b-989add05d868 service placement] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:13.726496 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 895/1767] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:13.908265 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d980e6f-fd44-4b34-8da0-9e2979b3a7cb None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:13.915702 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16e950-a815-4f5c-9cb7-d445cd075d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:13.916339 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16e950-a815-4f5c-9cb7-d445cd075d59 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:13.916675 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16e950-a815-4f5c-9cb7-d445cd075d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:13.917763 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16e950-a815-4f5c-9cb7-d445cd075d59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:13.918757 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16e950-a815-4f5c-9cb7-d445cd075d59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:13.920869 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16e950-a815-4f5c-9cb7-d445cd075d59 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:13.951003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee438aa-c4eb-495c-805b-989add05d868 service placement] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:13.952592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0ee438aa-c4eb-495c-805b-989add05d868 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:13.985132 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee438aa-c4eb-495c-805b-989add05d868 service placement] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:13.999896 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa0d1f-4c5f-4950-8131-a42a7eb75a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:14.000932 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa0d1f-4c5f-4950-8131-a42a7eb75a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:14.001442 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa0d1f-4c5f-4950-8131-a42a7eb75a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:14.002158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa0d1f-4c5f-4950-8131-a42a7eb75a56 admin admin] PATH_INFO: `/v3/projects/f5342a4200e444b18110f52657431714` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:14.006089 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa0d1f-4c5f-4950-8131-a42a7eb75a56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5342a4200e444b18110f52657431714)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:14.009056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa0d1f-4c5f-4950-8131-a42a7eb75a56 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:14.010829 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 873/1768] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:13 2022] POST /identity/v3/projects => generated 383 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:14.013169 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16e950-a815-4f5c-9cb7-d445cd075d59 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:14.120458 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dafa0d1f-4c5f-4950-8131-a42a7eb75a56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5342a4200e444b18110f52657431714', 'request_id': 'req-dafa0d1f-4c5f-4950-8131-a42a7eb75a56'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:14.157528 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dafa0d1f-4c5f-4950-8131-a42a7eb75a56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5342a4200e444b18110f52657431714', 'request_id': 'req-dafa0d1f-4c5f-4950-8131-a42a7eb75a56'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:14.170761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dafa0d1f-4c5f-4950-8131-a42a7eb75a56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5342a4200e444b18110f52657431714', 'request_id': 'req-dafa0d1f-4c5f-4950-8131-a42a7eb75a56'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:14.201721 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dafa0d1f-4c5f-4950-8131-a42a7eb75a56 admin admin] The token cache is being invalidate because project f5342a4200e444b18110f52657431714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:14.202208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dafa0d1f-4c5f-4950-8131-a42a7eb75a56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:14.204063 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dafa0d1f-4c5f-4950-8131-a42a7eb75a56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:14.206703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 896/1769] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:13 2022] DELETE /identity/v3/projects/f5342a4200e444b18110f52657431714 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:14.210346 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa08301-7795-4d1d-80c9-ac56fa8aad9a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:14.210816 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa08301-7795-4d1d-80c9-ac56fa8aad9a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:14.211234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa08301-7795-4d1d-80c9-ac56fa8aad9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:14.218369 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16e950-a815-4f5c-9cb7-d445cd075d59 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:14.263919 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-ffa08301-7795-4d1d-80c9-ac56fa8aad9a None None] MFA Rules not processed for user `90794e56c3f9486fbace8c39018233b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:14.266482 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ffa08301-7795-4d1d-80c9-ac56fa8aad9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:14.309364 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:14.429640 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 897/1770] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:14.429640 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa08301-7795-4d1d-80c9-ac56fa8aad9a None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:14.433251 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ffa08301-7795-4d1d-80c9-ac56fa8aad9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:14.467217 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a36921-c120-44d7-9413-4fe99ca93e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:14.467911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a36921-c120-44d7-9413-4fe99ca93e50 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:14.468199 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a36921-c120-44d7-9413-4fe99ca93e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:14.468473 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a36921-c120-44d7-9413-4fe99ca93e50 admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:14.473368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a36921-c120-44d7-9413-4fe99ca93e50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:14.480305 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a36921-c120-44d7-9413-4fe99ca93e50 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:14.494724 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa08301-7795-4d1d-80c9-ac56fa8aad9a None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:14.501449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce67d4-f56a-45e9-b5e6-7df11ab22a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:14.502463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce67d4-f56a-45e9-b5e6-7df11ab22a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:14.502853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce67d4-f56a-45e9-b5e6-7df11ab22a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:14.503190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce67d4-f56a-45e9-b5e6-7df11ab22a3d admin admin] PATH_INFO: `/v3/users/f28f0b2053654edabe5d78f487c49068` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:14.505275 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce67d4-f56a-45e9-b5e6-7df11ab22a3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f28f0b2053654edabe5d78f487c49068)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:14.509971 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce67d4-f56a-45e9-b5e6-7df11ab22a3d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:14.526409 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 874/1771] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:14 2022] POST /identity/v3/users => generated 298 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:14.527982 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e96dd-95a8-4478-bf9e-efc866c2b016 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:14.528373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e96dd-95a8-4478-bf9e-efc866c2b016 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:14.528744 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e96dd-95a8-4478-bf9e-efc866c2b016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:14.603530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-249e96dd-95a8-4478-bf9e-efc866c2b016 None None] MFA Rules not processed for user `90794e56c3f9486fbace8c39018233b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:14.604788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-249e96dd-95a8-4478-bf9e-efc866c2b016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:14.617525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a6ce67d4-f56a-45e9-b5e6-7df11ab22a3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f28f0b2053654edabe5d78f487c49068'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:14.618439 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a6ce67d4-f56a-45e9-b5e6-7df11ab22a3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f28f0b2053654edabe5d78f487c49068'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:14.624532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:14.642695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a6ce67d4-f56a-45e9-b5e6-7df11ab22a3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f28f0b2053654edabe5d78f487c49068'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:14.652267 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 875/1772] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:14.655943 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e96dd-95a8-4478-bf9e-efc866c2b016 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:14.657764 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a6ce67d4-f56a-45e9-b5e6-7df11ab22a3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f28f0b2053654edabe5d78f487c49068'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:14.658199 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-249e96dd-95a8-4478-bf9e-efc866c2b016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:14.658914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a6ce67d4-f56a-45e9-b5e6-7df11ab22a3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f28f0b2053654edabe5d78f487c49068'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:14.688630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e96dd-95a8-4478-bf9e-efc866c2b016 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:14.696440 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cf25a-a2a9-4c21-b40b-3533f92295c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:14.697214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cf25a-a2a9-4c21-b40b-3533f92295c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:14.697597 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cf25a-a2a9-4c21-b40b-3533f92295c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:14.697969 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cf25a-a2a9-4c21-b40b-3533f92295c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:14.705301 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 898/1773] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:14 2022] DELETE /identity/v3/users/f28f0b2053654edabe5d78f487c49068 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:14.706372 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce67d4-f56a-45e9-b5e6-7df11ab22a3d admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:14.707896 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a6ce67d4-f56a-45e9-b5e6-7df11ab22a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:14.717112 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1cf25a-a2a9-4c21-b40b-3533f92295c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:14.727635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1cf25a-a2a9-4c21-b40b-3533f92295c1 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:14.750722 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 876/1774] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:14.754866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cf25a-a2a9-4c21-b40b-3533f92295c1 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:14.772966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cf25a-a2a9-4c21-b40b-3533f92295c1 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:14.936267 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce5913-d27f-48da-a80a-191f7463a5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:14.937081 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce5913-d27f-48da-a80a-191f7463a5b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:14.937271 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce5913-d27f-48da-a80a-191f7463a5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:14.937652 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce5913-d27f-48da-a80a-191f7463a5b8 admin admin] PATH_INFO: `/v3/projects/13d2510a4cb947c4b0f30c0a85627323/users/64823aafdeb84361996819a76320404a/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:14.996170 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce5913-d27f-48da-a80a-191f7463a5b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d2510a4cb947c4b0f30c0a85627323, user_id=64823aafdeb84361996819a76320404a, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:15.005511 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce5913-d27f-48da-a80a-191f7463a5b8 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:15.013419 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce67d4-f56a-45e9-b5e6-7df11ab22a3d admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:15.030652 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cf5f5-8754-4fe3-8f44-e2ca7a3d4f3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:15.031647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cf5f5-8754-4fe3-8f44-e2ca7a3d4f3a service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:15.032151 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cf5f5-8754-4fe3-8f44-e2ca7a3d4f3a service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:15.032665 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cf5f5-8754-4fe3-8f44-e2ca7a3d4f3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:15.037207 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-fa8cf5f5-8754-4fe3-8f44-e2ca7a3d4f3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:15.067008 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 877/1775] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:14 2022] PUT /identity/v3/projects/13d2510a4cb947c4b0f30c0a85627323/users/64823aafdeb84361996819a76320404a/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:15.071087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce5913-d27f-48da-a80a-191f7463a5b8 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:15.205198 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8cf5f5-8754-4fe3-8f44-e2ca7a3d4f3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:15.207882 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8cf5f5-8754-4fe3-8f44-e2ca7a3d4f3a service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:15.228276 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 899/1776] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:14 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:15.257568 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce5913-d27f-48da-a80a-191f7463a5b8 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:15.266146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce192d6d-57dc-4fed-b980-55874a9be109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:15.269845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce192d6d-57dc-4fed-b980-55874a9be109 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:15.269845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce192d6d-57dc-4fed-b980-55874a9be109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:15.270056 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce192d6d-57dc-4fed-b980-55874a9be109 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:15.272203 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce192d6d-57dc-4fed-b980-55874a9be109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:15.277824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce192d6d-57dc-4fed-b980-55874a9be109 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:15.296618 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 878/1777] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:15.301000 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cf5f5-8754-4fe3-8f44-e2ca7a3d4f3a service nova] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:15.317748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cf5f5-8754-4fe3-8f44-e2ca7a3d4f3a service nova] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:15.325136 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac3db4-541c-4c99-a3af-6cedb7c142fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:15.325918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac3db4-541c-4c99-a3af-6cedb7c142fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:15.326264 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac3db4-541c-4c99-a3af-6cedb7c142fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:15.326610 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac3db4-541c-4c99-a3af-6cedb7c142fc admin admin] PATH_INFO: `/v3/projects/13d2510a4cb947c4b0f30c0a85627323/users/64823aafdeb84361996819a76320404a/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:15.330068 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac3db4-541c-4c99-a3af-6cedb7c142fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d2510a4cb947c4b0f30c0a85627323, user_id=64823aafdeb84361996819a76320404a, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:15.332967 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac3db4-541c-4c99-a3af-6cedb7c142fc admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:15.369507 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 900/1778] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:15 2022] PUT /identity/v3/projects/13d2510a4cb947c4b0f30c0a85627323/users/64823aafdeb84361996819a76320404a/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:15.373073 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dc924-75df-4b89-83f5-7c87c6eaf3c9 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:15.373571 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dc924-75df-4b89-83f5-7c87c6eaf3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:15.373672 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dc924-75df-4b89-83f5-7c87c6eaf3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:15.391056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60764f94-a75b-4db4-b8c2-df378c949154 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:15.391336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60764f94-a75b-4db4-b8c2-df378c949154 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:15.391657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60764f94-a75b-4db4-b8c2-df378c949154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:15.505676 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-209dc924-75df-4b89-83f5-7c87c6eaf3c9 None None] MFA Rules not processed for user `64823aafdeb84361996819a76320404a`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:15.507984 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-209dc924-75df-4b89-83f5-7c87c6eaf3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:15.510557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-60764f94-a75b-4db4-b8c2-df378c949154 None None] MFA Rules not processed for user `a1f7c9ea93684f498e0b223d91382a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:15.513554 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-60764f94-a75b-4db4-b8c2-df378c949154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:15.524790 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:15.613831 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:15.685969 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 879/1779] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:15.687836 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 901/1780] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:15.689399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a286d-91fb-4e85-87b8-d3cf549b5d94 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:15.689606 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a286d-91fb-4e85-87b8-d3cf549b5d94 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:15.689849 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a286d-91fb-4e85-87b8-d3cf549b5d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:15.692552 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9898c-6e55-429a-be85-db956a0dbfe0 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:15.692917 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9898c-6e55-429a-be85-db956a0dbfe0 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:15.693198 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9898c-6e55-429a-be85-db956a0dbfe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:15.732345 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-299a286d-91fb-4e85-87b8-d3cf549b5d94 None None] MFA Rules not processed for user `a1f7c9ea93684f498e0b223d91382a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:15.735337 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-42b9898c-6e55-429a-be85-db956a0dbfe0 None None] MFA Rules not processed for user `bb71e0c02b4647b28ed6a6194d270d35`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:15.746971 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-299a286d-91fb-4e85-87b8-d3cf549b5d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:15.747325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-42b9898c-6e55-429a-be85-db956a0dbfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:15.790619 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 902/1781] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:15.808325 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a286d-91fb-4e85-87b8-d3cf549b5d94 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:15.815565 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-299a286d-91fb-4e85-87b8-d3cf549b5d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:15.958050 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 880/1782] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:15.958050 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9898c-6e55-429a-be85-db956a0dbfe0 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:15.962189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-42b9898c-6e55-429a-be85-db956a0dbfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:15.989566 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a286d-91fb-4e85-87b8-d3cf549b5d94 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:16.008241 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e657313-5b79-4c39-bdec-f9c3be207ad3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:16.009024 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e657313-5b79-4c39-bdec-f9c3be207ad3 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:16.009405 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e657313-5b79-4c39-bdec-f9c3be207ad3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:16.010268 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e657313-5b79-4c39-bdec-f9c3be207ad3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:16.034928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e657313-5b79-4c39-bdec-f9c3be207ad3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:16.036522 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e657313-5b79-4c39-bdec-f9c3be207ad3 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:16.059251 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 903/1783] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:16.060553 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e657313-5b79-4c39-bdec-f9c3be207ad3 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:16.063256 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0e657313-5b79-4c39-bdec-f9c3be207ad3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:16.169901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9898c-6e55-429a-be85-db956a0dbfe0 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:16.182301 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff80ca0-dfd5-4bcd-a83b-b5595c9ce85f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:16.186233 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff80ca0-dfd5-4bcd-a83b-b5595c9ce85f service nova] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:16.186712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff80ca0-dfd5-4bcd-a83b-b5595c9ce85f service nova] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:16.186965 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff80ca0-dfd5-4bcd-a83b-b5595c9ce85f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:16.211983 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff80ca0-dfd5-4bcd-a83b-b5595c9ce85f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:16.214177 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff80ca0-dfd5-4bcd-a83b-b5595c9ce85f service nova] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:16.225244 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 881/1784] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:16.226813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b02581-219c-4042-8a96-6cf6900a83e7 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:16.227101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b02581-219c-4042-8a96-6cf6900a83e7 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:16.227374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b02581-219c-4042-8a96-6cf6900a83e7 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:16.231982 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 882/1785] 10.222.0.16 () {54 vars in 912 bytes} [Wed Sep 28 12:15:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:15:16.233514 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e657313-5b79-4c39-bdec-f9c3be207ad3 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:16.241372 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997affae-e80a-4e11-8293-6bb7c2de4c40 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:16.241661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997affae-e80a-4e11-8293-6bb7c2de4c40 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:16.241933 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997affae-e80a-4e11-8293-6bb7c2de4c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:16.246067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac410d7-87c9-4398-a27c-d4c4090a5b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:16.246742 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac410d7-87c9-4398-a27c-d4c4090a5b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:16.247022 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac410d7-87c9-4398-a27c-d4c4090a5b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:16.247299 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac410d7-87c9-4398-a27c-d4c4090a5b3a admin admin] PATH_INFO: `/v3/projects/73ba1e725718419aa5a58b82b6b0b4f5` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:16.254735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac410d7-87c9-4398-a27c-d4c4090a5b3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=73ba1e725718419aa5a58b82b6b0b4f5)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:16.260505 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac410d7-87c9-4398-a27c-d4c4090a5b3a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:16.302558 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-997affae-e80a-4e11-8293-6bb7c2de4c40 None None] MFA Rules not processed for user `ca51ff621664452db7dd991714462e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:16.307685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-997affae-e80a-4e11-8293-6bb7c2de4c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:16.395935 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:16.398139 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cac410d7-87c9-4398-a27c-d4c4090a5b3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73ba1e725718419aa5a58b82b6b0b4f5', 'request_id': 'req-cac410d7-87c9-4398-a27c-d4c4090a5b3a'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:16.450169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cac410d7-87c9-4398-a27c-d4c4090a5b3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73ba1e725718419aa5a58b82b6b0b4f5', 'request_id': 'req-cac410d7-87c9-4398-a27c-d4c4090a5b3a'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:16.477288 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cac410d7-87c9-4398-a27c-d4c4090a5b3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73ba1e725718419aa5a58b82b6b0b4f5', 'request_id': 'req-cac410d7-87c9-4398-a27c-d4c4090a5b3a'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:16.485928 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 883/1786] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 28 12:15:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:16.528626 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cac410d7-87c9-4398-a27c-d4c4090a5b3a admin admin] The token cache is being invalidate because project 73ba1e725718419aa5a58b82b6b0b4f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:16.528959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cac410d7-87c9-4398-a27c-d4c4090a5b3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:16.530254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cac410d7-87c9-4398-a27c-d4c4090a5b3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:16.534244 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 904/1787] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:16 2022] DELETE /identity/v3/projects/73ba1e725718419aa5a58b82b6b0b4f5 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:16.540078 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309c344-9c18-4aa1-bfaa-5dfbab6b418c None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:16.541081 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309c344-9c18-4aa1-bfaa-5dfbab6b418c None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:16.541081 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309c344-9c18-4aa1-bfaa-5dfbab6b418c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:16.612878 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-7309c344-9c18-4aa1-bfaa-5dfbab6b418c None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:16.614596 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-7309c344-9c18-4aa1-bfaa-5dfbab6b418c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:16.854100 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac410d7-87c9-4398-a27c-d4c4090a5b3a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:16.855705 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-cac410d7-87c9-4398-a27c-d4c4090a5b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:16.876196 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:16.878127 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 884/1788] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:16.882894 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1e1d0-5211-4346-8dbe-63c5ba8a7e2e None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:16.885937 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1e1d0-5211-4346-8dbe-63c5ba8a7e2e None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:16.886252 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1e1d0-5211-4346-8dbe-63c5ba8a7e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:16.942213 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-8df1e1d0-5211-4346-8dbe-63c5ba8a7e2e None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:16.943636 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-8df1e1d0-5211-4346-8dbe-63c5ba8a7e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:16.972926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 885/1789] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:16.978149 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1e1d0-5211-4346-8dbe-63c5ba8a7e2e None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:17.003248 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1e1d0-5211-4346-8dbe-63c5ba8a7e2e None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:17.020726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac410d7-87c9-4398-a27c-d4c4090a5b3a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:17.021318 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8d07b-93c0-4027-a00c-e4e2c6a0062e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:17.022008 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8d07b-93c0-4027-a00c-e4e2c6a0062e admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:17.022473 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8d07b-93c0-4027-a00c-e4e2c6a0062e admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:17.023106 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8d07b-93c0-4027-a00c-e4e2c6a0062e admin admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:17.024102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8d07b-93c0-4027-a00c-e4e2c6a0062e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:15:17.026255 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93390d38-e5e2-4309-8092-bc30aafaba22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:17.027056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93390d38-e5e2-4309-8092-bc30aafaba22 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:17.027556 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93390d38-e5e2-4309-8092-bc30aafaba22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:17.027986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93390d38-e5e2-4309-8092-bc30aafaba22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:17.028108 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8d07b-93c0-4027-a00c-e4e2c6a0062e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:17.030273 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-93390d38-e5e2-4309-8092-bc30aafaba22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:17.037214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8d07b-93c0-4027-a00c-e4e2c6a0062e admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:17.052636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93390d38-e5e2-4309-8092-bc30aafaba22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:17.054550 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93390d38-e5e2-4309-8092-bc30aafaba22 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:17.077500 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 886/1790] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:15:17.078503 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 905/1791] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:17.088763 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93390d38-e5e2-4309-8092-bc30aafaba22 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:17.108517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93390d38-e5e2-4309-8092-bc30aafaba22 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:17.122159 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec54d0-325b-461d-afaf-fa7b15e448dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:17.123051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec54d0-325b-461d-afaf-fa7b15e448dc admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:17.123523 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec54d0-325b-461d-afaf-fa7b15e448dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:17.123953 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec54d0-325b-461d-afaf-fa7b15e448dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:17.124743 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec54d0-325b-461d-afaf-fa7b15e448dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:17.127018 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec54d0-325b-461d-afaf-fa7b15e448dc admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:17.189755 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 906/1792] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:17 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:17.193525 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8d07b-93c0-4027-a00c-e4e2c6a0062e admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:17.206376 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec54d0-325b-461d-afaf-fa7b15e448dc admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:17.208836 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-61ec54d0-325b-461d-afaf-fa7b15e448dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:17.209646 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8d07b-93c0-4027-a00c-e4e2c6a0062e admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:17.349334 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdaba4-6c75-4afa-9580-bec79d457c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:17.351206 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdaba4-6c75-4afa-9580-bec79d457c1f admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:17.352261 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdaba4-6c75-4afa-9580-bec79d457c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:17.353080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdaba4-6c75-4afa-9580-bec79d457c1f admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:17.354262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec54d0-325b-461d-afaf-fa7b15e448dc admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:17.356141 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdaba4-6c75-4afa-9580-bec79d457c1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:17.363478 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdaba4-6c75-4afa-9580-bec79d457c1f admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:17.366585 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b2437-bb85-496e-9a35-f8abd1d4be1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:17.367464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b2437-bb85-496e-9a35-f8abd1d4be1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:17.367913 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b2437-bb85-496e-9a35-f8abd1d4be1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:17.368383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b2437-bb85-496e-9a35-f8abd1d4be1d admin admin] PATH_INFO: `/v3/users/00a875107736428e8509a9c9cc3f03ce` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:17.371716 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b2437-bb85-496e-9a35-f8abd1d4be1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a875107736428e8509a9c9cc3f03ce)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:17.373859 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b2437-bb85-496e-9a35-f8abd1d4be1d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:17.457352 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 887/1793] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:17 2022] POST /identity/v3/users => generated 288 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:17.464382 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdaba4-6c75-4afa-9580-bec79d457c1f admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:17.496906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-737b2437-bb85-496e-9a35-f8abd1d4be1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a875107736428e8509a9c9cc3f03ce'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:17.502614 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdaba4-6c75-4afa-9580-bec79d457c1f admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:17.504409 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-737b2437-bb85-496e-9a35-f8abd1d4be1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a875107736428e8509a9c9cc3f03ce'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:17.523914 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10698d-9da1-4d63-8999-36fcfbdf51da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:17.524525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-737b2437-bb85-496e-9a35-f8abd1d4be1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a875107736428e8509a9c9cc3f03ce'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:17.524644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10698d-9da1-4d63-8999-36fcfbdf51da admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:17.524851 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10698d-9da1-4d63-8999-36fcfbdf51da admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:17.528351 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10698d-9da1-4d63-8999-36fcfbdf51da admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:17.529198 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10698d-9da1-4d63-8999-36fcfbdf51da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:17.531883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10698d-9da1-4d63-8999-36fcfbdf51da admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:17.552420 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-737b2437-bb85-496e-9a35-f8abd1d4be1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a875107736428e8509a9c9cc3f03ce'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:17.553445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-737b2437-bb85-496e-9a35-f8abd1d4be1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a875107736428e8509a9c9cc3f03ce'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:17.559834 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 888/1794] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:17.565814 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10698d-9da1-4d63-8999-36fcfbdf51da admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:17.574122 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-5e10698d-9da1-4d63-8999-36fcfbdf51da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:17.626326 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10698d-9da1-4d63-8999-36fcfbdf51da admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:17.626974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 907/1795] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:17 2022] DELETE /identity/v3/users/00a875107736428e8509a9c9cc3f03ce => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:17.631274 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9072b-304e-4a38-8eb8-26c4ebf36b60 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:17.631618 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9072b-304e-4a38-8eb8-26c4ebf36b60 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:17.631879 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9072b-304e-4a38-8eb8-26c4ebf36b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:17.667271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:17.688024 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-eba9072b-304e-4a38-8eb8-26c4ebf36b60 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:17.689675 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-eba9072b-304e-4a38-8eb8-26c4ebf36b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:17.788334 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:17.825970 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed318f5f-ed3b-4996-a183-f378df425064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:17.826607 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed318f5f-ed3b-4996-a183-f378df425064 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:17.826890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed318f5f-ed3b-4996-a183-f378df425064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:17.827166 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed318f5f-ed3b-4996-a183-f378df425064 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:17.827853 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed318f5f-ed3b-4996-a183-f378df425064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:17.829765 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed318f5f-ed3b-4996-a183-f378df425064 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:17.848293 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 908/1796] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:17.849600 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9072b-304e-4a38-8eb8-26c4ebf36b60 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:17.851307 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-eba9072b-304e-4a38-8eb8-26c4ebf36b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:17.859324 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 889/1797] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:15:17.860499 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed318f5f-ed3b-4996-a183-f378df425064 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:17.883538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed318f5f-ed3b-4996-a183-f378df425064 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:17.904239 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aea0f2-d139-4cbc-8f8d-2ccc3dd7398d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:17.906666 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aea0f2-d139-4cbc-8f8d-2ccc3dd7398d admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:17.908872 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aea0f2-d139-4cbc-8f8d-2ccc3dd7398d admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:17.909348 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aea0f2-d139-4cbc-8f8d-2ccc3dd7398d admin admin] PATH_INFO: `/v3/projects/328b26acd75d48b3bb25b9689f62d50e/users/deeddee26a7c4058b706be4faa9dff45/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:17.937554 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aea0f2-d139-4cbc-8f8d-2ccc3dd7398d admin admin] RBAC: Authorizing `identity:create_grant(project_id=328b26acd75d48b3bb25b9689f62d50e, user_id=deeddee26a7c4058b706be4faa9dff45, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:17.948213 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aea0f2-d139-4cbc-8f8d-2ccc3dd7398d admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:17.978431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 890/1798] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:17 2022] PUT /identity/v3/projects/328b26acd75d48b3bb25b9689f62d50e/users/deeddee26a7c4058b706be4faa9dff45/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:17.992064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aea0f2-d139-4cbc-8f8d-2ccc3dd7398d admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:17.993217 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9072b-304e-4a38-8eb8-26c4ebf36b60 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:17.996797 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-56aea0f2-d139-4cbc-8f8d-2ccc3dd7398d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:18.184654 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8a2d2-73ba-4ef9-93b2-50489d19a516 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:18.188711 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8a2d2-73ba-4ef9-93b2-50489d19a516 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:18.188998 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8a2d2-73ba-4ef9-93b2-50489d19a516 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:18.189276 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8a2d2-73ba-4ef9-93b2-50489d19a516 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:18.195916 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e0f8a2d2-73ba-4ef9-93b2-50489d19a516 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:18.204661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aea0f2-d139-4cbc-8f8d-2ccc3dd7398d admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:18.216011 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d270d-cebb-45d1-851c-ca89aeec72bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:18.216654 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d270d-cebb-45d1-851c-ca89aeec72bc service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:18.216933 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d270d-cebb-45d1-851c-ca89aeec72bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:18.217209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d270d-cebb-45d1-851c-ca89aeec72bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:18.330916 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8a2d2-73ba-4ef9-93b2-50489d19a516 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:18.332400 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8a2d2-73ba-4ef9-93b2-50489d19a516 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:18.353596 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d270d-cebb-45d1-851c-ca89aeec72bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:18.355224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d270d-cebb-45d1-851c-ca89aeec72bc service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:18.357741 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 909/1799] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:18.359222 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd89fa-1aea-4358-b1ae-68044862588c None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:18.359539 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd89fa-1aea-4358-b1ae-68044862588c None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:18.359820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd89fa-1aea-4358-b1ae-68044862588c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:18.376765 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 891/1800] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:18.379159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba483c-e64e-490f-8658-0c6bd98e5c6f None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:18.379465 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba483c-e64e-490f-8658-0c6bd98e5c6f None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:18.379957 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba483c-e64e-490f-8658-0c6bd98e5c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:18.415240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b6dd89fa-1aea-4358-b1ae-68044862588c None None] MFA Rules not processed for user `deeddee26a7c4058b706be4faa9dff45`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:18.417041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b6dd89fa-1aea-4358-b1ae-68044862588c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:18.425633 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:18.529651 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-29ba483c-e64e-490f-8658-0c6bd98e5c6f None None] MFA Rules not processed for user `c0e57ea982d349c1a86b544e9a6e7758`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:18.537917 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-29ba483c-e64e-490f-8658-0c6bd98e5c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:18.610669 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:18.662528 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 910/1801] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:18.663586 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd89fa-1aea-4358-b1ae-68044862588c None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:18.687671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd89fa-1aea-4358-b1ae-68044862588c None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:18.697172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 892/1802] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 28 12:15:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:18.769647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef3cb8-0e6b-4793-99c8-fcd411b6b964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:18.772251 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef3cb8-0e6b-4793-99c8-fcd411b6b964 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:18.773898 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef3cb8-0e6b-4793-99c8-fcd411b6b964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:18.775374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef3cb8-0e6b-4793-99c8-fcd411b6b964 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:18.777747 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef3cb8-0e6b-4793-99c8-fcd411b6b964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:18.786574 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef3cb8-0e6b-4793-99c8-fcd411b6b964 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:18.881727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 911/1803] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:18 2022] POST /identity/v3/projects => generated 377 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:18.887835 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba483c-e64e-490f-8658-0c6bd98e5c6f None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:18.916444 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba483c-e64e-490f-8658-0c6bd98e5c6f None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:19.109454 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef3cb8-0e6b-4793-99c8-fcd411b6b964 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:19.111757 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-61ef3cb8-0e6b-4793-99c8-fcd411b6b964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:19.160220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac47b32-e0d9-4292-a025-74b4b4b9972d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:19.160842 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac47b32-e0d9-4292-a025-74b4b4b9972d admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:19.161122 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac47b32-e0d9-4292-a025-74b4b4b9972d admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:19.161392 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac47b32-e0d9-4292-a025-74b4b4b9972d admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:19.162479 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac47b32-e0d9-4292-a025-74b4b4b9972d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:19.164024 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac47b32-e0d9-4292-a025-74b4b4b9972d admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:19.288531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 893/1804] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:18 2022] POST /identity/v3/users => generated 295 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:19.292895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac47b32-e0d9-4292-a025-74b4b4b9972d admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:19.321953 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac47b32-e0d9-4292-a025-74b4b4b9972d admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:19.347756 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9d0dd-ac23-46b5-a78f-52a0d8428907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:19.348674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9d0dd-ac23-46b5-a78f-52a0d8428907 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:19.350895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9d0dd-ac23-46b5-a78f-52a0d8428907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:19.351141 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9d0dd-ac23-46b5-a78f-52a0d8428907 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:19.351884 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9d0dd-ac23-46b5-a78f-52a0d8428907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:19.359767 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9d0dd-ac23-46b5-a78f-52a0d8428907 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:19.415590 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 894/1805] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:19.416848 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9d0dd-ac23-46b5-a78f-52a0d8428907 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:19.469267 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9d0dd-ac23-46b5-a78f-52a0d8428907 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:19.507352 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28edb5-8781-4a22-b4f5-629854ddb972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:19.510014 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef3cb8-0e6b-4793-99c8-fcd411b6b964 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:19.511408 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28edb5-8781-4a22-b4f5-629854ddb972 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:19.512273 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28edb5-8781-4a22-b4f5-629854ddb972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:19.522718 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28edb5-8781-4a22-b4f5-629854ddb972 admin admin] PATH_INFO: `/v3/projects/e38a64a35685478c99364a26f593e5b2/users/15f39009be1b430e88b75d66be350e0c/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:19.542136 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c81651-6c4a-45ad-b3b8-3052c4cac307 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '822e394e80fd41adb54d330adaf65a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:19.542811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c81651-6c4a-45ad-b3b8-3052c4cac307 service swift] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:19.543095 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c81651-6c4a-45ad-b3b8-3052c4cac307 service swift] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:19.543365 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c81651-6c4a-45ad-b3b8-3052c4cac307 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:19.603985 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28edb5-8781-4a22-b4f5-629854ddb972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e38a64a35685478c99364a26f593e5b2, user_id=15f39009be1b430e88b75d66be350e0c, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:19.623414 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28edb5-8781-4a22-b4f5-629854ddb972 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:19.666674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 895/1806] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:19 2022] PUT /identity/v3/projects/e38a64a35685478c99364a26f593e5b2/users/15f39009be1b430e88b75d66be350e0c/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:19.669431 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df2320-691e-44a4-8fff-4d60a0f153e6 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:19.669764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df2320-691e-44a4-8fff-4d60a0f153e6 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:19.670044 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df2320-691e-44a4-8fff-4d60a0f153e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:19.725712 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c81651-6c4a-45ad-b3b8-3052c4cac307 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:19.728029 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c81651-6c4a-45ad-b3b8-3052c4cac307 service swift] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:19.737888 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-47df2320-691e-44a4-8fff-4d60a0f153e6 None None] MFA Rules not processed for user `90794e56c3f9486fbace8c39018233b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:19.741697 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-47df2320-691e-44a4-8fff-4d60a0f153e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:19.789029 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 912/1807] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 28 12:15:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 28 12:15:19.791467 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c81651-6c4a-45ad-b3b8-3052c4cac307 service swift] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:19.849151 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c81651-6c4a-45ad-b3b8-3052c4cac307 service swift] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:19.877962 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:19.993393 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 896/1808] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:20.173893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f8a35-e120-43fc-b164-ed8e1b69f424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:20.174536 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f8a35-e120-43fc-b164-ed8e1b69f424 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:20.174991 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f8a35-e120-43fc-b164-ed8e1b69f424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:20.175455 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f8a35-e120-43fc-b164-ed8e1b69f424 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:20.176320 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f8a35-e120-43fc-b164-ed8e1b69f424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:20.181028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f8a35-e120-43fc-b164-ed8e1b69f424 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:20.206834 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 913/1809] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:20.213335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df2320-691e-44a4-8fff-4d60a0f153e6 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:20.241296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df2320-691e-44a4-8fff-4d60a0f153e6 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:20.259043 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63676a-b3b9-4d5b-86d4-b07052c075b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:20.264187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63676a-b3b9-4d5b-86d4-b07052c075b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:20.264330 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63676a-b3b9-4d5b-86d4-b07052c075b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:20.266616 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63676a-b3b9-4d5b-86d4-b07052c075b4 admin admin] PATH_INFO: `/v3/projects/e38a64a35685478c99364a26f593e5b2/users/15f39009be1b430e88b75d66be350e0c/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:20.271602 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63676a-b3b9-4d5b-86d4-b07052c075b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e38a64a35685478c99364a26f593e5b2, user_id=15f39009be1b430e88b75d66be350e0c, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:20.289480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63676a-b3b9-4d5b-86d4-b07052c075b4 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:20.331463 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 897/1810] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:20 2022] PUT /identity/v3/projects/e38a64a35685478c99364a26f593e5b2/users/15f39009be1b430e88b75d66be350e0c/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:20.342801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34581f9-239e-49d8-9090-773e9ec7e17b None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:20.343415 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34581f9-239e-49d8-9090-773e9ec7e17b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:20.343996 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34581f9-239e-49d8-9090-773e9ec7e17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:20.438804 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-c34581f9-239e-49d8-9090-773e9ec7e17b None None] MFA Rules not processed for user `15f39009be1b430e88b75d66be350e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:20.440487 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c34581f9-239e-49d8-9090-773e9ec7e17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:20.824306 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 914/1811] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:20.836683 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63676a-b3b9-4d5b-86d4-b07052c075b4 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:20.857420 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-ea63676a-b3b9-4d5b-86d4-b07052c075b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:20.949690 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:21.144152 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63676a-b3b9-4d5b-86d4-b07052c075b4 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:21.164867 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bff711-179f-4f75-bf57-bf0e90ed7699 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:21.167601 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bff711-179f-4f75-bf57-bf0e90ed7699 service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:21.171486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bff711-179f-4f75-bf57-bf0e90ed7699 service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:21.172235 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bff711-179f-4f75-bf57-bf0e90ed7699 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:21.548847 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bff711-179f-4f75-bf57-bf0e90ed7699 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:21.553365 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bff711-179f-4f75-bf57-bf0e90ed7699 service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:21.604677 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 898/1812] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 769 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:15:21.985151 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34581f9-239e-49d8-9090-773e9ec7e17b None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:21.988504 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c34581f9-239e-49d8-9090-773e9ec7e17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:22.057283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e50bd8-f083-4e18-b771-8e4ef2404a4c None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:22.057832 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e50bd8-f083-4e18-b771-8e4ef2404a4c None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:22.057934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e50bd8-f083-4e18-b771-8e4ef2404a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:22.131556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-83e50bd8-f083-4e18-b771-8e4ef2404a4c None None] MFA Rules not processed for user `ca51ff621664452db7dd991714462e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:22.134890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-83e50bd8-f083-4e18-b771-8e4ef2404a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:22.341293 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34581f9-239e-49d8-9090-773e9ec7e17b None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:22.373212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572e827-6712-4123-89af-9111a0965dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:22.373877 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572e827-6712-4123-89af-9111a0965dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:22.374162 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572e827-6712-4123-89af-9111a0965dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:22.374493 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572e827-6712-4123-89af-9111a0965dcd admin admin] PATH_INFO: `/v3/projects/ffa7d7ff0356438ead09a3ff93cdee3f` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:22.406934 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572e827-6712-4123-89af-9111a0965dcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffa7d7ff0356438ead09a3ff93cdee3f)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:22.423154 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572e827-6712-4123-89af-9111a0965dcd admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:22.509717 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 899/1813] 10.222.0.50 () {58 vars in 1015 bytes} [Wed Sep 28 12:15:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:22.597727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:22.640236 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e50bd8-f083-4e18-b771-8e4ef2404a4c None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:22.641695 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-83e50bd8-f083-4e18-b771-8e4ef2404a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:22.653392 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3572e827-6712-4123-89af-9111a0965dcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffa7d7ff0356438ead09a3ff93cdee3f', 'request_id': 'req-3572e827-6712-4123-89af-9111a0965dcd'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:22.656833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e50bd8-f083-4e18-b771-8e4ef2404a4c None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:22.679856 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3572e827-6712-4123-89af-9111a0965dcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffa7d7ff0356438ead09a3ff93cdee3f', 'request_id': 'req-3572e827-6712-4123-89af-9111a0965dcd'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:22.723522 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3572e827-6712-4123-89af-9111a0965dcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffa7d7ff0356438ead09a3ff93cdee3f', 'request_id': 'req-3572e827-6712-4123-89af-9111a0965dcd'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:22.770179 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3572e827-6712-4123-89af-9111a0965dcd admin admin] The token cache is being invalidate because project ffa7d7ff0356438ead09a3ff93cdee3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:22.770739 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3572e827-6712-4123-89af-9111a0965dcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:22.771739 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3572e827-6712-4123-89af-9111a0965dcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:22.776401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 915/1814] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:21 2022] DELETE /identity/v3/projects/ffa7d7ff0356438ead09a3ff93cdee3f => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:22.785454 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572e827-6712-4123-89af-9111a0965dcd admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:22.798697 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3572e827-6712-4123-89af-9111a0965dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:22.959966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d6669-fccf-4e6c-8efa-08050ccdb65d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:22.962719 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d6669-fccf-4e6c-8efa-08050ccdb65d service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:22.963102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d6669-fccf-4e6c-8efa-08050ccdb65d service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:22.965975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d6669-fccf-4e6c-8efa-08050ccdb65d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:22.972201 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-360d6669-fccf-4e6c-8efa-08050ccdb65d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:23.018368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d6669-fccf-4e6c-8efa-08050ccdb65d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:23.024551 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d6669-fccf-4e6c-8efa-08050ccdb65d service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:23.062660 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 900/1815] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:15:23.128864 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572e827-6712-4123-89af-9111a0965dcd admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:23.150850 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc0056-bb8d-4433-a9ce-380871c99253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:23.151599 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc0056-bb8d-4433-a9ce-380871c99253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:23.152864 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc0056-bb8d-4433-a9ce-380871c99253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:23.153149 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc0056-bb8d-4433-a9ce-380871c99253 admin admin] PATH_INFO: `/v3/users/5257cc318f3d4b98abbe9f79ed4ab55f` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:23.161698 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc0056-bb8d-4433-a9ce-380871c99253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5257cc318f3d4b98abbe9f79ed4ab55f)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:23.164414 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc0056-bb8d-4433-a9ce-380871c99253 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:23.374732 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-34fc0056-bb8d-4433-a9ce-380871c99253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5257cc318f3d4b98abbe9f79ed4ab55f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:23.375825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-34fc0056-bb8d-4433-a9ce-380871c99253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5257cc318f3d4b98abbe9f79ed4ab55f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:23.402487 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-34fc0056-bb8d-4433-a9ce-380871c99253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5257cc318f3d4b98abbe9f79ed4ab55f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:23.431929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-34fc0056-bb8d-4433-a9ce-380871c99253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5257cc318f3d4b98abbe9f79ed4ab55f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:23.432619 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-34fc0056-bb8d-4433-a9ce-380871c99253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5257cc318f3d4b98abbe9f79ed4ab55f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:23.503298 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 916/1816] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:22 2022] DELETE /identity/v3/users/5257cc318f3d4b98abbe9f79ed4ab55f => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:25.282175 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d6669-fccf-4e6c-8efa-08050ccdb65d service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:25.284173 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-360d6669-fccf-4e6c-8efa-08050ccdb65d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:25.396616 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:25.526235 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d6669-fccf-4e6c-8efa-08050ccdb65d service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:25.722682 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75dd6d0-ce41-42e7-ab9d-ee0e28e9ed9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:25.723866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75dd6d0-ce41-42e7-ab9d-ee0e28e9ed9d service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:25.724453 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75dd6d0-ce41-42e7-ab9d-ee0e28e9ed9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:25.725017 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75dd6d0-ce41-42e7-ab9d-ee0e28e9ed9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:25.735410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-f75dd6d0-ce41-42e7-ab9d-ee0e28e9ed9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:25.941911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75dd6d0-ce41-42e7-ab9d-ee0e28e9ed9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:25.941911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75dd6d0-ce41-42e7-ab9d-ee0e28e9ed9d service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:25.981372 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 901/1817] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:25 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:26.123608 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc0056-bb8d-4433-a9ce-380871c99253 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:26.125844 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-34fc0056-bb8d-4433-a9ce-380871c99253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:26.188285 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc0056-bb8d-4433-a9ce-380871c99253 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:26.206991 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1efc4-6b86-420a-8ddc-3ac8a2bfd9b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:26.209615 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1efc4-6b86-420a-8ddc-3ac8a2bfd9b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:26.218062 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1efc4-6b86-420a-8ddc-3ac8a2bfd9b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:26.219018 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1efc4-6b86-420a-8ddc-3ac8a2bfd9b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:26.228207 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-81a1efc4-6b86-420a-8ddc-3ac8a2bfd9b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:26.346181 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:26.447877 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1efc4-6b86-420a-8ddc-3ac8a2bfd9b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:26.450576 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1efc4-6b86-420a-8ddc-3ac8a2bfd9b5 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:26.502172 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 917/1818] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:27.629308 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e3117-6362-447f-b80d-f02b1922c31e None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:27.629822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e3117-6362-447f-b80d-f02b1922c31e None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:27.629822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e3117-6362-447f-b80d-f02b1922c31e None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:27.631182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 902/1819] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 28 12:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:15:27.678272 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67c3fe-9f57-487e-bdb4-172a0bdff56c None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:27.678991 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67c3fe-9f57-487e-bdb4-172a0bdff56c None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:27.678991 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67c3fe-9f57-487e-bdb4-172a0bdff56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:27.719169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-dc67c3fe-9f57-487e-bdb4-172a0bdff56c None None] MFA Rules not processed for user `0e81804e04514ae882a1fd93789db025`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:27.722911 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-dc67c3fe-9f57-487e-bdb4-172a0bdff56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:27.728948 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e3117-6362-447f-b80d-f02b1922c31e None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:27.731626 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-a15e3117-6362-447f-b80d-f02b1922c31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:28.018147 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e3117-6362-447f-b80d-f02b1922c31e None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:28.030727 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df88f51-fd1e-4047-8329-930d4fac15ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:28.031826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df88f51-fd1e-4047-8329-930d4fac15ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:28.032598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df88f51-fd1e-4047-8329-930d4fac15ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:28.033715 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df88f51-fd1e-4047-8329-930d4fac15ed admin admin] PATH_INFO: `/v3/projects/f2c687518a05486d9c4e7e57878a0f75` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:28.035986 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df88f51-fd1e-4047-8329-930d4fac15ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2c687518a05486d9c4e7e57878a0f75)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:28.038427 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 918/1820] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 28 12:15:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:28.039780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df88f51-fd1e-4047-8329-930d4fac15ed admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:28.119066 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:28.163233 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4df88f51-fd1e-4047-8329-930d4fac15ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2c687518a05486d9c4e7e57878a0f75', 'request_id': 'req-4df88f51-fd1e-4047-8329-930d4fac15ed'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:28.192290 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4df88f51-fd1e-4047-8329-930d4fac15ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2c687518a05486d9c4e7e57878a0f75', 'request_id': 'req-4df88f51-fd1e-4047-8329-930d4fac15ed'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:28.225210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4df88f51-fd1e-4047-8329-930d4fac15ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2c687518a05486d9c4e7e57878a0f75', 'request_id': 'req-4df88f51-fd1e-4047-8329-930d4fac15ed'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:28.291700 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4df88f51-fd1e-4047-8329-930d4fac15ed admin admin] The token cache is being invalidate because project f2c687518a05486d9c4e7e57878a0f75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:28.291700 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4df88f51-fd1e-4047-8329-930d4fac15ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:28.291700 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4df88f51-fd1e-4047-8329-930d4fac15ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:28.298940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 903/1821] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:27 2022] DELETE /identity/v3/projects/f2c687518a05486d9c4e7e57878a0f75 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:28.301746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69480e3-0c79-49f6-a019-631ac7d18e6e None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:28.302315 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69480e3-0c79-49f6-a019-631ac7d18e6e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:28.302945 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69480e3-0c79-49f6-a019-631ac7d18e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:28.353074 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-d69480e3-0c79-49f6-a019-631ac7d18e6e None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:28.354592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d69480e3-0c79-49f6-a019-631ac7d18e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:28.547629 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 919/1822] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:28.572658 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfa6e6-05db-4a02-aa77-611528a67f07 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:28.574846 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfa6e6-05db-4a02-aa77-611528a67f07 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:28.575757 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfa6e6-05db-4a02-aa77-611528a67f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:28.667675 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-05bfa6e6-05db-4a02-aa77-611528a67f07 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:28.672373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-05bfa6e6-05db-4a02-aa77-611528a67f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:28.704464 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 904/1823] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:28.705747 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69480e3-0c79-49f6-a019-631ac7d18e6e None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:28.723731 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69480e3-0c79-49f6-a019-631ac7d18e6e None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:28.736938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb3d0b-1805-4adb-af9a-e0faa378acf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:28.737653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb3d0b-1805-4adb-af9a-e0faa378acf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:28.737931 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb3d0b-1805-4adb-af9a-e0faa378acf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:28.738202 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb3d0b-1805-4adb-af9a-e0faa378acf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:28.738872 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb3d0b-1805-4adb-af9a-e0faa378acf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:15:28.739179 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb3d0b-1805-4adb-af9a-e0faa378acf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:28.740835 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb3d0b-1805-4adb-af9a-e0faa378acf9 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:28.773385 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 920/1824] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:15:28.774338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfa6e6-05db-4a02-aa77-611528a67f07 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:28.785031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfa6e6-05db-4a02-aa77-611528a67f07 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:28.796914 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b9336-b55a-45fb-b7bd-3875114d07ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:28.797869 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b9336-b55a-45fb-b7bd-3875114d07ab admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:28.798374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b9336-b55a-45fb-b7bd-3875114d07ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:28.798807 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b9336-b55a-45fb-b7bd-3875114d07ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:28.799668 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b9336-b55a-45fb-b7bd-3875114d07ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:28.802085 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b9336-b55a-45fb-b7bd-3875114d07ab admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:28.873628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 905/1825] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:28 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:15:28.878782 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb3d0b-1805-4adb-af9a-e0faa378acf9 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:28.892461 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb3d0b-1805-4adb-af9a-e0faa378acf9 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:29.002712 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:29.044372 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861872bf-0b8a-4bf3-b3b4-ddd73b616dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:29.045305 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861872bf-0b8a-4bf3-b3b4-ddd73b616dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:29.045693 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861872bf-0b8a-4bf3-b3b4-ddd73b616dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:29.046310 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861872bf-0b8a-4bf3-b3b4-ddd73b616dd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:29.050106 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861872bf-0b8a-4bf3-b3b4-ddd73b616dd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:29.052961 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861872bf-0b8a-4bf3-b3b4-ddd73b616dd4 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:29.193363 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 921/1826] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:28 2022] POST /identity/v3/users => generated 289 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:29.195597 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b9336-b55a-45fb-b7bd-3875114d07ab admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:29.216936 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b9336-b55a-45fb-b7bd-3875114d07ab admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:29.253017 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bedaba7-285e-49bf-ab41-88cc3d643913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:29.253575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedaba7-285e-49bf-ab41-88cc3d643913 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:29.253852 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedaba7-285e-49bf-ab41-88cc3d643913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:29.254119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedaba7-285e-49bf-ab41-88cc3d643913 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:29.254770 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bedaba7-285e-49bf-ab41-88cc3d643913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:29.263642 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bedaba7-285e-49bf-ab41-88cc3d643913 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:29.295191 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861872bf-0b8a-4bf3-b3b4-ddd73b616dd4 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:29.296499 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 906/1827] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:15:29.313803 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861872bf-0b8a-4bf3-b3b4-ddd73b616dd4 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:29.330735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba092d8-9f7d-4a0b-b7bd-2f6b8315b11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:29.340175 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba092d8-9f7d-4a0b-b7bd-2f6b8315b11a admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:29.340505 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba092d8-9f7d-4a0b-b7bd-2f6b8315b11a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:29.341449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba092d8-9f7d-4a0b-b7bd-2f6b8315b11a admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:29.341449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba092d8-9f7d-4a0b-b7bd-2f6b8315b11a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:29.343339 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba092d8-9f7d-4a0b-b7bd-2f6b8315b11a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:29.400015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 922/1828] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:15:29.415287 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bedaba7-285e-49bf-ab41-88cc3d643913 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:29.434460 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba092d8-9f7d-4a0b-b7bd-2f6b8315b11a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:29.437076 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-4ba092d8-9f7d-4a0b-b7bd-2f6b8315b11a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:29.453944 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bedaba7-285e-49bf-ab41-88cc3d643913 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:29.482360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e5f8b-4843-4c61-89e6-ee362ce87005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:29.485477 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e5f8b-4843-4c61-89e6-ee362ce87005 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:29.485786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e5f8b-4843-4c61-89e6-ee362ce87005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:29.486067 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e5f8b-4843-4c61-89e6-ee362ce87005 admin admin] PATH_INFO: `/v3/projects/707515110b3049c5a08156135662cb48/users/cd74f89c10274c73b404208633164627/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:29.548851 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e5f8b-4843-4c61-89e6-ee362ce87005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=707515110b3049c5a08156135662cb48, user_id=cd74f89c10274c73b404208633164627, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:29.551230 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e5f8b-4843-4c61-89e6-ee362ce87005 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:29.576602 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba092d8-9f7d-4a0b-b7bd-2f6b8315b11a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:29.583758 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b216b64-bf8b-4e1c-9999-6685b3a28f21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:29.584619 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b216b64-bf8b-4e1c-9999-6685b3a28f21 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:29.585134 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b216b64-bf8b-4e1c-9999-6685b3a28f21 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:29.585648 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b216b64-bf8b-4e1c-9999-6685b3a28f21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:29.588241 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0b216b64-bf8b-4e1c-9999-6685b3a28f21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:29.620022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 907/1829] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:29 2022] PUT /identity/v3/projects/707515110b3049c5a08156135662cb48/users/cd74f89c10274c73b404208633164627/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:29.627795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b216b64-bf8b-4e1c-9999-6685b3a28f21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:29.629562 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b216b64-bf8b-4e1c-9999-6685b3a28f21 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:29.633076 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff5239-df41-432c-9536-e089ba3b10dd None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:29.633524 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff5239-df41-432c-9536-e089ba3b10dd None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:29.633884 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff5239-df41-432c-9536-e089ba3b10dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:29.653634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 923/1830] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:29.711288 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-9dff5239-df41-432c-9536-e089ba3b10dd None None] MFA Rules not processed for user `cd74f89c10274c73b404208633164627`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:29.715894 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-9dff5239-df41-432c-9536-e089ba3b10dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:30.028626 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 908/1831] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:30.029610 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b216b64-bf8b-4e1c-9999-6685b3a28f21 service nova] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:30.046786 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b216b64-bf8b-4e1c-9999-6685b3a28f21 service nova] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:30.164440 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0499b6-e39e-4fd0-84a7-9788406fb929 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:30.164969 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0499b6-e39e-4fd0-84a7-9788406fb929 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:30.165397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0499b6-e39e-4fd0-84a7-9788406fb929 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:30.167227 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 909/1832] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 28 12:15:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:15:30.283021 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f4d8f-1dfb-47bc-98f2-bf4aa6ed10ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:30.283837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f4d8f-1dfb-47bc-98f2-bf4aa6ed10ab admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:30.284398 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f4d8f-1dfb-47bc-98f2-bf4aa6ed10ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:30.284786 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f4d8f-1dfb-47bc-98f2-bf4aa6ed10ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:30.296187 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f4d8f-1dfb-47bc-98f2-bf4aa6ed10ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:30.309870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f4d8f-1dfb-47bc-98f2-bf4aa6ed10ab admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:30.332409 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0499b6-e39e-4fd0-84a7-9788406fb929 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:30.335421 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-2a0499b6-e39e-4fd0-84a7-9788406fb929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:30.357820 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0499b6-e39e-4fd0-84a7-9788406fb929 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:30.389580 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035350b-b534-4f90-8650-914028809c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:30.390674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035350b-b534-4f90-8650-914028809c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:30.392201 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035350b-b534-4f90-8650-914028809c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:30.394535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035350b-b534-4f90-8650-914028809c0a admin admin] PATH_INFO: `/v3/users/628f2a27689c4723aa13f0390ee310ee` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:30.399398 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035350b-b534-4f90-8650-914028809c0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=628f2a27689c4723aa13f0390ee310ee)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:30.405638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 924/1833] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:30 2022] POST /identity/v3/projects => generated 379 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:15:30.406746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035350b-b534-4f90-8650-914028809c0a admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:30.410803 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e957a-1e5a-4a0c-b81e-791a209cf382 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:30.411091 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e957a-1e5a-4a0c-b81e-791a209cf382 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:30.411366 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e957a-1e5a-4a0c-b81e-791a209cf382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:30.462408 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-818e957a-1e5a-4a0c-b81e-791a209cf382 None None] MFA Rules not processed for user `0e81804e04514ae882a1fd93789db025`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:30.465772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-818e957a-1e5a-4a0c-b81e-791a209cf382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:30.558851 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-2035350b-b534-4f90-8650-914028809c0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '628f2a27689c4723aa13f0390ee310ee'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:30.561360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:30.591250 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-2035350b-b534-4f90-8650-914028809c0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '628f2a27689c4723aa13f0390ee310ee'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:30.592247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-2035350b-b534-4f90-8650-914028809c0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '628f2a27689c4723aa13f0390ee310ee'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:30.596001 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:30.610220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-2035350b-b534-4f90-8650-914028809c0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '628f2a27689c4723aa13f0390ee310ee'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:30.670083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-2035350b-b534-4f90-8650-914028809c0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '628f2a27689c4723aa13f0390ee310ee'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:30.697865 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 925/1834] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 28 12:15:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:30.699396 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e957a-1e5a-4a0c-b81e-791a209cf382 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:30.703795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-818e957a-1e5a-4a0c-b81e-791a209cf382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:30.707815 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 910/1835] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:30 2022] DELETE /identity/v3/users/628f2a27689c4723aa13f0390ee310ee => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:30.709364 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d21a3d-7753-480f-b53b-c964ba568b82 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:30.711098 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d21a3d-7753-480f-b53b-c964ba568b82 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:30.713957 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d21a3d-7753-480f-b53b-c964ba568b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:30.776837 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-29d21a3d-7753-480f-b53b-c964ba568b82 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:30.779142 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-29d21a3d-7753-480f-b53b-c964ba568b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:30.921647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e957a-1e5a-4a0c-b81e-791a209cf382 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:30.930842 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0de05-ffbe-4aed-9092-f9a523a80c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:30.931713 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0de05-ffbe-4aed-9092-f9a523a80c17 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:30.932110 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0de05-ffbe-4aed-9092-f9a523a80c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:30.932501 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0de05-ffbe-4aed-9092-f9a523a80c17 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:30.933364 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0de05-ffbe-4aed-9092-f9a523a80c17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:30.938843 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0de05-ffbe-4aed-9092-f9a523a80c17 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:30.940928 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 911/1836] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:30.941690 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d21a3d-7753-480f-b53b-c964ba568b82 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:30.945213 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-29d21a3d-7753-480f-b53b-c964ba568b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:30.977197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d21a3d-7753-480f-b53b-c964ba568b82 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:30.989068 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 926/1837] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:30 2022] POST /identity/v3/users => generated 290 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:30.993915 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0de05-ffbe-4aed-9092-f9a523a80c17 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:30.994792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b741a-53e7-4c85-b80b-2bc8d563b7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:30.996751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b741a-53e7-4c85-b80b-2bc8d563b7c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:30.997331 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b741a-53e7-4c85-b80b-2bc8d563b7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:30.997331 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b741a-53e7-4c85-b80b-2bc8d563b7c6 admin admin] PATH_INFO: `/v3/users/8c73047d05ca4ff9b3a2a64f99e3734e` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:30.998975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b741a-53e7-4c85-b80b-2bc8d563b7c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c73047d05ca4ff9b3a2a64f99e3734e)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:31.001660 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b741a-53e7-4c85-b80b-2bc8d563b7c6 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:31.022153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0de05-ffbe-4aed-9092-f9a523a80c17 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:31.029685 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29246ef-732a-42f7-abd6-47db7c472aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:31.030961 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29246ef-732a-42f7-abd6-47db7c472aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:31.030961 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29246ef-732a-42f7-abd6-47db7c472aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:31.031300 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29246ef-732a-42f7-abd6-47db7c472aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:31.032552 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29246ef-732a-42f7-abd6-47db7c472aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:31.042111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29246ef-732a-42f7-abd6-47db7c472aa7 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:31.071054 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 927/1838] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:31.072888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29246ef-732a-42f7-abd6-47db7c472aa7 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:31.104025 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29246ef-732a-42f7-abd6-47db7c472aa7 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:31.128414 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bad2bc-9cee-4898-a2e5-102f3e5677b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:31.129465 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bad2bc-9cee-4898-a2e5-102f3e5677b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:31.129941 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bad2bc-9cee-4898-a2e5-102f3e5677b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:31.130385 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bad2bc-9cee-4898-a2e5-102f3e5677b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:31.133568 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bad2bc-9cee-4898-a2e5-102f3e5677b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:31.138197 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bad2bc-9cee-4898-a2e5-102f3e5677b4 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:31.164890 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 928/1839] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:15:31.166038 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bad2bc-9cee-4898-a2e5-102f3e5677b4 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:31.176596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a1bad2bc-9cee-4898-a2e5-102f3e5677b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:31.193497 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-bf2b741a-53e7-4c85-b80b-2bc8d563b7c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c73047d05ca4ff9b3a2a64f99e3734e'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:31.246353 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-bf2b741a-53e7-4c85-b80b-2bc8d563b7c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c73047d05ca4ff9b3a2a64f99e3734e'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:31.247423 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-bf2b741a-53e7-4c85-b80b-2bc8d563b7c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c73047d05ca4ff9b3a2a64f99e3734e'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:31.264863 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-bf2b741a-53e7-4c85-b80b-2bc8d563b7c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c73047d05ca4ff9b3a2a64f99e3734e'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:31.284426 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-bf2b741a-53e7-4c85-b80b-2bc8d563b7c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c73047d05ca4ff9b3a2a64f99e3734e'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:31.314168 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 912/1840] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:30 2022] DELETE /identity/v3/users/8c73047d05ca4ff9b3a2a64f99e3734e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:31.314168 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b741a-53e7-4c85-b80b-2bc8d563b7c6 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:31.330350 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-bf2b741a-53e7-4c85-b80b-2bc8d563b7c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:31.382241 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bad2bc-9cee-4898-a2e5-102f3e5677b4 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:31.485810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:31.525257 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1a557-feba-4404-8958-5e15d67169eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:31.526041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1a557-feba-4404-8958-5e15d67169eb service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:31.528110 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1a557-feba-4404-8958-5e15d67169eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:31.528444 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1a557-feba-4404-8958-5e15d67169eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:31.533725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-51c1a557-feba-4404-8958-5e15d67169eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:31.544413 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b741a-53e7-4c85-b80b-2bc8d563b7c6 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:31.570749 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54dc71-b98a-467d-a17c-5e50748a68a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:31.570749 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54dc71-b98a-467d-a17c-5e50748a68a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:31.571112 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54dc71-b98a-467d-a17c-5e50748a68a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:31.574407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54dc71-b98a-467d-a17c-5e50748a68a2 admin admin] PATH_INFO: `/v3/projects/fbdf5a40ece84ef3a3eabb5cd569dceb/users/3a5f7cced0db4566b9a55465e3ad1cd3/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:31.575722 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1a557-feba-4404-8958-5e15d67169eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:31.578354 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1a557-feba-4404-8958-5e15d67169eb service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:31.602015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:31.623155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 929/1841] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:31.626510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d471505-3fa2-437c-b0b8-3b8a103c3fe8 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:31.626681 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d471505-3fa2-437c-b0b8-3b8a103c3fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:31.627178 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d471505-3fa2-437c-b0b8-3b8a103c3fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:31.628401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54dc71-b98a-467d-a17c-5e50748a68a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbdf5a40ece84ef3a3eabb5cd569dceb, user_id=3a5f7cced0db4566b9a55465e3ad1cd3, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:31.635118 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54dc71-b98a-467d-a17c-5e50748a68a2 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:31.683529 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 913/1842] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:31 2022] PUT /identity/v3/projects/fbdf5a40ece84ef3a3eabb5cd569dceb/users/3a5f7cced0db4566b9a55465e3ad1cd3/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:31.685167 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-8d471505-3fa2-437c-b0b8-3b8a103c3fe8 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:31.690073 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8d471505-3fa2-437c-b0b8-3b8a103c3fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:31.692279 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc23dc-6dc4-4beb-80cf-73c69ecaf48f None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:31.692618 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc23dc-6dc4-4beb-80cf-73c69ecaf48f None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:31.693508 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc23dc-6dc4-4beb-80cf-73c69ecaf48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:31.780717 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-cafc23dc-6dc4-4beb-80cf-73c69ecaf48f None None] MFA Rules not processed for user `3a5f7cced0db4566b9a55465e3ad1cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:31.781455 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-cafc23dc-6dc4-4beb-80cf-73c69ecaf48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:31.896784 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 930/1843] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:31.912625 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 914/1844] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:31.917945 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d471505-3fa2-437c-b0b8-3b8a103c3fe8 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:31.932095 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d471505-3fa2-437c-b0b8-3b8a103c3fe8 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:31.940821 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21bcd5-ba04-4be4-bd29-df2f9eed3f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:31.941750 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21bcd5-ba04-4be4-bd29-df2f9eed3f42 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:31.942067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21bcd5-ba04-4be4-bd29-df2f9eed3f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:31.942492 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21bcd5-ba04-4be4-bd29-df2f9eed3f42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:31.943521 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21bcd5-ba04-4be4-bd29-df2f9eed3f42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:31.945687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21bcd5-ba04-4be4-bd29-df2f9eed3f42 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:31.993370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 931/1845] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:31 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:31.999459 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc23dc-6dc4-4beb-80cf-73c69ecaf48f None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:32.014054 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21bcd5-ba04-4be4-bd29-df2f9eed3f42 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:32.022006 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-cd21bcd5-ba04-4be4-bd29-df2f9eed3f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:32.036445 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc23dc-6dc4-4beb-80cf-73c69ecaf48f None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:32.197849 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21bcd5-ba04-4be4-bd29-df2f9eed3f42 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:32.201550 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f62195-51e9-4acc-8099-149fa3c2731c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:32.202178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f62195-51e9-4acc-8099-149fa3c2731c admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:32.202457 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f62195-51e9-4acc-8099-149fa3c2731c admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:32.202727 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f62195-51e9-4acc-8099-149fa3c2731c admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:32.204013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f62195-51e9-4acc-8099-149fa3c2731c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:32.207163 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f62195-51e9-4acc-8099-149fa3c2731c admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:32.210922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5b4ed-e6fb-4fd1-8c6b-3567494ac1e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:32.211570 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5b4ed-e6fb-4fd1-8c6b-3567494ac1e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:32.211828 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5b4ed-e6fb-4fd1-8c6b-3567494ac1e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:32.212098 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5b4ed-e6fb-4fd1-8c6b-3567494ac1e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:32.233253 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5b4ed-e6fb-4fd1-8c6b-3567494ac1e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:32.236080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5b4ed-e6fb-4fd1-8c6b-3567494ac1e3 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:32.282180 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 915/1846] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:31 2022] POST /identity/v3/users => generated 295 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:32.285770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 932/1847] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:32.288455 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f62195-51e9-4acc-8099-149fa3c2731c admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:32.322206 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f62195-51e9-4acc-8099-149fa3c2731c admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:32.347883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fc0c9-9406-4321-aca4-f386dd8c625d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:32.348570 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fc0c9-9406-4321-aca4-f386dd8c625d admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:32.348846 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fc0c9-9406-4321-aca4-f386dd8c625d admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:32.349151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fc0c9-9406-4321-aca4-f386dd8c625d admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:32.349830 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3fc0c9-9406-4321-aca4-f386dd8c625d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:32.351549 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3fc0c9-9406-4321-aca4-f386dd8c625d admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:32.381041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 916/1848] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:15:32.384901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5b4ed-e6fb-4fd1-8c6b-3567494ac1e3 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:32.398715 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5b4ed-e6fb-4fd1-8c6b-3567494ac1e3 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:32.408871 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c505eb1-e220-4126-ba3d-1af73602c948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:32.410928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c505eb1-e220-4126-ba3d-1af73602c948 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:32.411372 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c505eb1-e220-4126-ba3d-1af73602c948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:32.412345 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c505eb1-e220-4126-ba3d-1af73602c948 admin admin] PATH_INFO: `/v3/projects/006f63fe27db41dba40d58d7b2556c02/users/9b9bcd4f0d094b58b30f96aff16f0cb6/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:32.458203 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c505eb1-e220-4126-ba3d-1af73602c948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=006f63fe27db41dba40d58d7b2556c02, user_id=9b9bcd4f0d094b58b30f96aff16f0cb6, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:32.461258 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c505eb1-e220-4126-ba3d-1af73602c948 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:32.486720 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 933/1849] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:32 2022] PUT /identity/v3/projects/006f63fe27db41dba40d58d7b2556c02/users/9b9bcd4f0d094b58b30f96aff16f0cb6/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:32.491462 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fc0c9-9406-4321-aca4-f386dd8c625d admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:32.510045 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fc0c9-9406-4321-aca4-f386dd8c625d admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:32.575063 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:32.674831 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ac4b2-30b6-4c58-80d1-345f5fded9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:32.675501 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ac4b2-30b6-4c58-80d1-345f5fded9dd admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:32.676013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ac4b2-30b6-4c58-80d1-345f5fded9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:32.676392 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ac4b2-30b6-4c58-80d1-345f5fded9dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:32.677671 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ac4b2-30b6-4c58-80d1-345f5fded9dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:32.684000 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ac4b2-30b6-4c58-80d1-345f5fded9dd admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:32.710146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 917/1850] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:32.711063 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c505eb1-e220-4126-ba3d-1af73602c948 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:32.723373 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c505eb1-e220-4126-ba3d-1af73602c948 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:32.749180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0766c-b99e-4087-92df-8be183c4dc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:32.750010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0766c-b99e-4087-92df-8be183c4dc11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:32.750448 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0766c-b99e-4087-92df-8be183c4dc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:32.750574 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0766c-b99e-4087-92df-8be183c4dc11 admin admin] PATH_INFO: `/v3/projects/006f63fe27db41dba40d58d7b2556c02/users/9b9bcd4f0d094b58b30f96aff16f0cb6/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:32.752680 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0766c-b99e-4087-92df-8be183c4dc11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=006f63fe27db41dba40d58d7b2556c02, user_id=9b9bcd4f0d094b58b30f96aff16f0cb6, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:32.755925 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0766c-b99e-4087-92df-8be183c4dc11 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:32.771518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 934/1851] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:32 2022] PUT /identity/v3/projects/006f63fe27db41dba40d58d7b2556c02/users/9b9bcd4f0d094b58b30f96aff16f0cb6/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:32.787689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3186c-13e7-4c1d-a577-73a9653bb340 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:32.788304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3186c-13e7-4c1d-a577-73a9653bb340 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:32.788972 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3186c-13e7-4c1d-a577-73a9653bb340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:32.864917 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-9ce3186c-13e7-4c1d-a577-73a9653bb340 None None] MFA Rules not processed for user `9b9bcd4f0d094b58b30f96aff16f0cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:32.868803 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-9ce3186c-13e7-4c1d-a577-73a9653bb340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:32.998462 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0766c-b99e-4087-92df-8be183c4dc11 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:33.002543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3ad0766c-b99e-4087-92df-8be183c4dc11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:33.040727 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 918/1852] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:33.053287 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3186c-13e7-4c1d-a577-73a9653bb340 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:33.059144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-9ce3186c-13e7-4c1d-a577-73a9653bb340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:33.219467 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:33.291821 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0766c-b99e-4087-92df-8be183c4dc11 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:33.307739 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5266b32-0a4b-4ccb-9fd1-a09185cf4269 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:33.310557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5266b32-0a4b-4ccb-9fd1-a09185cf4269 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:33.310840 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5266b32-0a4b-4ccb-9fd1-a09185cf4269 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:33.311180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5266b32-0a4b-4ccb-9fd1-a09185cf4269 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:33.318449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d5266b32-0a4b-4ccb-9fd1-a09185cf4269 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:33.337163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5266b32-0a4b-4ccb-9fd1-a09185cf4269 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:33.339011 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5266b32-0a4b-4ccb-9fd1-a09185cf4269 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:33.354909 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 935/1853] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:33.358231 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3186c-13e7-4c1d-a577-73a9653bb340 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:33.369434 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a7933-956c-43b2-a7df-aeff7039975c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:33.370415 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a7933-956c-43b2-a7df-aeff7039975c service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:33.371464 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a7933-956c-43b2-a7df-aeff7039975c service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:33.371797 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a7933-956c-43b2-a7df-aeff7039975c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:33.396345 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a7933-956c-43b2-a7df-aeff7039975c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:33.397811 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a7933-956c-43b2-a7df-aeff7039975c service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:33.439691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 919/1854] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:33.493621 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5266b32-0a4b-4ccb-9fd1-a09185cf4269 service nova] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:33.495196 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d5266b32-0a4b-4ccb-9fd1-a09185cf4269 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:33.528439 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5266b32-0a4b-4ccb-9fd1-a09185cf4269 service nova] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:33.543950 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf16c9a-ca8b-4fce-a151-4a77129d43e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:33.558730 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf16c9a-ca8b-4fce-a151-4a77129d43e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:33.559115 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf16c9a-ca8b-4fce-a151-4a77129d43e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:33.565173 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf16c9a-ca8b-4fce-a151-4a77129d43e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:33.569883 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-fcf16c9a-ca8b-4fce-a151-4a77129d43e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:33.588332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a7933-956c-43b2-a7df-aeff7039975c service cinder] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:33.590011 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-0e2a7933-956c-43b2-a7df-aeff7039975c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:33.779537 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:33.801594 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf16c9a-ca8b-4fce-a151-4a77129d43e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:33.803421 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf16c9a-ca8b-4fce-a151-4a77129d43e3 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:33.827040 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a7933-956c-43b2-a7df-aeff7039975c service cinder] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:33.831978 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 936/1855] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:33.846056 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e3ec9-56cf-4eeb-983f-aebbbf4ee320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:33.846910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e3ec9-56cf-4eeb-983f-aebbbf4ee320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:33.847344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e3ec9-56cf-4eeb-983f-aebbbf4ee320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:33.847805 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e3ec9-56cf-4eeb-983f-aebbbf4ee320 admin admin] PATH_INFO: `/v3/projects/3efa5cb9e39649ccbdf069578aa48102` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:33.853068 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e3ec9-56cf-4eeb-983f-aebbbf4ee320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3efa5cb9e39649ccbdf069578aa48102)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:33.855281 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e3ec9-56cf-4eeb-983f-aebbbf4ee320 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:34.000118 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-503e3ec9-56cf-4eeb-983f-aebbbf4ee320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3efa5cb9e39649ccbdf069578aa48102', 'request_id': 'req-503e3ec9-56cf-4eeb-983f-aebbbf4ee320'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:34.013455 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-503e3ec9-56cf-4eeb-983f-aebbbf4ee320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3efa5cb9e39649ccbdf069578aa48102', 'request_id': 'req-503e3ec9-56cf-4eeb-983f-aebbbf4ee320'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:34.025010 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-503e3ec9-56cf-4eeb-983f-aebbbf4ee320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3efa5cb9e39649ccbdf069578aa48102', 'request_id': 'req-503e3ec9-56cf-4eeb-983f-aebbbf4ee320'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:34.048759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-503e3ec9-56cf-4eeb-983f-aebbbf4ee320 admin admin] The token cache is being invalidate because project 3efa5cb9e39649ccbdf069578aa48102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:34.049057 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-503e3ec9-56cf-4eeb-983f-aebbbf4ee320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:34.049746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-503e3ec9-56cf-4eeb-983f-aebbbf4ee320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:34.052411 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 920/1856] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:33 2022] DELETE /identity/v3/projects/3efa5cb9e39649ccbdf069578aa48102 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:34.056240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf16c9a-ca8b-4fce-a151-4a77129d43e3 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:34.070619 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf16c9a-ca8b-4fce-a151-4a77129d43e3 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:34.150359 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e3ec9-56cf-4eeb-983f-aebbbf4ee320 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:34.151975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-503e3ec9-56cf-4eeb-983f-aebbbf4ee320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:34.214439 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34207f-c1e7-45a3-a4d1-f8b2b960a2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:34.215094 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34207f-c1e7-45a3-a4d1-f8b2b960a2fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:34.216317 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34207f-c1e7-45a3-a4d1-f8b2b960a2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:34.216591 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34207f-c1e7-45a3-a4d1-f8b2b960a2fa admin admin] PATH_INFO: `/v3/users/9a02ffab47e749f1b2b58cdec8b72751` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:34.219893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34207f-c1e7-45a3-a4d1-f8b2b960a2fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a02ffab47e749f1b2b58cdec8b72751)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:34.225692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34207f-c1e7-45a3-a4d1-f8b2b960a2fa admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:34.334425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e3ec9-56cf-4eeb-983f-aebbbf4ee320 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:34.366373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3239f26-3c26-40ac-95ae-2b905994da3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:34.367041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3239f26-3c26-40ac-95ae-2b905994da3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:34.367332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3239f26-3c26-40ac-95ae-2b905994da3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:34.367649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3239f26-3c26-40ac-95ae-2b905994da3c admin admin] PATH_INFO: `/v3/projects/f5545a6266bf4f9281084acb47da84fe` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:34.378007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3239f26-3c26-40ac-95ae-2b905994da3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5545a6266bf4f9281084acb47da84fe)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:34.380243 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3239f26-3c26-40ac-95ae-2b905994da3c admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:34.393024 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2d34207f-c1e7-45a3-a4d1-f8b2b960a2fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a02ffab47e749f1b2b58cdec8b72751'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:34.395135 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2d34207f-c1e7-45a3-a4d1-f8b2b960a2fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a02ffab47e749f1b2b58cdec8b72751'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:34.424830 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2d34207f-c1e7-45a3-a4d1-f8b2b960a2fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a02ffab47e749f1b2b58cdec8b72751'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:34.445591 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2d34207f-c1e7-45a3-a4d1-f8b2b960a2fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a02ffab47e749f1b2b58cdec8b72751'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:34.446277 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2d34207f-c1e7-45a3-a4d1-f8b2b960a2fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a02ffab47e749f1b2b58cdec8b72751'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:34.460516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:34.497197 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 937/1857] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:34 2022] DELETE /identity/v3/users/9a02ffab47e749f1b2b58cdec8b72751 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:34.532853 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-a3239f26-3c26-40ac-95ae-2b905994da3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5545a6266bf4f9281084acb47da84fe', 'request_id': 'req-a3239f26-3c26-40ac-95ae-2b905994da3c'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:34.540672 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-a3239f26-3c26-40ac-95ae-2b905994da3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5545a6266bf4f9281084acb47da84fe', 'request_id': 'req-a3239f26-3c26-40ac-95ae-2b905994da3c'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:34.576143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-a3239f26-3c26-40ac-95ae-2b905994da3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5545a6266bf4f9281084acb47da84fe', 'request_id': 'req-a3239f26-3c26-40ac-95ae-2b905994da3c'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:34.614050 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-a3239f26-3c26-40ac-95ae-2b905994da3c admin admin] The token cache is being invalidate because project f5545a6266bf4f9281084acb47da84fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:34.614589 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-a3239f26-3c26-40ac-95ae-2b905994da3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:34.615928 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-a3239f26-3c26-40ac-95ae-2b905994da3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:34.620674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 921/1858] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:34 2022] DELETE /identity/v3/projects/f5545a6266bf4f9281084acb47da84fe => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:34.625071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34207f-c1e7-45a3-a4d1-f8b2b960a2fa admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:34.627266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-2d34207f-c1e7-45a3-a4d1-f8b2b960a2fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:34.750341 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34207f-c1e7-45a3-a4d1-f8b2b960a2fa admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:34.821205 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc9062-7514-4026-976e-4ee14f7e8333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:34.822152 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc9062-7514-4026-976e-4ee14f7e8333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:34.822436 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc9062-7514-4026-976e-4ee14f7e8333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:34.822710 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc9062-7514-4026-976e-4ee14f7e8333 admin admin] PATH_INFO: `/v3/users/3987ad4588f54314a27999c8e889b695` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:34.823936 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc9062-7514-4026-976e-4ee14f7e8333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3987ad4588f54314a27999c8e889b695)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:34.825871 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc9062-7514-4026-976e-4ee14f7e8333 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:34.887836 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-69fc9062-7514-4026-976e-4ee14f7e8333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3987ad4588f54314a27999c8e889b695'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:34.888589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-69fc9062-7514-4026-976e-4ee14f7e8333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3987ad4588f54314a27999c8e889b695'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:34.900834 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-69fc9062-7514-4026-976e-4ee14f7e8333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3987ad4588f54314a27999c8e889b695'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:34.913984 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-69fc9062-7514-4026-976e-4ee14f7e8333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3987ad4588f54314a27999c8e889b695'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:34.916229 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-69fc9062-7514-4026-976e-4ee14f7e8333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3987ad4588f54314a27999c8e889b695'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:34.957264 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 938/1859] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:34 2022] DELETE /identity/v3/users/3987ad4588f54314a27999c8e889b695 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:35.393428 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3239f26-3c26-40ac-95ae-2b905994da3c admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:35.395311 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-a3239f26-3c26-40ac-95ae-2b905994da3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:35.445327 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3239f26-3c26-40ac-95ae-2b905994da3c admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:35.483576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:35.625746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccfdc8-1ed4-4339-b90f-cead3e14dfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:35.626416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccfdc8-1ed4-4339-b90f-cead3e14dfc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:35.626698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccfdc8-1ed4-4339-b90f-cead3e14dfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:35.626975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccfdc8-1ed4-4339-b90f-cead3e14dfc0 admin admin] PATH_INFO: `/v3/projects/4b9b12d275864298bb25d75b3b928671` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:35.628350 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ccfdc8-1ed4-4339-b90f-cead3e14dfc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b9b12d275864298bb25d75b3b928671)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:35.630624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ccfdc8-1ed4-4339-b90f-cead3e14dfc0 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:35.720880 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-d5ccfdc8-1ed4-4339-b90f-cead3e14dfc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b9b12d275864298bb25d75b3b928671', 'request_id': 'req-d5ccfdc8-1ed4-4339-b90f-cead3e14dfc0'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:35.731628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-d5ccfdc8-1ed4-4339-b90f-cead3e14dfc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b9b12d275864298bb25d75b3b928671', 'request_id': 'req-d5ccfdc8-1ed4-4339-b90f-cead3e14dfc0'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:35.744753 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-d5ccfdc8-1ed4-4339-b90f-cead3e14dfc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b9b12d275864298bb25d75b3b928671', 'request_id': 'req-d5ccfdc8-1ed4-4339-b90f-cead3e14dfc0'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:35.762330 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-d5ccfdc8-1ed4-4339-b90f-cead3e14dfc0 admin admin] The token cache is being invalidate because project 4b9b12d275864298bb25d75b3b928671 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:35.762697 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-d5ccfdc8-1ed4-4339-b90f-cead3e14dfc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:35.763335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-d5ccfdc8-1ed4-4339-b90f-cead3e14dfc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:35.765836 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 922/1860] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:35 2022] DELETE /identity/v3/projects/4b9b12d275864298bb25d75b3b928671 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:35.772884 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879564e-4ad4-462c-8e62-0ffcf246227b None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:35.774993 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879564e-4ad4-462c-8e62-0ffcf246227b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:35.775679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879564e-4ad4-462c-8e62-0ffcf246227b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:35.812366 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-9879564e-4ad4-462c-8e62-0ffcf246227b None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:35.822151 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9879564e-4ad4-462c-8e62-0ffcf246227b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:35.832483 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:35.915261 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 939/1861] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:35.927793 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6c685-d8d8-47ee-b545-d9b6a490e64a None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:35.928112 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6c685-d8d8-47ee-b545-d9b6a490e64a None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:35.930126 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6c685-d8d8-47ee-b545-d9b6a490e64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:35.959502 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-22a6c685-d8d8-47ee-b545-d9b6a490e64a None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:35.960908 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-22a6c685-d8d8-47ee-b545-d9b6a490e64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:35.977948 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 923/1862] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:35.979899 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879564e-4ad4-462c-8e62-0ffcf246227b None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:35.994624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879564e-4ad4-462c-8e62-0ffcf246227b None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:36.022620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6c685-d8d8-47ee-b545-d9b6a490e64a None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:36.024848 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6aebf-9afa-416c-bd35-9a2e9046db0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:36.025489 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6aebf-9afa-416c-bd35-9a2e9046db0e admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:36.025897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6aebf-9afa-416c-bd35-9a2e9046db0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:36.026131 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6aebf-9afa-416c-bd35-9a2e9046db0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:36.027480 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6aebf-9afa-416c-bd35-9a2e9046db0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:15:36.027803 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6aebf-9afa-416c-bd35-9a2e9046db0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:36.028408 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-22a6c685-d8d8-47ee-b545-d9b6a490e64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:36.041145 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6aebf-9afa-416c-bd35-9a2e9046db0e admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:36.059367 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6c685-d8d8-47ee-b545-d9b6a490e64a None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:36.067740 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e7cc2-df7e-4d8f-b948-9fd97642fee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:36.068640 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e7cc2-df7e-4d8f-b948-9fd97642fee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:36.069188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e7cc2-df7e-4d8f-b948-9fd97642fee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:36.071306 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e7cc2-df7e-4d8f-b948-9fd97642fee4 admin admin] PATH_INFO: `/v3/projects/d7d8d3ed5dcd42518762e6e001f51579` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:36.072801 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e7cc2-df7e-4d8f-b948-9fd97642fee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7d8d3ed5dcd42518762e6e001f51579)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:36.078696 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e7cc2-df7e-4d8f-b948-9fd97642fee4 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:36.089379 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 940/1863] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:15:36.095771 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6aebf-9afa-416c-bd35-9a2e9046db0e admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:36.127912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6aebf-9afa-416c-bd35-9a2e9046db0e admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:36.141897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941afb1c-586e-4f8b-86de-9a13e398313e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:36.142877 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941afb1c-586e-4f8b-86de-9a13e398313e admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:36.144111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941afb1c-586e-4f8b-86de-9a13e398313e admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:36.145307 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941afb1c-586e-4f8b-86de-9a13e398313e admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:36.148397 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941afb1c-586e-4f8b-86de-9a13e398313e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:36.153735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941afb1c-586e-4f8b-86de-9a13e398313e admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:36.207146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 941/1864] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:36 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:36.209155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941afb1c-586e-4f8b-86de-9a13e398313e admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:36.218158 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-ef2e7cc2-df7e-4d8f-b948-9fd97642fee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7d8d3ed5dcd42518762e6e001f51579', 'request_id': 'req-ef2e7cc2-df7e-4d8f-b948-9fd97642fee4'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:36.228284 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-ef2e7cc2-df7e-4d8f-b948-9fd97642fee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7d8d3ed5dcd42518762e6e001f51579', 'request_id': 'req-ef2e7cc2-df7e-4d8f-b948-9fd97642fee4'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:36.244926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-ef2e7cc2-df7e-4d8f-b948-9fd97642fee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7d8d3ed5dcd42518762e6e001f51579', 'request_id': 'req-ef2e7cc2-df7e-4d8f-b948-9fd97642fee4'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:36.278054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-ef2e7cc2-df7e-4d8f-b948-9fd97642fee4 admin admin] The token cache is being invalidate because project d7d8d3ed5dcd42518762e6e001f51579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:36.278592 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-ef2e7cc2-df7e-4d8f-b948-9fd97642fee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:36.279380 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-ef2e7cc2-df7e-4d8f-b948-9fd97642fee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:36.281680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 924/1865] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:36 2022] DELETE /identity/v3/projects/d7d8d3ed5dcd42518762e6e001f51579 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:36.286266 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e7cc2-df7e-4d8f-b948-9fd97642fee4 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:36.288354 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-ef2e7cc2-df7e-4d8f-b948-9fd97642fee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:36.319873 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941afb1c-586e-4f8b-86de-9a13e398313e admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:36.322282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:36.328668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07b2f9-5454-422c-8787-5feb1fd4673a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:36.329834 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07b2f9-5454-422c-8787-5feb1fd4673a admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:36.330540 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07b2f9-5454-422c-8787-5feb1fd4673a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:36.331308 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07b2f9-5454-422c-8787-5feb1fd4673a admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:36.332813 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07b2f9-5454-422c-8787-5feb1fd4673a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:36.335889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07b2f9-5454-422c-8787-5feb1fd4673a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:36.377305 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 942/1866] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:36 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:36.379406 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07b2f9-5454-422c-8787-5feb1fd4673a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:36.381464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-1b07b2f9-5454-422c-8787-5feb1fd4673a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:36.405784 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07b2f9-5454-422c-8787-5feb1fd4673a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:36.420030 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e7cc2-df7e-4d8f-b948-9fd97642fee4 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:36.422342 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc560646-0e26-4e42-9e68-99f3626ff348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:36.423062 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc560646-0e26-4e42-9e68-99f3626ff348 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:36.423300 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc560646-0e26-4e42-9e68-99f3626ff348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:36.423979 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc560646-0e26-4e42-9e68-99f3626ff348 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:36.424899 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc560646-0e26-4e42-9e68-99f3626ff348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:36.426196 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f810f-9a3a-4339-aad9-303ba990fbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:36.426937 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f810f-9a3a-4339-aad9-303ba990fbd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:36.427068 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f810f-9a3a-4339-aad9-303ba990fbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:36.427338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f810f-9a3a-4339-aad9-303ba990fbd5 admin admin] PATH_INFO: `/v3/users/64823aafdeb84361996819a76320404a` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:36.427950 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc560646-0e26-4e42-9e68-99f3626ff348 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:36.428790 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f810f-9a3a-4339-aad9-303ba990fbd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64823aafdeb84361996819a76320404a)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:36.431414 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f810f-9a3a-4339-aad9-303ba990fbd5 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:36.443059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 943/1867] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:36.447105 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc560646-0e26-4e42-9e68-99f3626ff348 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:36.458730 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc560646-0e26-4e42-9e68-99f3626ff348 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:36.465315 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8236c-b094-4772-a6cf-ee31070372fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:36.465927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8236c-b094-4772-a6cf-ee31070372fc admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:36.466319 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8236c-b094-4772-a6cf-ee31070372fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:36.466598 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8236c-b094-4772-a6cf-ee31070372fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:36.467243 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8236c-b094-4772-a6cf-ee31070372fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:36.468929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8236c-b094-4772-a6cf-ee31070372fc admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:36.480292 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 944/1868] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:15:36.484751 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8236c-b094-4772-a6cf-ee31070372fc admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:36.492335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-f77f810f-9a3a-4339-aad9-303ba990fbd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64823aafdeb84361996819a76320404a'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:36.497914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8236c-b094-4772-a6cf-ee31070372fc admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:36.503525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be88ac-d84e-4763-940f-7308580a5c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:36.504190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be88ac-d84e-4763-940f-7308580a5c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:36.504486 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be88ac-d84e-4763-940f-7308580a5c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:36.504785 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be88ac-d84e-4763-940f-7308580a5c0b admin admin] PATH_INFO: `/v3/projects/17a330414c4c4840a115f243aa930cc5/users/ddc85e8ad79e4d0fa681c5a7127b887e/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:36.507375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-f77f810f-9a3a-4339-aad9-303ba990fbd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64823aafdeb84361996819a76320404a'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:36.508125 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-f77f810f-9a3a-4339-aad9-303ba990fbd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64823aafdeb84361996819a76320404a'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:36.517324 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-f77f810f-9a3a-4339-aad9-303ba990fbd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64823aafdeb84361996819a76320404a'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:36.523121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be88ac-d84e-4763-940f-7308580a5c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=17a330414c4c4840a115f243aa930cc5, user_id=ddc85e8ad79e4d0fa681c5a7127b887e, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:36.525221 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-f77f810f-9a3a-4339-aad9-303ba990fbd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64823aafdeb84361996819a76320404a'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:36.526560 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be88ac-d84e-4763-940f-7308580a5c0b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:36.533032 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 925/1869] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:36 2022] DELETE /identity/v3/users/64823aafdeb84361996819a76320404a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:36.541161 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 945/1870] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:36 2022] PUT /identity/v3/projects/17a330414c4c4840a115f243aa930cc5/users/ddc85e8ad79e4d0fa681c5a7127b887e/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:36.552808 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c63b4-6b2b-4ee8-9cb7-ca536595f70e None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:36.553313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c63b4-6b2b-4ee8-9cb7-ca536595f70e None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:36.553736 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c63b4-6b2b-4ee8-9cb7-ca536595f70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:36.604490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-9a8c63b4-6b2b-4ee8-9cb7-ca536595f70e None None] MFA Rules not processed for user `ddc85e8ad79e4d0fa681c5a7127b887e`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:36.605971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-9a8c63b4-6b2b-4ee8-9cb7-ca536595f70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:36.693791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 926/1871] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:15:36.698663 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be88ac-d84e-4763-940f-7308580a5c0b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:36.701004 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-07be88ac-d84e-4763-940f-7308580a5c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:36.740041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:36.804581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be88ac-d84e-4763-940f-7308580a5c0b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:36.810132 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5429433-2b9d-4453-aafb-033a24a2ca28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:36.811178 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5429433-2b9d-4453-aafb-033a24a2ca28 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:36.811512 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5429433-2b9d-4453-aafb-033a24a2ca28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:36.811914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5429433-2b9d-4453-aafb-033a24a2ca28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:36.812954 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5429433-2b9d-4453-aafb-033a24a2ca28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:36.814883 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5429433-2b9d-4453-aafb-033a24a2ca28 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:36.851073 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c63b4-6b2b-4ee8-9cb7-ca536595f70e None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:36.858664 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 946/1872] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:36 2022] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:15:36.869039 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c63b4-6b2b-4ee8-9cb7-ca536595f70e None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:36.898088 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:36.941968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dd2db-74aa-49fe-af79-314beb09a540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:36.942630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dd2db-74aa-49fe-af79-314beb09a540 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:36.942911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dd2db-74aa-49fe-af79-314beb09a540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:36.943184 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dd2db-74aa-49fe-af79-314beb09a540 admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:36.944004 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8dd2db-74aa-49fe-af79-314beb09a540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:36.946294 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8dd2db-74aa-49fe-af79-314beb09a540 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:36.976488 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 927/1873] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:36 2022] POST /identity/v3/users => generated 295 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:36.980870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5429433-2b9d-4453-aafb-033a24a2ca28 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:36.994753 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5429433-2b9d-4453-aafb-033a24a2ca28 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:37.005112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb44043-6afb-4e51-af0f-a27c35833f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:37.005112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb44043-6afb-4e51-af0f-a27c35833f14 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:37.005112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb44043-6afb-4e51-af0f-a27c35833f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:37.005112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb44043-6afb-4e51-af0f-a27c35833f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:37.005507 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb44043-6afb-4e51-af0f-a27c35833f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:37.007140 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb44043-6afb-4e51-af0f-a27c35833f14 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:37.043584 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 947/1874] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:37.044512 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dd2db-74aa-49fe-af79-314beb09a540 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:37.056977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dd2db-74aa-49fe-af79-314beb09a540 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:37.074393 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31234ae9-3f42-49a7-9339-8036b2dee397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:37.074760 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31234ae9-3f42-49a7-9339-8036b2dee397 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:37.075042 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31234ae9-3f42-49a7-9339-8036b2dee397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:37.075316 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31234ae9-3f42-49a7-9339-8036b2dee397 admin admin] PATH_INFO: `/v3/projects/61df2c3cc0df4dfcb798e1026b516d5c/users/889c98e0496d4453a1ac28cfaac71a1a/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:37.102331 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31234ae9-3f42-49a7-9339-8036b2dee397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61df2c3cc0df4dfcb798e1026b516d5c, user_id=889c98e0496d4453a1ac28cfaac71a1a, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:37.111351 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31234ae9-3f42-49a7-9339-8036b2dee397 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:37.136536 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 928/1875] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:37 2022] PUT /identity/v3/projects/61df2c3cc0df4dfcb798e1026b516d5c/users/889c98e0496d4453a1ac28cfaac71a1a/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:37.142153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb44043-6afb-4e51-af0f-a27c35833f14 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:37.156706 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb44043-6afb-4e51-af0f-a27c35833f14 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:37.252786 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd4b21-6a88-465e-8eea-e77143907804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:37.253433 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd4b21-6a88-465e-8eea-e77143907804 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:37.253866 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd4b21-6a88-465e-8eea-e77143907804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:37.255169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd4b21-6a88-465e-8eea-e77143907804 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:37.255169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd4b21-6a88-465e-8eea-e77143907804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:37.256793 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd4b21-6a88-465e-8eea-e77143907804 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:37.277452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 948/1876] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:37.279054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31234ae9-3f42-49a7-9339-8036b2dee397 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:37.294114 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31234ae9-3f42-49a7-9339-8036b2dee397 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:37.299216 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072f3f4-ac0a-4d2c-b2c1-7ec8927af32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:37.300298 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072f3f4-ac0a-4d2c-b2c1-7ec8927af32b admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:37.300465 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072f3f4-ac0a-4d2c-b2c1-7ec8927af32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:37.300780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072f3f4-ac0a-4d2c-b2c1-7ec8927af32b admin admin] PATH_INFO: `/v3/projects/61df2c3cc0df4dfcb798e1026b516d5c/users/889c98e0496d4453a1ac28cfaac71a1a/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:37.302901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072f3f4-ac0a-4d2c-b2c1-7ec8927af32b admin admin] RBAC: Authorizing `identity:create_grant(project_id=61df2c3cc0df4dfcb798e1026b516d5c, user_id=889c98e0496d4453a1ac28cfaac71a1a, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:37.305654 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072f3f4-ac0a-4d2c-b2c1-7ec8927af32b admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:37.329130 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 929/1877] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:37 2022] PUT /identity/v3/projects/61df2c3cc0df4dfcb798e1026b516d5c/users/889c98e0496d4453a1ac28cfaac71a1a/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:37.331944 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb57b51-f88b-424a-95ca-056508ac49e4 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:37.332315 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb57b51-f88b-424a-95ca-056508ac49e4 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:37.332722 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb57b51-f88b-424a-95ca-056508ac49e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:37.372341 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-6eb57b51-f88b-424a-95ca-056508ac49e4 None None] MFA Rules not processed for user `889c98e0496d4453a1ac28cfaac71a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:37.373661 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6eb57b51-f88b-424a-95ca-056508ac49e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:37.498504 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 949/1878] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:37.526068 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072f3f4-ac0a-4d2c-b2c1-7ec8927af32b admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:37.529486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-8072f3f4-ac0a-4d2c-b2c1-7ec8927af32b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:37.643427 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb57b51-f88b-424a-95ca-056508ac49e4 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:37.645132 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6eb57b51-f88b-424a-95ca-056508ac49e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:37.677728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072f3f4-ac0a-4d2c-b2c1-7ec8927af32b admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:37.681660 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:37.688822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364e77d-4168-4ba7-8788-bec0c7dc8c0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:37.689683 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364e77d-4168-4ba7-8788-bec0c7dc8c0c service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:37.690081 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364e77d-4168-4ba7-8788-bec0c7dc8c0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:37.690501 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364e77d-4168-4ba7-8788-bec0c7dc8c0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:37.771070 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb57b51-f88b-424a-95ca-056508ac49e4 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:37.772050 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f364e77d-4168-4ba7-8788-bec0c7dc8c0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:37.775916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f364e77d-4168-4ba7-8788-bec0c7dc8c0c service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:37.785971 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5a41e-2bf0-4d7e-9242-8396021f1339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:37.787940 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5a41e-2bf0-4d7e-9242-8396021f1339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:37.788484 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5a41e-2bf0-4d7e-9242-8396021f1339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:37.789163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5a41e-2bf0-4d7e-9242-8396021f1339 admin admin] PATH_INFO: `/v3/users/cd74f89c10274c73b404208633164627` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:37.795470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5a41e-2bf0-4d7e-9242-8396021f1339 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd74f89c10274c73b404208633164627)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:37.800451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5a41e-2bf0-4d7e-9242-8396021f1339 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:37.805888 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 930/1879] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:37.865590 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7ba5a41e-2bf0-4d7e-9242-8396021f1339 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd74f89c10274c73b404208633164627'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:37.866352 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7ba5a41e-2bf0-4d7e-9242-8396021f1339 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd74f89c10274c73b404208633164627'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:37.875511 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7ba5a41e-2bf0-4d7e-9242-8396021f1339 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd74f89c10274c73b404208633164627'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:37.884647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7ba5a41e-2bf0-4d7e-9242-8396021f1339 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd74f89c10274c73b404208633164627'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:37.885357 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7ba5a41e-2bf0-4d7e-9242-8396021f1339 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd74f89c10274c73b404208633164627'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:37.912907 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d2939-8d82-4cf7-9370-46d0736aeccd None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:37.913191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d2939-8d82-4cf7-9370-46d0736aeccd None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:37.913462 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d2939-8d82-4cf7-9370-46d0736aeccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:37.917039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 950/1880] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:37 2022] DELETE /identity/v3/users/cd74f89c10274c73b404208633164627 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:37.954997 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-000d2939-8d82-4cf7-9370-46d0736aeccd None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:37.954997 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-000d2939-8d82-4cf7-9370-46d0736aeccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:37.998725 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:38.045930 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 931/1881] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:38.056940 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5a41e-2bf0-4d7e-9242-8396021f1339 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:38.059301 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7ba5a41e-2bf0-4d7e-9242-8396021f1339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:38.079520 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d2939-8d82-4cf7-9370-46d0736aeccd None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:38.081475 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-000d2939-8d82-4cf7-9370-46d0736aeccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:38.096711 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d2939-8d82-4cf7-9370-46d0736aeccd None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:38.102769 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df90c14-780b-485f-9d7c-04eaa74af466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:38.103753 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df90c14-780b-485f-9d7c-04eaa74af466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:38.103853 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df90c14-780b-485f-9d7c-04eaa74af466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:38.104130 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df90c14-780b-485f-9d7c-04eaa74af466 admin admin] PATH_INFO: `/v3/projects/13d2510a4cb947c4b0f30c0a85627323` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:38.106354 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df90c14-780b-485f-9d7c-04eaa74af466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13d2510a4cb947c4b0f30c0a85627323)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:38.108349 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df90c14-780b-485f-9d7c-04eaa74af466 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:38.162634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5a41e-2bf0-4d7e-9242-8396021f1339 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:38.172710 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-5df90c14-780b-485f-9d7c-04eaa74af466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13d2510a4cb947c4b0f30c0a85627323', 'request_id': 'req-5df90c14-780b-485f-9d7c-04eaa74af466'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:38.182341 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-5df90c14-780b-485f-9d7c-04eaa74af466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13d2510a4cb947c4b0f30c0a85627323', 'request_id': 'req-5df90c14-780b-485f-9d7c-04eaa74af466'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:38.192861 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-5df90c14-780b-485f-9d7c-04eaa74af466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13d2510a4cb947c4b0f30c0a85627323', 'request_id': 'req-5df90c14-780b-485f-9d7c-04eaa74af466'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:38.207973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-5df90c14-780b-485f-9d7c-04eaa74af466 admin admin] The token cache is being invalidate because project 13d2510a4cb947c4b0f30c0a85627323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:38.208273 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-5df90c14-780b-485f-9d7c-04eaa74af466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:38.209290 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-5df90c14-780b-485f-9d7c-04eaa74af466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:38.227460 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 932/1882] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:38 2022] DELETE /identity/v3/projects/13d2510a4cb947c4b0f30c0a85627323 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:38.227460 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678df38-f3a8-4c8a-b71b-7dc3f11efb32 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:38.227460 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678df38-f3a8-4c8a-b71b-7dc3f11efb32 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:38.227460 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678df38-f3a8-4c8a-b71b-7dc3f11efb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:38.251954 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-d678df38-f3a8-4c8a-b71b-7dc3f11efb32 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:38.253406 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-d678df38-f3a8-4c8a-b71b-7dc3f11efb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:38.263769 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff68f4-6a69-4c55-b9dc-ddeab61e1a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:38.264399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff68f4-6a69-4c55-b9dc-ddeab61e1a4f service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:38.265037 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff68f4-6a69-4c55-b9dc-ddeab61e1a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:38.265318 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff68f4-6a69-4c55-b9dc-ddeab61e1a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:38.276541 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-13ff68f4-6a69-4c55-b9dc-ddeab61e1a4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:38.282988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:38.386424 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff68f4-6a69-4c55-b9dc-ddeab61e1a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:38.387914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff68f4-6a69-4c55-b9dc-ddeab61e1a4f service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:38.397892 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 951/1883] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:15:38.416072 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 933/1884] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:38.424896 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6b121-f8cd-49c3-9f8b-00912145c087 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:38.425187 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6b121-f8cd-49c3-9f8b-00912145c087 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:38.425563 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6b121-f8cd-49c3-9f8b-00912145c087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:38.453238 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-c4d6b121-f8cd-49c3-9f8b-00912145c087 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:38.454506 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c4d6b121-f8cd-49c3-9f8b-00912145c087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:38.468049 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 952/1885] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:38.468994 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678df38-f3a8-4c8a-b71b-7dc3f11efb32 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:38.479400 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678df38-f3a8-4c8a-b71b-7dc3f11efb32 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:38.485667 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd58c56-96ab-49b1-8f3d-ac1e2b37d2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:38.486390 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd58c56-96ab-49b1-8f3d-ac1e2b37d2fd admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:38.486674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd58c56-96ab-49b1-8f3d-ac1e2b37d2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:38.486945 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd58c56-96ab-49b1-8f3d-ac1e2b37d2fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:38.489243 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd58c56-96ab-49b1-8f3d-ac1e2b37d2fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:15:38.489243 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd58c56-96ab-49b1-8f3d-ac1e2b37d2fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:38.491246 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd58c56-96ab-49b1-8f3d-ac1e2b37d2fd admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:38.505269 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 934/1886] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:15:38.509690 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6b121-f8cd-49c3-9f8b-00912145c087 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:38.528099 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6b121-f8cd-49c3-9f8b-00912145c087 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:38.535268 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3c623-40b3-44c0-86f1-6a86f04292d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:38.536501 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3c623-40b3-44c0-86f1-6a86f04292d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:38.536775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3c623-40b3-44c0-86f1-6a86f04292d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:38.537161 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3c623-40b3-44c0-86f1-6a86f04292d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:38.537897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3c623-40b3-44c0-86f1-6a86f04292d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:38.540080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3c623-40b3-44c0-86f1-6a86f04292d4 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:38.591490 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 953/1887] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:38 2022] POST /identity/v3/projects => generated 387 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:38.594593 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd58c56-96ab-49b1-8f3d-ac1e2b37d2fd admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:38.607059 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd58c56-96ab-49b1-8f3d-ac1e2b37d2fd admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:38.663290 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:38.678241 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7457b1-0222-45aa-8405-7bcd9183a1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:38.678871 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7457b1-0222-45aa-8405-7bcd9183a1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:38.679152 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7457b1-0222-45aa-8405-7bcd9183a1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:38.679718 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7457b1-0222-45aa-8405-7bcd9183a1c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:38.680563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7457b1-0222-45aa-8405-7bcd9183a1c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:38.683484 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7457b1-0222-45aa-8405-7bcd9183a1c2 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:38.727233 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 935/1888] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:38 2022] POST /identity/v3/users => generated 294 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:15:38.731679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3c623-40b3-44c0-86f1-6a86f04292d4 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:38.747419 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3c623-40b3-44c0-86f1-6a86f04292d4 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:38.752774 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50095e86-ba30-4d16-b8ec-103e436b20a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:38.753451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50095e86-ba30-4d16-b8ec-103e436b20a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:38.753737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50095e86-ba30-4d16-b8ec-103e436b20a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:38.754010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50095e86-ba30-4d16-b8ec-103e436b20a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:38.754674 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50095e86-ba30-4d16-b8ec-103e436b20a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:38.756409 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50095e86-ba30-4d16-b8ec-103e436b20a6 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:38.771822 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 954/1889] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:38.773618 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7457b1-0222-45aa-8405-7bcd9183a1c2 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:38.785791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7457b1-0222-45aa-8405-7bcd9183a1c2 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:38.791605 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f326b-5c1e-4700-aefe-f0ee107d4fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:38.792391 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f326b-5c1e-4700-aefe-f0ee107d4fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:38.792727 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f326b-5c1e-4700-aefe-f0ee107d4fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:38.793068 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f326b-5c1e-4700-aefe-f0ee107d4fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:38.793791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f326b-5c1e-4700-aefe-f0ee107d4fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:38.795501 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f326b-5c1e-4700-aefe-f0ee107d4fd4 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:38.809654 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 936/1890] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:38.826296 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50095e86-ba30-4d16-b8ec-103e436b20a6 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:38.837436 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50095e86-ba30-4d16-b8ec-103e436b20a6 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:38.842404 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a358ff-f400-4e55-af77-ff72c7fea8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:38.843187 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a358ff-f400-4e55-af77-ff72c7fea8f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:38.843495 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a358ff-f400-4e55-af77-ff72c7fea8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:38.843774 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a358ff-f400-4e55-af77-ff72c7fea8f6 admin admin] PATH_INFO: `/v3/projects/10fc737c47384531a5bdaced0a645212/users/53e4316ab73e4c6390d4db1ec234ab06/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:38.875765 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a358ff-f400-4e55-af77-ff72c7fea8f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10fc737c47384531a5bdaced0a645212, user_id=53e4316ab73e4c6390d4db1ec234ab06, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:38.878487 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a358ff-f400-4e55-af77-ff72c7fea8f6 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:38.894585 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 955/1891] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:38 2022] PUT /identity/v3/projects/10fc737c47384531a5bdaced0a645212/users/53e4316ab73e4c6390d4db1ec234ab06/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:38.908827 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923b9af-6b99-457a-943a-e4ebaf674970 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:38.909139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923b9af-6b99-457a-943a-e4ebaf674970 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:38.909795 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923b9af-6b99-457a-943a-e4ebaf674970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:38.952771 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-1923b9af-6b99-457a-943a-e4ebaf674970 None None] MFA Rules not processed for user `53e4316ab73e4c6390d4db1ec234ab06`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:38.954359 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-1923b9af-6b99-457a-943a-e4ebaf674970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:39.071143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 937/1892] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:39.072358 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a358ff-f400-4e55-af77-ff72c7fea8f6 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:39.086909 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923b9af-6b99-457a-943a-e4ebaf674970 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:39.088375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-1923b9af-6b99-457a-943a-e4ebaf674970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:39.193014 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a358ff-f400-4e55-af77-ff72c7fea8f6 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:39.198752 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2854903-c557-4bcf-805e-611a0625d372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:39.199369 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2854903-c557-4bcf-805e-611a0625d372 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:39.199682 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2854903-c557-4bcf-805e-611a0625d372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:39.199947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2854903-c557-4bcf-805e-611a0625d372 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:39.200596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2854903-c557-4bcf-805e-611a0625d372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:39.202846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2854903-c557-4bcf-805e-611a0625d372 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:39.226624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923b9af-6b99-457a-943a-e4ebaf674970 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:39.234440 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cc4db-3c67-4f09-8b61-f7fc8f354476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:39.236118 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cc4db-3c67-4f09-8b61-f7fc8f354476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:39.236259 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cc4db-3c67-4f09-8b61-f7fc8f354476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:39.236474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cc4db-3c67-4f09-8b61-f7fc8f354476 admin admin] PATH_INFO: `/v3/projects/707515110b3049c5a08156135662cb48` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:39.238383 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cc4db-3c67-4f09-8b61-f7fc8f354476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=707515110b3049c5a08156135662cb48)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:39.241312 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cc4db-3c67-4f09-8b61-f7fc8f354476 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:39.260352 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 956/1893] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:39 2022] POST /identity/v3/projects => generated 389 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:39.262852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2854903-c557-4bcf-805e-611a0625d372 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:39.301325 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:39.345672 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-103cc4db-3c67-4f09-8b61-f7fc8f354476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '707515110b3049c5a08156135662cb48', 'request_id': 'req-103cc4db-3c67-4f09-8b61-f7fc8f354476'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:39.358109 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:39.361332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-103cc4db-3c67-4f09-8b61-f7fc8f354476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '707515110b3049c5a08156135662cb48', 'request_id': 'req-103cc4db-3c67-4f09-8b61-f7fc8f354476'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:39.382967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-103cc4db-3c67-4f09-8b61-f7fc8f354476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '707515110b3049c5a08156135662cb48', 'request_id': 'req-103cc4db-3c67-4f09-8b61-f7fc8f354476'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:39.427754 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2854903-c557-4bcf-805e-611a0625d372 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:39.434048 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-103cc4db-3c67-4f09-8b61-f7fc8f354476 admin admin] The token cache is being invalidate because project 707515110b3049c5a08156135662cb48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:39.434509 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-103cc4db-3c67-4f09-8b61-f7fc8f354476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:39.435276 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-103cc4db-3c67-4f09-8b61-f7fc8f354476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:39.438033 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 938/1894] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:39 2022] DELETE /identity/v3/projects/707515110b3049c5a08156135662cb48 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:39.438840 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cc4db-3c67-4f09-8b61-f7fc8f354476 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:39.442290 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-103cc4db-3c67-4f09-8b61-f7fc8f354476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:39.509536 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71c343-a54e-4552-9229-c6a8590be991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:39.510408 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71c343-a54e-4552-9229-c6a8590be991 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:39.510858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71c343-a54e-4552-9229-c6a8590be991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:39.511334 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71c343-a54e-4552-9229-c6a8590be991 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:39.512774 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71c343-a54e-4552-9229-c6a8590be991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:39.515045 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71c343-a54e-4552-9229-c6a8590be991 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:39.517119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cc4db-3c67-4f09-8b61-f7fc8f354476 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:39.520928 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca6025-23dd-458d-a863-872a93cb1f1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:39.521540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca6025-23dd-458d-a863-872a93cb1f1f service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:39.521821 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca6025-23dd-458d-a863-872a93cb1f1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:39.522091 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca6025-23dd-458d-a863-872a93cb1f1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:39.523916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-0aca6025-23dd-458d-a863-872a93cb1f1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:39.544176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 957/1895] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:39 2022] POST /identity/v3/users => generated 301 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:39.545243 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71c343-a54e-4552-9229-c6a8590be991 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:39.548866 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-dd71c343-a54e-4552-9229-c6a8590be991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:39.564550 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71c343-a54e-4552-9229-c6a8590be991 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:39.570098 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f67a3-fce7-44f8-800f-5f17df66f596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:39.570787 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f67a3-fce7-44f8-800f-5f17df66f596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:39.571069 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f67a3-fce7-44f8-800f-5f17df66f596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:39.571341 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f67a3-fce7-44f8-800f-5f17df66f596 admin admin] PATH_INFO: `/v3/users/3a5f7cced0db4566b9a55465e3ad1cd3` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:39.572703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f67a3-fce7-44f8-800f-5f17df66f596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a5f7cced0db4566b9a55465e3ad1cd3)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:39.574749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f67a3-fce7-44f8-800f-5f17df66f596 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:39.621606 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca6025-23dd-458d-a863-872a93cb1f1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:39.623521 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca6025-23dd-458d-a863-872a93cb1f1f service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:39.641520 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 939/1896] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:39.642894 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca6025-23dd-458d-a863-872a93cb1f1f service cinder] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:39.645101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-0aca6025-23dd-458d-a863-872a93cb1f1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:39.661806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ce3f67a3-fce7-44f8-800f-5f17df66f596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a5f7cced0db4566b9a55465e3ad1cd3'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:39.662555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ce3f67a3-fce7-44f8-800f-5f17df66f596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a5f7cced0db4566b9a55465e3ad1cd3'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:39.671952 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca6025-23dd-458d-a863-872a93cb1f1f service cinder] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:39.672396 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ce3f67a3-fce7-44f8-800f-5f17df66f596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a5f7cced0db4566b9a55465e3ad1cd3'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:39.682469 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ce3f67a3-fce7-44f8-800f-5f17df66f596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a5f7cced0db4566b9a55465e3ad1cd3'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:39.683375 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ce3f67a3-fce7-44f8-800f-5f17df66f596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a5f7cced0db4566b9a55465e3ad1cd3'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:39.684266 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c6ecc-9693-4f1f-aaca-bceec21f66aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:39.684969 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c6ecc-9693-4f1f-aaca-bceec21f66aa admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:39.687748 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c6ecc-9693-4f1f-aaca-bceec21f66aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:39.688030 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c6ecc-9693-4f1f-aaca-bceec21f66aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:39.688688 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c6ecc-9693-4f1f-aaca-bceec21f66aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:39.690332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c6ecc-9693-4f1f-aaca-bceec21f66aa admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:39.720752 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 940/1897] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:39.724504 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c6ecc-9693-4f1f-aaca-bceec21f66aa admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:39.727326 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-370c6ecc-9693-4f1f-aaca-bceec21f66aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:39.740337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 958/1898] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:39 2022] DELETE /identity/v3/users/3a5f7cced0db4566b9a55465e3ad1cd3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:39.743585 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c6ecc-9693-4f1f-aaca-bceec21f66aa admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:39.823305 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d51233-ad53-4ac1-9383-7f07b283ee23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:39.824016 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d51233-ad53-4ac1-9383-7f07b283ee23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:39.824302 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d51233-ad53-4ac1-9383-7f07b283ee23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:39.824624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d51233-ad53-4ac1-9383-7f07b283ee23 admin admin] PATH_INFO: `/v3/projects/bdcb751889bc420a893bd08a5142004f/users/65d1319e72e4454893ee5ce92e140240/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:39.869359 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d51233-ad53-4ac1-9383-7f07b283ee23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdcb751889bc420a893bd08a5142004f, user_id=65d1319e72e4454893ee5ce92e140240, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:39.873798 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d51233-ad53-4ac1-9383-7f07b283ee23 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:39.891541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 941/1899] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:39 2022] PUT /identity/v3/projects/bdcb751889bc420a893bd08a5142004f/users/65d1319e72e4454893ee5ce92e140240/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:39.895249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f67a3-fce7-44f8-800f-5f17df66f596 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:39.907890 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f67a3-fce7-44f8-800f-5f17df66f596 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:39.959000 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:40.059888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c5e48-ca07-43b0-89fb-73c688e983f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:40.060888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c5e48-ca07-43b0-89fb-73c688e983f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:40.061172 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c5e48-ca07-43b0-89fb-73c688e983f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:40.061444 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c5e48-ca07-43b0-89fb-73c688e983f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:40.063519 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c5e48-ca07-43b0-89fb-73c688e983f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:40.067479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c5e48-ca07-43b0-89fb-73c688e983f3 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:40.093125 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 959/1900] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:40.093988 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d51233-ad53-4ac1-9383-7f07b283ee23 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:40.105804 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d51233-ad53-4ac1-9383-7f07b283ee23 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:40.113440 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b74d7-644d-4ec9-8f37-b56041e214c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:40.114295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b74d7-644d-4ec9-8f37-b56041e214c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:40.114447 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b74d7-644d-4ec9-8f37-b56041e214c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:40.114740 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b74d7-644d-4ec9-8f37-b56041e214c9 admin admin] PATH_INFO: `/v3/projects/bdcb751889bc420a893bd08a5142004f/users/65d1319e72e4454893ee5ce92e140240/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:40.117221 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1b74d7-644d-4ec9-8f37-b56041e214c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdcb751889bc420a893bd08a5142004f, user_id=65d1319e72e4454893ee5ce92e140240, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:40.125506 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1b74d7-644d-4ec9-8f37-b56041e214c9 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:40.129030 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:40.142948 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 942/1901] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:40 2022] PUT /identity/v3/projects/bdcb751889bc420a893bd08a5142004f/users/65d1319e72e4454893ee5ce92e140240/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:40.153381 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c95527-5284-4b0c-a299-7bdc63fdb403 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:40.153806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c95527-5284-4b0c-a299-7bdc63fdb403 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:40.153926 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c95527-5284-4b0c-a299-7bdc63fdb403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:40.200727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-d7c95527-5284-4b0c-a299-7bdc63fdb403 None None] MFA Rules not processed for user `65d1319e72e4454893ee5ce92e140240`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:40.202249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d7c95527-5284-4b0c-a299-7bdc63fdb403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:40.319822 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 960/1902] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:40 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:40.338861 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b74d7-644d-4ec9-8f37-b56041e214c9 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:40.348506 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-bb1b74d7-644d-4ec9-8f37-b56041e214c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:40.393209 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c95527-5284-4b0c-a299-7bdc63fdb403 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:40.394632 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d7c95527-5284-4b0c-a299-7bdc63fdb403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:40.448072 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b74d7-644d-4ec9-8f37-b56041e214c9 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:40.452160 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a66f5f-e04d-4831-af31-6b0e9b54e720 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:40.452779 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a66f5f-e04d-4831-af31-6b0e9b54e720 service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:40.453055 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a66f5f-e04d-4831-af31-6b0e9b54e720 service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:40.453326 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a66f5f-e04d-4831-af31-6b0e9b54e720 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:40.465028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a66f5f-e04d-4831-af31-6b0e9b54e720 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:40.466482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a66f5f-e04d-4831-af31-6b0e9b54e720 service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:40.481548 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 943/1903] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:40 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:40.501988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c95527-5284-4b0c-a299-7bdc63fdb403 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:40.507276 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96869e8-1abb-465e-b0f7-8123ed8fa93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:40.508010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96869e8-1abb-465e-b0f7-8123ed8fa93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:40.508890 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96869e8-1abb-465e-b0f7-8123ed8fa93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:40.509177 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96869e8-1abb-465e-b0f7-8123ed8fa93d admin admin] PATH_INFO: `/v3/projects/fbdf5a40ece84ef3a3eabb5cd569dceb` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:40.510328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96869e8-1abb-465e-b0f7-8123ed8fa93d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbdf5a40ece84ef3a3eabb5cd569dceb)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:40.512791 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96869e8-1abb-465e-b0f7-8123ed8fa93d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:40.581907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b96869e8-1abb-465e-b0f7-8123ed8fa93d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbdf5a40ece84ef3a3eabb5cd569dceb', 'request_id': 'req-b96869e8-1abb-465e-b0f7-8123ed8fa93d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:40.587947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:40.592225 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b96869e8-1abb-465e-b0f7-8123ed8fa93d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbdf5a40ece84ef3a3eabb5cd569dceb', 'request_id': 'req-b96869e8-1abb-465e-b0f7-8123ed8fa93d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:40.606882 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b96869e8-1abb-465e-b0f7-8123ed8fa93d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbdf5a40ece84ef3a3eabb5cd569dceb', 'request_id': 'req-b96869e8-1abb-465e-b0f7-8123ed8fa93d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:40.624343 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b96869e8-1abb-465e-b0f7-8123ed8fa93d admin admin] The token cache is being invalidate because project fbdf5a40ece84ef3a3eabb5cd569dceb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:40.624735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b96869e8-1abb-465e-b0f7-8123ed8fa93d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:40.625530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b96869e8-1abb-465e-b0f7-8123ed8fa93d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:40.630718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 961/1904] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:40 2022] DELETE /identity/v3/projects/fbdf5a40ece84ef3a3eabb5cd569dceb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:40.631406 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a66f5f-e04d-4831-af31-6b0e9b54e720 service cinder] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:40.641956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a66f5f-e04d-4831-af31-6b0e9b54e720 service cinder] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:40.659123 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96869e8-1abb-465e-b0f7-8123ed8fa93d admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:40.660621 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b96869e8-1abb-465e-b0f7-8123ed8fa93d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:40.721593 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d47ab0-244d-4348-9ee6-e21f2c329174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:40.722368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d47ab0-244d-4348-9ee6-e21f2c329174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:40.722650 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d47ab0-244d-4348-9ee6-e21f2c329174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:40.723717 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d47ab0-244d-4348-9ee6-e21f2c329174 admin admin] PATH_INFO: `/v3/users/9b9bcd4f0d094b58b30f96aff16f0cb6` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:40.727327 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d47ab0-244d-4348-9ee6-e21f2c329174 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b9bcd4f0d094b58b30f96aff16f0cb6)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:40.733825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d47ab0-244d-4348-9ee6-e21f2c329174 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:40.748026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96869e8-1abb-465e-b0f7-8123ed8fa93d admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:40.754660 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b7313-719c-42ed-9caf-884dfadaeffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:40.755506 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b7313-719c-42ed-9caf-884dfadaeffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:40.755840 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b7313-719c-42ed-9caf-884dfadaeffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:40.756123 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b7313-719c-42ed-9caf-884dfadaeffc admin admin] PATH_INFO: `/v3/users/53e4316ab73e4c6390d4db1ec234ab06` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:40.758722 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b7313-719c-42ed-9caf-884dfadaeffc admin admin] RBAC: Authorizing `identity:delete_user(user_id=53e4316ab73e4c6390d4db1ec234ab06)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:40.761312 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b7313-719c-42ed-9caf-884dfadaeffc admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:40.800295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-a9d47ab0-244d-4348-9ee6-e21f2c329174 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b9bcd4f0d094b58b30f96aff16f0cb6'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:40.817047 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-a9d47ab0-244d-4348-9ee6-e21f2c329174 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b9bcd4f0d094b58b30f96aff16f0cb6'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:40.817779 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-a9d47ab0-244d-4348-9ee6-e21f2c329174 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b9bcd4f0d094b58b30f96aff16f0cb6'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:40.822419 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-734b7313-719c-42ed-9caf-884dfadaeffc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53e4316ab73e4c6390d4db1ec234ab06'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:40.823167 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-734b7313-719c-42ed-9caf-884dfadaeffc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53e4316ab73e4c6390d4db1ec234ab06'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:40.827548 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-a9d47ab0-244d-4348-9ee6-e21f2c329174 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b9bcd4f0d094b58b30f96aff16f0cb6'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:40.831152 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-734b7313-719c-42ed-9caf-884dfadaeffc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53e4316ab73e4c6390d4db1ec234ab06'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:40.836302 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-a9d47ab0-244d-4348-9ee6-e21f2c329174 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b9bcd4f0d094b58b30f96aff16f0cb6'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:40.841603 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-734b7313-719c-42ed-9caf-884dfadaeffc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53e4316ab73e4c6390d4db1ec234ab06'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:40.842441 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-734b7313-719c-42ed-9caf-884dfadaeffc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53e4316ab73e4c6390d4db1ec234ab06'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:40.847711 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 944/1905] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:40 2022] DELETE /identity/v3/users/9b9bcd4f0d094b58b30f96aff16f0cb6 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:40.868404 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 962/1906] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:40 2022] DELETE /identity/v3/users/53e4316ab73e4c6390d4db1ec234ab06 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:40.873274 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0162d5-c36c-4861-ba69-7c8a00b30aa5 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:40.873697 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0162d5-c36c-4861-ba69-7c8a00b30aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:40.873979 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0162d5-c36c-4861-ba69-7c8a00b30aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:40.905071 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-eb0162d5-c36c-4861-ba69-7c8a00b30aa5 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:40.906937 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-eb0162d5-c36c-4861-ba69-7c8a00b30aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:40.921851 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:40.996756 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 945/1907] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:41.012530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b7313-719c-42ed-9caf-884dfadaeffc admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:41.014859 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-734b7313-719c-42ed-9caf-884dfadaeffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:41.128848 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b7313-719c-42ed-9caf-884dfadaeffc admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:41.134143 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace6bb5-96a5-4470-a4cc-30178d1a4861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:41.134845 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace6bb5-96a5-4470-a4cc-30178d1a4861 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:41.135157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace6bb5-96a5-4470-a4cc-30178d1a4861 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:41.135526 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace6bb5-96a5-4470-a4cc-30178d1a4861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:41.149725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace6bb5-96a5-4470-a4cc-30178d1a4861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:41.152717 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace6bb5-96a5-4470-a4cc-30178d1a4861 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:41.164995 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 963/1908] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:41.182341 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0162d5-c36c-4861-ba69-7c8a00b30aa5 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:41.184435 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-eb0162d5-c36c-4861-ba69-7c8a00b30aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:41.198215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0162d5-c36c-4861-ba69-7c8a00b30aa5 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:41.204157 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61f847-d6d2-4882-823a-ab72fb4bd96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:41.204870 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61f847-d6d2-4882-823a-ab72fb4bd96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:41.205254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61f847-d6d2-4882-823a-ab72fb4bd96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:41.205644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61f847-d6d2-4882-823a-ab72fb4bd96e admin admin] PATH_INFO: `/v3/projects/006f63fe27db41dba40d58d7b2556c02` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:41.207009 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61f847-d6d2-4882-823a-ab72fb4bd96e admin admin] RBAC: Authorizing `identity:delete_project(project_id=006f63fe27db41dba40d58d7b2556c02)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:41.211684 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61f847-d6d2-4882-823a-ab72fb4bd96e admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:41.291820 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-bc61f847-d6d2-4882-823a-ab72fb4bd96e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '006f63fe27db41dba40d58d7b2556c02', 'request_id': 'req-bc61f847-d6d2-4882-823a-ab72fb4bd96e'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:41.310552 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-bc61f847-d6d2-4882-823a-ab72fb4bd96e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '006f63fe27db41dba40d58d7b2556c02', 'request_id': 'req-bc61f847-d6d2-4882-823a-ab72fb4bd96e'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:41.320487 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-bc61f847-d6d2-4882-823a-ab72fb4bd96e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '006f63fe27db41dba40d58d7b2556c02', 'request_id': 'req-bc61f847-d6d2-4882-823a-ab72fb4bd96e'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:41.335224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-bc61f847-d6d2-4882-823a-ab72fb4bd96e admin admin] The token cache is being invalidate because project 006f63fe27db41dba40d58d7b2556c02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:41.335747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-bc61f847-d6d2-4882-823a-ab72fb4bd96e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:41.336661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-bc61f847-d6d2-4882-823a-ab72fb4bd96e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:41.339030 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 946/1909] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:41 2022] DELETE /identity/v3/projects/006f63fe27db41dba40d58d7b2556c02 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:41.345224 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa7d0d-43cc-48ab-8e0c-e048091a2780 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:41.345865 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa7d0d-43cc-48ab-8e0c-e048091a2780 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:41.346320 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa7d0d-43cc-48ab-8e0c-e048091a2780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:41.358543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:41.375836 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9659c-41a6-45d0-a88e-05f7f789165c None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:41.376690 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9659c-41a6-45d0-a88e-05f7f789165c None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:41.377117 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9659c-41a6-45d0-a88e-05f7f789165c None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:41.378930 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 947/1910] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 28 12:15:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:15:41.379919 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-16aa7d0d-43cc-48ab-8e0c-e048091a2780 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:41.381647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-16aa7d0d-43cc-48ab-8e0c-e048091a2780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:41.394366 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ebb19-4d41-41aa-ab29-4547a9e1750a None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:41.395071 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ebb19-4d41-41aa-ab29-4547a9e1750a None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:41.395759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ebb19-4d41-41aa-ab29-4547a9e1750a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:41.510495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-ce2ebb19-4d41-41aa-ab29-4547a9e1750a None None] MFA Rules not processed for user `0e81804e04514ae882a1fd93789db025`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:41.512150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-ce2ebb19-4d41-41aa-ab29-4547a9e1750a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:41.599961 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 964/1911] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:41.609423 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccee46-6437-4c52-866c-50ff08fcf990 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:41.609811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccee46-6437-4c52-866c-50ff08fcf990 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:41.610184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccee46-6437-4c52-866c-50ff08fcf990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:41.652649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-1cccee46-6437-4c52-866c-50ff08fcf990 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:41.655415 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-1cccee46-6437-4c52-866c-50ff08fcf990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:41.684959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 965/1912] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:15:41.688933 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccee46-6437-4c52-866c-50ff08fcf990 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:41.723230 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccee46-6437-4c52-866c-50ff08fcf990 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:41.724330 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 948/1913] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 28 12:15:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:41.736881 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376d7a5-c4b3-4e90-9334-f07ff8e41973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:41.737556 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376d7a5-c4b3-4e90-9334-f07ff8e41973 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:41.737824 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376d7a5-c4b3-4e90-9334-f07ff8e41973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:41.738097 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376d7a5-c4b3-4e90-9334-f07ff8e41973 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:41.738773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376d7a5-c4b3-4e90-9334-f07ff8e41973 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:15:41.739077 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376d7a5-c4b3-4e90-9334-f07ff8e41973 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:41.740735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376d7a5-c4b3-4e90-9334-f07ff8e41973 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:41.760823 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 966/1914] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:15:41.762566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ebb19-4d41-41aa-ab29-4547a9e1750a None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:41.777254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ebb19-4d41-41aa-ab29-4547a9e1750a None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:41.783453 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e075873-aa97-4248-a2fd-ef5e989fd467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:41.784392 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e075873-aa97-4248-a2fd-ef5e989fd467 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:41.785051 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e075873-aa97-4248-a2fd-ef5e989fd467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:41.785782 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e075873-aa97-4248-a2fd-ef5e989fd467 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:41.786052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e075873-aa97-4248-a2fd-ef5e989fd467 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:41.788422 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e075873-aa97-4248-a2fd-ef5e989fd467 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:41.829532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 949/1915] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:41 2022] POST /identity/v3/projects => generated 379 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:41.834533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376d7a5-c4b3-4e90-9334-f07ff8e41973 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:41.849590 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376d7a5-c4b3-4e90-9334-f07ff8e41973 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:41.944422 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38759e-fc25-4e4c-9746-37cd9945d1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:41.945148 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38759e-fc25-4e4c-9746-37cd9945d1f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:41.945446 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38759e-fc25-4e4c-9746-37cd9945d1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:41.945850 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38759e-fc25-4e4c-9746-37cd9945d1f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:41.946583 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38759e-fc25-4e4c-9746-37cd9945d1f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:41.949270 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38759e-fc25-4e4c-9746-37cd9945d1f6 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:41.971823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e075873-aa97-4248-a2fd-ef5e989fd467 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:41.977884 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-6e075873-aa97-4248-a2fd-ef5e989fd467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:41.992316 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 967/1916] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:41 2022] POST /identity/v3/users => generated 290 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:41.996963 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38759e-fc25-4e4c-9746-37cd9945d1f6 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:42.011214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e075873-aa97-4248-a2fd-ef5e989fd467 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:42.018166 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33120b-86ba-4bbd-a809-a677e622d5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:42.018166 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33120b-86ba-4bbd-a809-a677e622d5d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:42.018166 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33120b-86ba-4bbd-a809-a677e622d5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:42.018790 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33120b-86ba-4bbd-a809-a677e622d5d4 admin admin] PATH_INFO: `/v3/projects/10fc737c47384531a5bdaced0a645212` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:42.019810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33120b-86ba-4bbd-a809-a677e622d5d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10fc737c47384531a5bdaced0a645212)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:42.021810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33120b-86ba-4bbd-a809-a677e622d5d4 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:42.023653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38759e-fc25-4e4c-9746-37cd9945d1f6 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:42.024477 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:42.029141 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb7293-8077-4abe-8a0b-d4e8d9bb7a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:42.029968 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb7293-8077-4abe-8a0b-d4e8d9bb7a0b admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:42.030622 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb7293-8077-4abe-8a0b-d4e8d9bb7a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:42.030733 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb7293-8077-4abe-8a0b-d4e8d9bb7a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:42.031527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb7293-8077-4abe-8a0b-d4e8d9bb7a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:42.033414 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb7293-8077-4abe-8a0b-d4e8d9bb7a0b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:42.047671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 968/1917] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:42.051965 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb7293-8077-4abe-8a0b-d4e8d9bb7a0b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:42.053735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f6eb7293-8077-4abe-8a0b-d4e8d9bb7a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:42.084662 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-6c33120b-86ba-4bbd-a809-a677e622d5d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10fc737c47384531a5bdaced0a645212', 'request_id': 'req-6c33120b-86ba-4bbd-a809-a677e622d5d4'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:42.091566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-6c33120b-86ba-4bbd-a809-a677e622d5d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10fc737c47384531a5bdaced0a645212', 'request_id': 'req-6c33120b-86ba-4bbd-a809-a677e622d5d4'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:42.100136 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-6c33120b-86ba-4bbd-a809-a677e622d5d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10fc737c47384531a5bdaced0a645212', 'request_id': 'req-6c33120b-86ba-4bbd-a809-a677e622d5d4'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:42.119193 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-6c33120b-86ba-4bbd-a809-a677e622d5d4 admin admin] The token cache is being invalidate because project 10fc737c47384531a5bdaced0a645212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:42.119518 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-6c33120b-86ba-4bbd-a809-a677e622d5d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:42.120219 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-6c33120b-86ba-4bbd-a809-a677e622d5d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:42.122659 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 950/1918] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:41 2022] DELETE /identity/v3/projects/10fc737c47384531a5bdaced0a645212 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:42.123224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33120b-86ba-4bbd-a809-a677e622d5d4 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:42.124788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-6c33120b-86ba-4bbd-a809-a677e622d5d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:42.154157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:42.162215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb7293-8077-4abe-8a0b-d4e8d9bb7a0b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:42.208704 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33120b-86ba-4bbd-a809-a677e622d5d4 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:42.214041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ea968-f202-466c-a683-499d087bdfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:42.215178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ea968-f202-466c-a683-499d087bdfc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:42.215178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ea968-f202-466c-a683-499d087bdfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:42.215178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ea968-f202-466c-a683-499d087bdfc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:42.215780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ea968-f202-466c-a683-499d087bdfc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:42.217606 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ea968-f202-466c-a683-499d087bdfc4 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:42.228772 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 951/1919] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:42.229701 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ea968-f202-466c-a683-499d087bdfc4 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:42.232016 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-413ea968-f202-466c-a683-499d087bdfc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:42.246798 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe21c6-7f9e-4630-8978-85c3c1444759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:42.247483 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ea968-f202-466c-a683-499d087bdfc4 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:42.247596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe21c6-7f9e-4630-8978-85c3c1444759 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:42.247851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe21c6-7f9e-4630-8978-85c3c1444759 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:42.248129 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe21c6-7f9e-4630-8978-85c3c1444759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:42.250018 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-cbbe21c6-7f9e-4630-8978-85c3c1444759 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:42.252615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca3fbe-b819-4cdf-957b-89a8a43a9521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:42.253389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca3fbe-b819-4cdf-957b-89a8a43a9521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:42.253724 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca3fbe-b819-4cdf-957b-89a8a43a9521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:42.254644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca3fbe-b819-4cdf-957b-89a8a43a9521 admin admin] PATH_INFO: `/v3/users/65d1319e72e4454893ee5ce92e140240` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:42.255508 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca3fbe-b819-4cdf-957b-89a8a43a9521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65d1319e72e4454893ee5ce92e140240)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:42.257522 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca3fbe-b819-4cdf-957b-89a8a43a9521 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:42.263038 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe21c6-7f9e-4630-8978-85c3c1444759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:42.265200 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe21c6-7f9e-4630-8978-85c3c1444759 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:42.279030 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 969/1920] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:42.279739 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe21c6-7f9e-4630-8978-85c3c1444759 service nova] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:42.292635 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe21c6-7f9e-4630-8978-85c3c1444759 service nova] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:42.298413 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c99666-c71d-4107-88cb-266abc866c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:42.299182 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c99666-c71d-4107-88cb-266abc866c93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:42.299489 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c99666-c71d-4107-88cb-266abc866c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:42.299836 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c99666-c71d-4107-88cb-266abc866c93 admin admin] PATH_INFO: `/v3/projects/35a1a25c35ff4c1489c395bdab231a59/users/245d4cdd5ca04f139784714ec76be95f/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:42.317129 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-a9ca3fbe-b819-4cdf-957b-89a8a43a9521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65d1319e72e4454893ee5ce92e140240'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:42.325935 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c99666-c71d-4107-88cb-266abc866c93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35a1a25c35ff4c1489c395bdab231a59, user_id=245d4cdd5ca04f139784714ec76be95f, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:42.329094 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c99666-c71d-4107-88cb-266abc866c93 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:42.335265 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-a9ca3fbe-b819-4cdf-957b-89a8a43a9521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65d1319e72e4454893ee5ce92e140240'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:42.336150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-a9ca3fbe-b819-4cdf-957b-89a8a43a9521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65d1319e72e4454893ee5ce92e140240'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:42.345096 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-a9ca3fbe-b819-4cdf-957b-89a8a43a9521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65d1319e72e4454893ee5ce92e140240'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:42.347245 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 970/1921] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:42 2022] PUT /identity/v3/projects/35a1a25c35ff4c1489c395bdab231a59/users/245d4cdd5ca04f139784714ec76be95f/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:42.358832 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e970b-0b62-427e-9ff8-c69c3386e390 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:42.359415 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e970b-0b62-427e-9ff8-c69c3386e390 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:42.360121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e970b-0b62-427e-9ff8-c69c3386e390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:42.361105 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-a9ca3fbe-b819-4cdf-957b-89a8a43a9521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65d1319e72e4454893ee5ce92e140240'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:42.363409 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:42.369915 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 952/1922] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:42 2022] DELETE /identity/v3/users/65d1319e72e4454893ee5ce92e140240 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:42.395039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-234e970b-0b62-427e-9ff8-c69c3386e390 None None] MFA Rules not processed for user `245d4cdd5ca04f139784714ec76be95f`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:42.396303 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-234e970b-0b62-427e-9ff8-c69c3386e390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:42.492278 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 971/1923] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:42.497074 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca3fbe-b819-4cdf-957b-89a8a43a9521 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:42.498595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-a9ca3fbe-b819-4cdf-957b-89a8a43a9521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:42.611414 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca3fbe-b819-4cdf-957b-89a8a43a9521 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:42.620417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6236406-bb7d-4fa8-b289-511a758d87d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:42.621332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6236406-bb7d-4fa8-b289-511a758d87d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:42.621709 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6236406-bb7d-4fa8-b289-511a758d87d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:42.622051 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6236406-bb7d-4fa8-b289-511a758d87d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:42.622837 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6236406-bb7d-4fa8-b289-511a758d87d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:42.625284 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6236406-bb7d-4fa8-b289-511a758d87d1 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:42.676403 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 953/1924] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:42 2022] POST /identity/v3/projects => generated 381 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:42.680685 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e970b-0b62-427e-9ff8-c69c3386e390 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:42.692574 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e970b-0b62-427e-9ff8-c69c3386e390 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:42.756612 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6236406-bb7d-4fa8-b289-511a758d87d1 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:42.758817 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-f6236406-bb7d-4fa8-b289-511a758d87d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:42.773731 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:42.789745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7eee7-288f-4929-b7c1-c5cc95611aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:42.790417 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7eee7-288f-4929-b7c1-c5cc95611aad admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:42.790701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7eee7-288f-4929-b7c1-c5cc95611aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:42.790944 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7eee7-288f-4929-b7c1-c5cc95611aad admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:42.791676 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7eee7-288f-4929-b7c1-c5cc95611aad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:42.794166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7eee7-288f-4929-b7c1-c5cc95611aad admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:42.829431 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 972/1925] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:42 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:42.830595 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7eee7-288f-4929-b7c1-c5cc95611aad admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:42.834200 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0ee7eee7-288f-4929-b7c1-c5cc95611aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:42.849065 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7eee7-288f-4929-b7c1-c5cc95611aad admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:42.853882 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e220b9d-b2d4-43f4-94f7-a087cd586b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:42.854515 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e220b9d-b2d4-43f4-94f7-a087cd586b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:42.855738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e220b9d-b2d4-43f4-94f7-a087cd586b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:42.856057 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e220b9d-b2d4-43f4-94f7-a087cd586b86 admin admin] PATH_INFO: `/v3/users/deeddee26a7c4058b706be4faa9dff45` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:42.857255 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e220b9d-b2d4-43f4-94f7-a087cd586b86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deeddee26a7c4058b706be4faa9dff45)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:42.859170 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e220b9d-b2d4-43f4-94f7-a087cd586b86 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:42.868705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6236406-bb7d-4fa8-b289-511a758d87d1 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:42.874533 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a9fbc-abea-494b-9330-745d8a0f472d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:42.875183 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a9fbc-abea-494b-9330-745d8a0f472d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:42.875482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a9fbc-abea-494b-9330-745d8a0f472d admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:42.875930 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a9fbc-abea-494b-9330-745d8a0f472d admin admin] PATH_INFO: `/v3/projects/bdcb751889bc420a893bd08a5142004f` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:42.877371 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a9fbc-abea-494b-9330-745d8a0f472d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdcb751889bc420a893bd08a5142004f)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:42.879288 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a9fbc-abea-494b-9330-745d8a0f472d admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:42.923503 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7e220b9d-b2d4-43f4-94f7-a087cd586b86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deeddee26a7c4058b706be4faa9dff45'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:42.924220 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7e220b9d-b2d4-43f4-94f7-a087cd586b86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deeddee26a7c4058b706be4faa9dff45'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:42.932567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7e220b9d-b2d4-43f4-94f7-a087cd586b86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deeddee26a7c4058b706be4faa9dff45'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:42.941960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-d24a9fbc-abea-494b-9330-745d8a0f472d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdcb751889bc420a893bd08a5142004f', 'request_id': 'req-d24a9fbc-abea-494b-9330-745d8a0f472d'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:42.943245 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7e220b9d-b2d4-43f4-94f7-a087cd586b86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deeddee26a7c4058b706be4faa9dff45'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:42.943723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7e220b9d-b2d4-43f4-94f7-a087cd586b86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deeddee26a7c4058b706be4faa9dff45'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:42.948859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-d24a9fbc-abea-494b-9330-745d8a0f472d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdcb751889bc420a893bd08a5142004f', 'request_id': 'req-d24a9fbc-abea-494b-9330-745d8a0f472d'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:42.960774 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-d24a9fbc-abea-494b-9330-745d8a0f472d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdcb751889bc420a893bd08a5142004f', 'request_id': 'req-d24a9fbc-abea-494b-9330-745d8a0f472d'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:42.966253 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 973/1926] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:42 2022] DELETE /identity/v3/users/deeddee26a7c4058b706be4faa9dff45 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:42.967397 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e220b9d-b2d4-43f4-94f7-a087cd586b86 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:42.972060 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7e220b9d-b2d4-43f4-94f7-a087cd586b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:42.980638 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-d24a9fbc-abea-494b-9330-745d8a0f472d admin admin] The token cache is being invalidate because project bdcb751889bc420a893bd08a5142004f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:42.981044 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-d24a9fbc-abea-494b-9330-745d8a0f472d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:42.981918 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-d24a9fbc-abea-494b-9330-745d8a0f472d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:42.983981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 954/1927] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:42 2022] DELETE /identity/v3/projects/bdcb751889bc420a893bd08a5142004f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:42.986886 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb7b49-5847-4380-bcf2-132a7ac4b134 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:42.988090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb7b49-5847-4380-bcf2-132a7ac4b134 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:42.988397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb7b49-5847-4380-bcf2-132a7ac4b134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:43.013383 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-16fb7b49-5847-4380-bcf2-132a7ac4b134 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:43.014874 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-16fb7b49-5847-4380-bcf2-132a7ac4b134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:43.028097 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:43.054265 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e220b9d-b2d4-43f4-94f7-a087cd586b86 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:43.059559 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc811a2-fa5c-42ad-9b78-5cb27d0f0820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:43.060191 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc811a2-fa5c-42ad-9b78-5cb27d0f0820 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:43.060475 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc811a2-fa5c-42ad-9b78-5cb27d0f0820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:43.060733 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc811a2-fa5c-42ad-9b78-5cb27d0f0820 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:43.061593 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc811a2-fa5c-42ad-9b78-5cb27d0f0820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:43.063255 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc811a2-fa5c-42ad-9b78-5cb27d0f0820 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:43.075108 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 974/1928] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:43.076826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0adbee-4430-4e56-819b-eae91ed3bf90 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:43.076826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0adbee-4430-4e56-819b-eae91ed3bf90 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:43.077012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0adbee-4430-4e56-819b-eae91ed3bf90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:43.098919 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-4e0adbee-4430-4e56-819b-eae91ed3bf90 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:43.100182 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-4e0adbee-4430-4e56-819b-eae91ed3bf90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:43.111411 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 975/1929] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:43.112400 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0adbee-4430-4e56-819b-eae91ed3bf90 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:43.121169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-4e0adbee-4430-4e56-819b-eae91ed3bf90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:43.135178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 955/1930] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:43.137238 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173f97f-f7a8-4c0d-ab28-ebe24b33c3a2 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:43.137528 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173f97f-f7a8-4c0d-ab28-ebe24b33c3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:43.137799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173f97f-f7a8-4c0d-ab28-ebe24b33c3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:43.141092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0adbee-4430-4e56-819b-eae91ed3bf90 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:43.147405 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fd89b-683d-49f8-93e5-9781bb387d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:43.147818 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fd89b-683d-49f8-93e5-9781bb387d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:43.148112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fd89b-683d-49f8-93e5-9781bb387d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:43.148392 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fd89b-683d-49f8-93e5-9781bb387d19 admin admin] PATH_INFO: `/v3/projects/603b6e2439a94ad398747e26ca863b81/users/ef1477a232ec4adb855044114410623d/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:43.166516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fd89b-683d-49f8-93e5-9781bb387d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=603b6e2439a94ad398747e26ca863b81, user_id=ef1477a232ec4adb855044114410623d, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:43.167598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-6173f97f-f7a8-4c0d-ab28-ebe24b33c3a2 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:43.168550 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fd89b-683d-49f8-93e5-9781bb387d19 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:43.169287 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-6173f97f-f7a8-4c0d-ab28-ebe24b33c3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:43.188195 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 956/1931] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:43.188195 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173f97f-f7a8-4c0d-ab28-ebe24b33c3a2 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:43.191553 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-6173f97f-f7a8-4c0d-ab28-ebe24b33c3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:43.192926 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 976/1932] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:43 2022] PUT /identity/v3/projects/603b6e2439a94ad398747e26ca863b81/users/ef1477a232ec4adb855044114410623d/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:43.193917 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fd89b-683d-49f8-93e5-9781bb387d19 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:43.222534 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:43.290017 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fd89b-683d-49f8-93e5-9781bb387d19 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:43.296459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2edf2b-e66d-4c82-be80-705f544cb06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:43.297089 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2edf2b-e66d-4c82-be80-705f544cb06f admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:43.297374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2edf2b-e66d-4c82-be80-705f544cb06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:43.297646 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2edf2b-e66d-4c82-be80-705f544cb06f admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:43.299616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2edf2b-e66d-4c82-be80-705f544cb06f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:15:43.300152 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2edf2b-e66d-4c82-be80-705f544cb06f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:43.302253 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2edf2b-e66d-4c82-be80-705f544cb06f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:43.324621 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 977/1933] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:15:43.325671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2edf2b-e66d-4c82-be80-705f544cb06f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:43.329943 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173f97f-f7a8-4c0d-ab28-ebe24b33c3a2 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:43.339345 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2edf2b-e66d-4c82-be80-705f544cb06f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:43.345986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc30087-2d6d-4463-94cb-304821096374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:43.346699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc30087-2d6d-4463-94cb-304821096374 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:43.346970 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc30087-2d6d-4463-94cb-304821096374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:43.347246 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc30087-2d6d-4463-94cb-304821096374 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:43.347947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc30087-2d6d-4463-94cb-304821096374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:43.349760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc30087-2d6d-4463-94cb-304821096374 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:43.369734 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 978/1934] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:43.371295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc30087-2d6d-4463-94cb-304821096374 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:43.384870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc30087-2d6d-4463-94cb-304821096374 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:43.388754 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a39bb9-d0db-4c1c-a1cc-07a479bb79fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:43.389655 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a39bb9-d0db-4c1c-a1cc-07a479bb79fd service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:43.390033 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a39bb9-d0db-4c1c-a1cc-07a479bb79fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:43.390386 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a39bb9-d0db-4c1c-a1cc-07a479bb79fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:43.390851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0110c8c-a5f4-4ece-9af3-b467b6e432d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:43.391503 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0110c8c-a5f4-4ece-9af3-b467b6e432d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:43.391778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0110c8c-a5f4-4ece-9af3-b467b6e432d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:43.392053 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0110c8c-a5f4-4ece-9af3-b467b6e432d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:43.392830 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0110c8c-a5f4-4ece-9af3-b467b6e432d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:43.394978 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0110c8c-a5f4-4ece-9af3-b467b6e432d9 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:43.414118 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a39bb9-d0db-4c1c-a1cc-07a479bb79fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:43.415679 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a39bb9-d0db-4c1c-a1cc-07a479bb79fd service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:43.438842 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 957/1935] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:43.440459 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a39bb9-d0db-4c1c-a1cc-07a479bb79fd service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:43.455002 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a39bb9-d0db-4c1c-a1cc-07a479bb79fd service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:43.462492 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 979/1936] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:43 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:43.463490 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0110c8c-a5f4-4ece-9af3-b467b6e432d9 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:43.569590 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9674a-605b-4dbd-ba34-3806608e4e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:43.570416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9674a-605b-4dbd-ba34-3806608e4e44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:43.570785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9674a-605b-4dbd-ba34-3806608e4e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:43.571106 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9674a-605b-4dbd-ba34-3806608e4e44 admin admin] PATH_INFO: `/v3/projects/603b6e2439a94ad398747e26ca863b81/users/ef1477a232ec4adb855044114410623d/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:43.574209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9674a-605b-4dbd-ba34-3806608e4e44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=603b6e2439a94ad398747e26ca863b81, user_id=ef1477a232ec4adb855044114410623d, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:43.578299 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9674a-605b-4dbd-ba34-3806608e4e44 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:43.602032 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 958/1937] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:43 2022] PUT /identity/v3/projects/603b6e2439a94ad398747e26ca863b81/users/ef1477a232ec4adb855044114410623d/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:43.602216 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0110c8c-a5f4-4ece-9af3-b467b6e432d9 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:43.613934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1e031-1e64-4a98-8abd-e705a95e2999 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:43.614483 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1e031-1e64-4a98-8abd-e705a95e2999 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:43.614762 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1e031-1e64-4a98-8abd-e705a95e2999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:43.623538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:43.672405 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-f9d1e031-1e64-4a98-8abd-e705a95e2999 None None] MFA Rules not processed for user `ef1477a232ec4adb855044114410623d`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:43.674820 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-f9d1e031-1e64-4a98-8abd-e705a95e2999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:43.716537 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08ce0b-54ab-45bb-a614-ce4a5c1c2f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:43.717593 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08ce0b-54ab-45bb-a614-ce4a5c1c2f16 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:43.717877 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08ce0b-54ab-45bb-a614-ce4a5c1c2f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:43.718151 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08ce0b-54ab-45bb-a614-ce4a5c1c2f16 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:43.718793 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08ce0b-54ab-45bb-a614-ce4a5c1c2f16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:43.721163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08ce0b-54ab-45bb-a614-ce4a5c1c2f16 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:43.758247 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 980/1938] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:43 2022] POST /identity/v3/users => generated 291 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:43.759071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08ce0b-54ab-45bb-a614-ce4a5c1c2f16 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:43.765482 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-fe08ce0b-54ab-45bb-a614-ce4a5c1c2f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:43.782169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08ce0b-54ab-45bb-a614-ce4a5c1c2f16 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:43.788631 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 959/1939] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:43.788631 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1e031-1e64-4a98-8abd-e705a95e2999 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:43.790230 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862044e-f90f-4143-8465-0b288e09c47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:43.790890 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862044e-f90f-4143-8465-0b288e09c47b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:43.791174 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862044e-f90f-4143-8465-0b288e09c47b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:43.791474 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862044e-f90f-4143-8465-0b288e09c47b admin admin] PATH_INFO: `/v3/users/ddc85e8ad79e4d0fa681c5a7127b887e` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:43.793122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862044e-f90f-4143-8465-0b288e09c47b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddc85e8ad79e4d0fa681c5a7127b887e)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:43.795066 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862044e-f90f-4143-8465-0b288e09c47b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:43.804596 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1e031-1e64-4a98-8abd-e705a95e2999 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:43.810249 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392174f-7108-432b-b7b9-f9a419657333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:43.810824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392174f-7108-432b-b7b9-f9a419657333 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:43.811122 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392174f-7108-432b-b7b9-f9a419657333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:43.811552 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:43.812053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392174f-7108-432b-b7b9-f9a419657333 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:43.812802 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392174f-7108-432b-b7b9-f9a419657333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:43.814620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392174f-7108-432b-b7b9-f9a419657333 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:43.827035 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 960/1940] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:43.827949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392174f-7108-432b-b7b9-f9a419657333 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:43.830184 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-2392174f-7108-432b-b7b9-f9a419657333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:43.856366 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a862044e-f90f-4143-8465-0b288e09c47b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddc85e8ad79e4d0fa681c5a7127b887e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:43.857154 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a862044e-f90f-4143-8465-0b288e09c47b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddc85e8ad79e4d0fa681c5a7127b887e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:43.867147 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a862044e-f90f-4143-8465-0b288e09c47b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddc85e8ad79e4d0fa681c5a7127b887e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:43.878132 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a862044e-f90f-4143-8465-0b288e09c47b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddc85e8ad79e4d0fa681c5a7127b887e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:43.878788 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a862044e-f90f-4143-8465-0b288e09c47b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddc85e8ad79e4d0fa681c5a7127b887e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:43.902223 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 981/1941] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:43 2022] DELETE /identity/v3/users/ddc85e8ad79e4d0fa681c5a7127b887e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:43.905361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862044e-f90f-4143-8465-0b288e09c47b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:43.905472 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392174f-7108-432b-b7b9-f9a419657333 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:43.905557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a862044e-f90f-4143-8465-0b288e09c47b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:43.955271 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df949f-3f4d-4ac9-8fba-1e9d81fdbab5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:43.955999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df949f-3f4d-4ac9-8fba-1e9d81fdbab5 service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:43.956340 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df949f-3f4d-4ac9-8fba-1e9d81fdbab5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:43.956682 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df949f-3f4d-4ac9-8fba-1e9d81fdbab5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:43.958530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-08df949f-3f4d-4ac9-8fba-1e9d81fdbab5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:43.976038 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862044e-f90f-4143-8465-0b288e09c47b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:43.982702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb5e13-c878-4461-ad56-59ce9f33b1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:43.983319 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb5e13-c878-4461-ad56-59ce9f33b1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:43.983635 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb5e13-c878-4461-ad56-59ce9f33b1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:43.983913 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb5e13-c878-4461-ad56-59ce9f33b1d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:43.984566 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb5e13-c878-4461-ad56-59ce9f33b1d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:43.986189 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb5e13-c878-4461-ad56-59ce9f33b1d9 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:43.997168 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 982/1942] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:43.998394 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb5e13-c878-4461-ad56-59ce9f33b1d9 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:44.000237 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-55eb5e13-c878-4461-ad56-59ce9f33b1d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:44.008945 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:44.013649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb5e13-c878-4461-ad56-59ce9f33b1d9 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:44.018538 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6efc7-1679-498b-9dd2-947886435b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:44.019172 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6efc7-1679-498b-9dd2-947886435b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:44.019474 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6efc7-1679-498b-9dd2-947886435b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:44.019753 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6efc7-1679-498b-9dd2-947886435b6a admin admin] PATH_INFO: `/v3/projects/328b26acd75d48b3bb25b9689f62d50e` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:44.021284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6efc7-1679-498b-9dd2-947886435b6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=328b26acd75d48b3bb25b9689f62d50e)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:44.023190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6efc7-1679-498b-9dd2-947886435b6a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:44.030233 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df949f-3f4d-4ac9-8fba-1e9d81fdbab5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:44.031753 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df949f-3f4d-4ac9-8fba-1e9d81fdbab5 service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:44.042055 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 961/1943] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:44.043483 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9d949-7343-4811-8d34-89ecc320eb14 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:44.043897 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9d949-7343-4811-8d34-89ecc320eb14 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:44.044736 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9d949-7343-4811-8d34-89ecc320eb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:44.072387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-41d9d949-7343-4811-8d34-89ecc320eb14 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:44.074494 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-41d9d949-7343-4811-8d34-89ecc320eb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:44.108118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-82d6efc7-1679-498b-9dd2-947886435b6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '328b26acd75d48b3bb25b9689f62d50e', 'request_id': 'req-82d6efc7-1679-498b-9dd2-947886435b6a'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:44.115620 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-82d6efc7-1679-498b-9dd2-947886435b6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '328b26acd75d48b3bb25b9689f62d50e', 'request_id': 'req-82d6efc7-1679-498b-9dd2-947886435b6a'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:44.127336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-82d6efc7-1679-498b-9dd2-947886435b6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '328b26acd75d48b3bb25b9689f62d50e', 'request_id': 'req-82d6efc7-1679-498b-9dd2-947886435b6a'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:44.148825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-82d6efc7-1679-498b-9dd2-947886435b6a admin admin] The token cache is being invalidate because project 328b26acd75d48b3bb25b9689f62d50e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:44.159926 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-82d6efc7-1679-498b-9dd2-947886435b6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:44.161150 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-82d6efc7-1679-498b-9dd2-947886435b6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:44.162403 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 962/1944] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:44.163292 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9d949-7343-4811-8d34-89ecc320eb14 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:44.164276 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 983/1945] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:43 2022] DELETE /identity/v3/projects/328b26acd75d48b3bb25b9689f62d50e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:44.176647 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9d949-7343-4811-8d34-89ecc320eb14 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:44.177816 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6efc7-1679-498b-9dd2-947886435b6a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:44.180671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-82d6efc7-1679-498b-9dd2-947886435b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:44.182292 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330657f-c1cb-4159-b2a6-444c02d9fb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:44.183609 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330657f-c1cb-4159-b2a6-444c02d9fb3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:44.184222 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330657f-c1cb-4159-b2a6-444c02d9fb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:44.184827 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330657f-c1cb-4159-b2a6-444c02d9fb3a admin admin] PATH_INFO: `/v3/projects/e1a6eb96ccee4acabac1120de081f257/users/6173bb35c4d3444f8951c00649b8b3b6/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:44.209507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330657f-c1cb-4159-b2a6-444c02d9fb3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a6eb96ccee4acabac1120de081f257, user_id=6173bb35c4d3444f8951c00649b8b3b6, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:44.213602 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330657f-c1cb-4159-b2a6-444c02d9fb3a admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:44.216433 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6efc7-1679-498b-9dd2-947886435b6a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:44.227667 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3941c33-1964-4590-9700-b3991c4dddec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:44.228877 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3941c33-1964-4590-9700-b3991c4dddec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:44.229089 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3941c33-1964-4590-9700-b3991c4dddec admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:44.229429 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3941c33-1964-4590-9700-b3991c4dddec admin admin] PATH_INFO: `/v3/users/15f39009be1b430e88b75d66be350e0c` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:44.231130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3941c33-1964-4590-9700-b3991c4dddec admin admin] RBAC: Authorizing `identity:delete_user(user_id=15f39009be1b430e88b75d66be350e0c)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:44.233949 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3941c33-1964-4590-9700-b3991c4dddec admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:44.237233 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:44.238279 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 963/1946] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:44 2022] PUT /identity/v3/projects/e1a6eb96ccee4acabac1120de081f257/users/6173bb35c4d3444f8951c00649b8b3b6/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:44.239200 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330657f-c1cb-4159-b2a6-444c02d9fb3a admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:44.241796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-a330657f-c1cb-4159-b2a6-444c02d9fb3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:44.339785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330657f-c1cb-4159-b2a6-444c02d9fb3a admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:44.345512 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f775e-e578-4306-8478-f8e67336a633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:44.346452 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f775e-e578-4306-8478-f8e67336a633 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:44.346742 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f775e-e578-4306-8478-f8e67336a633 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:44.347020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f775e-e578-4306-8478-f8e67336a633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:44.349670 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-d18f775e-e578-4306-8478-f8e67336a633 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:44.350995 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c3941c33-1964-4590-9700-b3991c4dddec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15f39009be1b430e88b75d66be350e0c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:44.353628 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c3941c33-1964-4590-9700-b3991c4dddec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15f39009be1b430e88b75d66be350e0c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:44.372057 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c3941c33-1964-4590-9700-b3991c4dddec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15f39009be1b430e88b75d66be350e0c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:44.382758 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c3941c33-1964-4590-9700-b3991c4dddec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15f39009be1b430e88b75d66be350e0c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:44.384000 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c3941c33-1964-4590-9700-b3991c4dddec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15f39009be1b430e88b75d66be350e0c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:44.412019 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 984/1947] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:44 2022] DELETE /identity/v3/users/15f39009be1b430e88b75d66be350e0c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:44.413876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388b798-1c2e-4e74-a79a-7ab7abdfd65a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:44.414443 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388b798-1c2e-4e74-a79a-7ab7abdfd65a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:44.414826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388b798-1c2e-4e74-a79a-7ab7abdfd65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:44.471172 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-3388b798-1c2e-4e74-a79a-7ab7abdfd65a None None] MFA Rules not processed for user `6173bb35c4d3444f8951c00649b8b3b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:44.474910 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3388b798-1c2e-4e74-a79a-7ab7abdfd65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:44.494759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f775e-e578-4306-8478-f8e67336a633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:44.497246 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f775e-e578-4306-8478-f8e67336a633 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:44.517868 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 964/1948] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:44.589502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 985/1949] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:44.593864 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f775e-e578-4306-8478-f8e67336a633 service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:44.595925 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-d18f775e-e578-4306-8478-f8e67336a633 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:44.633154 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f775e-e578-4306-8478-f8e67336a633 service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:44.640668 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:44.773572 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291a035-a84c-4f08-bb8f-1c5365a771c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:44.774495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291a035-a84c-4f08-bb8f-1c5365a771c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:44.774842 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291a035-a84c-4f08-bb8f-1c5365a771c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:44.775190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291a035-a84c-4f08-bb8f-1c5365a771c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:44.777155 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291a035-a84c-4f08-bb8f-1c5365a771c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:44.781322 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291a035-a84c-4f08-bb8f-1c5365a771c2 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:44.843128 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 965/1950] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:44 2022] POST /identity/v3/projects => generated 383 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:44.847640 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388b798-1c2e-4e74-a79a-7ab7abdfd65a None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:44.854580 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3388b798-1c2e-4e74-a79a-7ab7abdfd65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:44.879925 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388b798-1c2e-4e74-a79a-7ab7abdfd65a None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:44.896465 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291a035-a84c-4f08-bb8f-1c5365a771c2 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:44.898832 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b291a035-a84c-4f08-bb8f-1c5365a771c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:45.027946 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab219117-9b74-4179-80f8-c6afd8f7e15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:45.028579 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab219117-9b74-4179-80f8-c6afd8f7e15f admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:45.028858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab219117-9b74-4179-80f8-c6afd8f7e15f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:45.029133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab219117-9b74-4179-80f8-c6afd8f7e15f admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:45.029778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab219117-9b74-4179-80f8-c6afd8f7e15f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:45.030403 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291a035-a84c-4f08-bb8f-1c5365a771c2 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:45.031759 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab219117-9b74-4179-80f8-c6afd8f7e15f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:45.037595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396df42-55f5-45e1-a1db-3c408838889a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:45.039075 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396df42-55f5-45e1-a1db-3c408838889a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:45.041894 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396df42-55f5-45e1-a1db-3c408838889a admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:45.042300 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396df42-55f5-45e1-a1db-3c408838889a admin admin] PATH_INFO: `/v3/users/245d4cdd5ca04f139784714ec76be95f` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:45.044009 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396df42-55f5-45e1-a1db-3c408838889a admin admin] RBAC: Authorizing `identity:delete_user(user_id=245d4cdd5ca04f139784714ec76be95f)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:45.049876 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396df42-55f5-45e1-a1db-3c408838889a admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:45.089265 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:45.095967 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 986/1951] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:44 2022] POST /identity/v3/users => generated 298 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:45.099674 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab219117-9b74-4179-80f8-c6afd8f7e15f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:45.103368 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ab219117-9b74-4179-80f8-c6afd8f7e15f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:45.131593 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab219117-9b74-4179-80f8-c6afd8f7e15f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:45.148761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9346a9f-ca3e-4082-9bdf-cd443cbb4c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:45.149429 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9346a9f-ca3e-4082-9bdf-cd443cbb4c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:45.149745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9346a9f-ca3e-4082-9bdf-cd443cbb4c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:45.149979 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9346a9f-ca3e-4082-9bdf-cd443cbb4c22 admin admin] PATH_INFO: `/v3/projects/e38a64a35685478c99364a26f593e5b2` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:45.151156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9346a9f-ca3e-4082-9bdf-cd443cbb4c22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e38a64a35685478c99364a26f593e5b2)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:45.153609 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9346a9f-ca3e-4082-9bdf-cd443cbb4c22 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:45.159507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-d396df42-55f5-45e1-a1db-3c408838889a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '245d4cdd5ca04f139784714ec76be95f'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:45.206813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-d396df42-55f5-45e1-a1db-3c408838889a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '245d4cdd5ca04f139784714ec76be95f'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:45.207924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-d396df42-55f5-45e1-a1db-3c408838889a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '245d4cdd5ca04f139784714ec76be95f'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:45.221668 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-d396df42-55f5-45e1-a1db-3c408838889a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '245d4cdd5ca04f139784714ec76be95f'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:45.232925 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-d396df42-55f5-45e1-a1db-3c408838889a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '245d4cdd5ca04f139784714ec76be95f'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:45.268814 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f9346a9f-ca3e-4082-9bdf-cd443cbb4c22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e38a64a35685478c99364a26f593e5b2', 'request_id': 'req-f9346a9f-ca3e-4082-9bdf-cd443cbb4c22'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:45.269592 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 966/1952] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:44 2022] DELETE /identity/v3/users/245d4cdd5ca04f139784714ec76be95f => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:45.270802 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396df42-55f5-45e1-a1db-3c408838889a admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:45.273145 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-d396df42-55f5-45e1-a1db-3c408838889a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:45.281387 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f9346a9f-ca3e-4082-9bdf-cd443cbb4c22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e38a64a35685478c99364a26f593e5b2', 'request_id': 'req-f9346a9f-ca3e-4082-9bdf-cd443cbb4c22'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:45.294166 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:45.295132 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f9346a9f-ca3e-4082-9bdf-cd443cbb4c22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e38a64a35685478c99364a26f593e5b2', 'request_id': 'req-f9346a9f-ca3e-4082-9bdf-cd443cbb4c22'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:45.323328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f9346a9f-ca3e-4082-9bdf-cd443cbb4c22 admin admin] The token cache is being invalidate because project e38a64a35685478c99364a26f593e5b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:45.325290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f9346a9f-ca3e-4082-9bdf-cd443cbb4c22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:45.326503 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f9346a9f-ca3e-4082-9bdf-cd443cbb4c22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:45.329054 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 987/1953] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:45 2022] DELETE /identity/v3/projects/e38a64a35685478c99364a26f593e5b2 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:45.330003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9346a9f-ca3e-4082-9bdf-cd443cbb4c22 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:45.331987 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f9346a9f-ca3e-4082-9bdf-cd443cbb4c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:45.399194 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396df42-55f5-45e1-a1db-3c408838889a admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:45.405128 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b90de6-5eb0-44a8-b5db-6b731687d8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:45.405798 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b90de6-5eb0-44a8-b5db-6b731687d8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:45.406078 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b90de6-5eb0-44a8-b5db-6b731687d8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:45.406346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b90de6-5eb0-44a8-b5db-6b731687d8b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:45.406999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b90de6-5eb0-44a8-b5db-6b731687d8b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:45.408713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b90de6-5eb0-44a8-b5db-6b731687d8b4 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:45.421180 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 967/1954] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:45.422598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47ebda-19fd-4851-83d3-a4a2fc147c67 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:45.422916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47ebda-19fd-4851-83d3-a4a2fc147c67 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:45.423191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47ebda-19fd-4851-83d3-a4a2fc147c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:45.446031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-cb47ebda-19fd-4851-83d3-a4a2fc147c67 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:45.447308 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-cb47ebda-19fd-4851-83d3-a4a2fc147c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:45.453579 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9346a9f-ca3e-4082-9bdf-cd443cbb4c22 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:45.459735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 968/1955] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:45.461392 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace0e06-e419-4b24-9616-019b4883d6f8 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:45.461709 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace0e06-e419-4b24-9616-019b4883d6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:45.462066 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace0e06-e419-4b24-9616-019b4883d6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:45.462873 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70ddab-76dc-41ba-96a5-e0462611c599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:45.463568 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70ddab-76dc-41ba-96a5-e0462611c599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:45.463904 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70ddab-76dc-41ba-96a5-e0462611c599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:45.464997 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70ddab-76dc-41ba-96a5-e0462611c599 admin admin] PATH_INFO: `/v3/projects/17a330414c4c4840a115f243aa930cc5` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:45.466255 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70ddab-76dc-41ba-96a5-e0462611c599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17a330414c4c4840a115f243aa930cc5)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:45.468448 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70ddab-76dc-41ba-96a5-e0462611c599 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:45.491628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-5ace0e06-e419-4b24-9616-019b4883d6f8 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:45.493444 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-5ace0e06-e419-4b24-9616-019b4883d6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:45.503099 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 969/1956] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:45.504152 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace0e06-e419-4b24-9616-019b4883d6f8 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:45.505623 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-5ace0e06-e419-4b24-9616-019b4883d6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:45.518940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace0e06-e419-4b24-9616-019b4883d6f8 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:45.525508 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6ba0e-0395-4380-a045-cedec41fc1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:45.526245 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6ba0e-0395-4380-a045-cedec41fc1f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:45.527066 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6ba0e-0395-4380-a045-cedec41fc1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:45.527388 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6ba0e-0395-4380-a045-cedec41fc1f7 admin admin] PATH_INFO: `/v3/projects/774cb5256b64420bb76d45aec1bedfa6/users/bf834ff7b6304e0689ebaad2606bda10/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:45.545941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6ba0e-0395-4380-a045-cedec41fc1f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=774cb5256b64420bb76d45aec1bedfa6, user_id=bf834ff7b6304e0689ebaad2606bda10, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:45.548778 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6ba0e-0395-4380-a045-cedec41fc1f7 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:45.561507 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-4f70ddab-76dc-41ba-96a5-e0462611c599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17a330414c4c4840a115f243aa930cc5', 'request_id': 'req-4f70ddab-76dc-41ba-96a5-e0462611c599'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:45.564020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 970/1957] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:45 2022] PUT /identity/v3/projects/774cb5256b64420bb76d45aec1bedfa6/users/bf834ff7b6304e0689ebaad2606bda10/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:45.565094 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6ba0e-0395-4380-a045-cedec41fc1f7 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:45.567963 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-07a6ba0e-0395-4380-a045-cedec41fc1f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:45.571465 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-4f70ddab-76dc-41ba-96a5-e0462611c599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17a330414c4c4840a115f243aa930cc5', 'request_id': 'req-4f70ddab-76dc-41ba-96a5-e0462611c599'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:45.578997 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-4f70ddab-76dc-41ba-96a5-e0462611c599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17a330414c4c4840a115f243aa930cc5', 'request_id': 'req-4f70ddab-76dc-41ba-96a5-e0462611c599'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:45.597141 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-4f70ddab-76dc-41ba-96a5-e0462611c599 admin admin] The token cache is being invalidate because project 17a330414c4c4840a115f243aa930cc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:45.597493 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-4f70ddab-76dc-41ba-96a5-e0462611c599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:45.598206 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-4f70ddab-76dc-41ba-96a5-e0462611c599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:45.603669 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 988/1958] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:45 2022] DELETE /identity/v3/projects/17a330414c4c4840a115f243aa930cc5 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:45.603669 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6f966-88d8-4f61-96aa-ba4e4dc35839 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:45.603669 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6f966-88d8-4f61-96aa-ba4e4dc35839 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:45.603669 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6f966-88d8-4f61-96aa-ba4e4dc35839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:45.641912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-afd6f966-88d8-4f61-96aa-ba4e4dc35839 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:45.644302 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-afd6f966-88d8-4f61-96aa-ba4e4dc35839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:45.646586 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6ba0e-0395-4380-a045-cedec41fc1f7 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:45.651007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad62d6-e51c-4b81-89bd-39a439790f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:45.652726 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad62d6-e51c-4b81-89bd-39a439790f06 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:45.653096 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad62d6-e51c-4b81-89bd-39a439790f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:45.653404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad62d6-e51c-4b81-89bd-39a439790f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:45.655911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-75ad62d6-e51c-4b81-89bd-39a439790f06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:45.663859 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:45.756726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 989/1959] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:45.757776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6f966-88d8-4f61-96aa-ba4e4dc35839 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:45.759274 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-afd6f966-88d8-4f61-96aa-ba4e4dc35839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:45.762818 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad62d6-e51c-4b81-89bd-39a439790f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:45.764927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad62d6-e51c-4b81-89bd-39a439790f06 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:45.773611 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6f966-88d8-4f61-96aa-ba4e4dc35839 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:45.779230 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd7890-e73c-485e-82e6-d2ae7eec35f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:45.779956 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd7890-e73c-485e-82e6-d2ae7eec35f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:45.780800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd7890-e73c-485e-82e6-d2ae7eec35f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:45.781178 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd7890-e73c-485e-82e6-d2ae7eec35f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:45.781894 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd7890-e73c-485e-82e6-d2ae7eec35f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:45.782961 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 971/1960] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:45.784158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd7890-e73c-485e-82e6-d2ae7eec35f6 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:45.784453 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad62d6-e51c-4b81-89bd-39a439790f06 service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:45.786578 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-75ad62d6-e51c-4b81-89bd-39a439790f06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:45.798781 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 990/1961] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:45.801220 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd7890-e73c-485e-82e6-d2ae7eec35f6 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:45.809047 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad62d6-e51c-4b81-89bd-39a439790f06 service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:45.814281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd7890-e73c-485e-82e6-d2ae7eec35f6 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:45.820356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136698e-1fe8-44bc-aa84-7e072e2b2e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:45.820623 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e186bcc-42ed-413a-8a78-c520dc3f615c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:45.821473 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136698e-1fe8-44bc-aa84-7e072e2b2e9b admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:45.821950 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136698e-1fe8-44bc-aa84-7e072e2b2e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:45.822432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136698e-1fe8-44bc-aa84-7e072e2b2e9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:45.822625 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e186bcc-42ed-413a-8a78-c520dc3f615c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:45.822990 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e186bcc-42ed-413a-8a78-c520dc3f615c admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:45.823369 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e186bcc-42ed-413a-8a78-c520dc3f615c admin admin] PATH_INFO: `/v3/users/889c98e0496d4453a1ac28cfaac71a1a` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:45.824752 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136698e-1fe8-44bc-aa84-7e072e2b2e9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:15:45.825160 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136698e-1fe8-44bc-aa84-7e072e2b2e9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:45.825276 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e186bcc-42ed-413a-8a78-c520dc3f615c admin admin] RBAC: Authorizing `identity:delete_user(user_id=889c98e0496d4453a1ac28cfaac71a1a)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:45.827461 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136698e-1fe8-44bc-aa84-7e072e2b2e9b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:45.828230 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e186bcc-42ed-413a-8a78-c520dc3f615c admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:45.845599 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 991/1962] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:15:45.848062 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136698e-1fe8-44bc-aa84-7e072e2b2e9b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:45.852003 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:45.881759 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136698e-1fe8-44bc-aa84-7e072e2b2e9b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:45.896387 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd099c8-8a01-471f-b108-b0c8abfcbca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:45.900466 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd099c8-8a01-471f-b108-b0c8abfcbca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:45.900753 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd099c8-8a01-471f-b108-b0c8abfcbca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:45.901032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd099c8-8a01-471f-b108-b0c8abfcbca4 admin admin] PATH_INFO: `/v3/projects/774cb5256b64420bb76d45aec1bedfa6/users/bf834ff7b6304e0689ebaad2606bda10/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:45.908046 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd099c8-8a01-471f-b108-b0c8abfcbca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=774cb5256b64420bb76d45aec1bedfa6, user_id=bf834ff7b6304e0689ebaad2606bda10, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:45.911090 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd099c8-8a01-471f-b108-b0c8abfcbca4 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:45.930661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4e186bcc-42ed-413a-8a78-c520dc3f615c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '889c98e0496d4453a1ac28cfaac71a1a'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:45.943223 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 992/1963] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:45 2022] PUT /identity/v3/projects/774cb5256b64420bb76d45aec1bedfa6/users/bf834ff7b6304e0689ebaad2606bda10/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:45.945133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd099c8-8a01-471f-b108-b0c8abfcbca4 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:45.947111 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4e186bcc-42ed-413a-8a78-c520dc3f615c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '889c98e0496d4453a1ac28cfaac71a1a'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:45.948037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4e186bcc-42ed-413a-8a78-c520dc3f615c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '889c98e0496d4453a1ac28cfaac71a1a'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:45.963291 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4e186bcc-42ed-413a-8a78-c520dc3f615c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '889c98e0496d4453a1ac28cfaac71a1a'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:45.974302 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4e186bcc-42ed-413a-8a78-c520dc3f615c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '889c98e0496d4453a1ac28cfaac71a1a'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:45.985009 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 972/1964] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:45 2022] DELETE /identity/v3/users/889c98e0496d4453a1ac28cfaac71a1a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:45.985009 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3fe6f-aee5-44ef-b2db-3be246d82c9f None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:45.985009 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3fe6f-aee5-44ef-b2db-3be246d82c9f None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:45.985009 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3fe6f-aee5-44ef-b2db-3be246d82c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:46.060666 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-29c3fe6f-aee5-44ef-b2db-3be246d82c9f None None] MFA Rules not processed for user `bf834ff7b6304e0689ebaad2606bda10`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:46.062761 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-29c3fe6f-aee5-44ef-b2db-3be246d82c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:46.087464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd099c8-8a01-471f-b108-b0c8abfcbca4 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:46.160121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0e4e7-f475-4da7-b1b8-fc3d7f1c3c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:46.168405 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0e4e7-f475-4da7-b1b8-fc3d7f1c3c45 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:46.168405 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0e4e7-f475-4da7-b1b8-fc3d7f1c3c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:46.168405 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0e4e7-f475-4da7-b1b8-fc3d7f1c3c45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:46.168405 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0e4e7-f475-4da7-b1b8-fc3d7f1c3c45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:46.168405 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0e4e7-f475-4da7-b1b8-fc3d7f1c3c45 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:46.174091 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 973/1965] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:46.186827 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3fe6f-aee5-44ef-b2db-3be246d82c9f None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:46.188341 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-29c3fe6f-aee5-44ef-b2db-3be246d82c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:46.217262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 993/1966] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:45 2022] POST /identity/v3/projects => generated 373 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:46.218151 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0e4e7-f475-4da7-b1b8-fc3d7f1c3c45 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:46.220082 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ffb0e4e7-f475-4da7-b1b8-fc3d7f1c3c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:46.234003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:46.275965 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3fe6f-aee5-44ef-b2db-3be246d82c9f None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:46.310683 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0e4e7-f475-4da7-b1b8-fc3d7f1c3c45 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:46.320183 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11f6f0-fa70-42a3-ac8b-053877eb3882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:46.320873 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11f6f0-fa70-42a3-ac8b-053877eb3882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:46.321152 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11f6f0-fa70-42a3-ac8b-053877eb3882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:46.321426 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11f6f0-fa70-42a3-ac8b-053877eb3882 admin admin] PATH_INFO: `/v3/projects/35a1a25c35ff4c1489c395bdab231a59` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:46.328880 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11f6f0-fa70-42a3-ac8b-053877eb3882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35a1a25c35ff4c1489c395bdab231a59)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:46.332990 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11f6f0-fa70-42a3-ac8b-053877eb3882 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:46.340935 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:46.376552 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fe940-7713-47d8-b96f-024c0d0ec702 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:46.377187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fe940-7713-47d8-b96f-024c0d0ec702 service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:46.377524 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fe940-7713-47d8-b96f-024c0d0ec702 service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:46.377748 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fe940-7713-47d8-b96f-024c0d0ec702 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:46.405441 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-aa11f6f0-fa70-42a3-ac8b-053877eb3882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35a1a25c35ff4c1489c395bdab231a59', 'request_id': 'req-aa11f6f0-fa70-42a3-ac8b-053877eb3882'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:46.414222 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-aa11f6f0-fa70-42a3-ac8b-053877eb3882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35a1a25c35ff4c1489c395bdab231a59', 'request_id': 'req-aa11f6f0-fa70-42a3-ac8b-053877eb3882'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:46.422095 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-aa11f6f0-fa70-42a3-ac8b-053877eb3882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35a1a25c35ff4c1489c395bdab231a59', 'request_id': 'req-aa11f6f0-fa70-42a3-ac8b-053877eb3882'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:46.441417 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-aa11f6f0-fa70-42a3-ac8b-053877eb3882 admin admin] The token cache is being invalidate because project 35a1a25c35ff4c1489c395bdab231a59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:46.441697 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-aa11f6f0-fa70-42a3-ac8b-053877eb3882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:46.442401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-aa11f6f0-fa70-42a3-ac8b-053877eb3882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:46.444706 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 994/1967] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:46 2022] DELETE /identity/v3/projects/35a1a25c35ff4c1489c395bdab231a59 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:46.446203 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11f6f0-fa70-42a3-ac8b-053877eb3882 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:46.449014 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-aa11f6f0-fa70-42a3-ac8b-053877eb3882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:46.484160 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fe940-7713-47d8-b96f-024c0d0ec702 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:46.485666 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fe940-7713-47d8-b96f-024c0d0ec702 service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:46.505615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 974/1968] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:15:46.507000 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fe940-7713-47d8-b96f-024c0d0ec702 service cinder] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:46.523489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fe940-7713-47d8-b96f-024c0d0ec702 service cinder] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:46.530025 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef809a9-4f06-496e-a5e3-d907f5dd3a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:46.530684 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef809a9-4f06-496e-a5e3-d907f5dd3a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:46.531253 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef809a9-4f06-496e-a5e3-d907f5dd3a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:46.531560 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef809a9-4f06-496e-a5e3-d907f5dd3a65 admin admin] PATH_INFO: `/v3/users/ef1477a232ec4adb855044114410623d` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:46.532930 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef809a9-4f06-496e-a5e3-d907f5dd3a65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef1477a232ec4adb855044114410623d)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:46.533749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11f6f0-fa70-42a3-ac8b-053877eb3882 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:46.535167 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef809a9-4f06-496e-a5e3-d907f5dd3a65 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:46.538941 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e0b11-02aa-4859-9438-f4ef7595640a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:46.539592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e0b11-02aa-4859-9438-f4ef7595640a admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:46.539875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e0b11-02aa-4859-9438-f4ef7595640a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:46.540150 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e0b11-02aa-4859-9438-f4ef7595640a admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:46.540821 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e0b11-02aa-4859-9438-f4ef7595640a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:46.543746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e0b11-02aa-4859-9438-f4ef7595640a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:46.583622 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 995/1969] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:46 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:46.587503 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e0b11-02aa-4859-9438-f4ef7595640a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:46.606852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e0b11-02aa-4859-9438-f4ef7595640a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:46.618459 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-5ef809a9-4f06-496e-a5e3-d907f5dd3a65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef1477a232ec4adb855044114410623d'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:46.627354 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad43ad5-b7cf-4eac-9d0d-6ab24b8f67ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:46.628150 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43ad5-b7cf-4eac-9d0d-6ab24b8f67ab admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:46.628434 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43ad5-b7cf-4eac-9d0d-6ab24b8f67ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:46.628703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43ad5-b7cf-4eac-9d0d-6ab24b8f67ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:46.629507 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad43ad5-b7cf-4eac-9d0d-6ab24b8f67ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:46.631333 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad43ad5-b7cf-4eac-9d0d-6ab24b8f67ab admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:46.637400 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-5ef809a9-4f06-496e-a5e3-d907f5dd3a65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef1477a232ec4adb855044114410623d'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:46.638254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-5ef809a9-4f06-496e-a5e3-d907f5dd3a65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef1477a232ec4adb855044114410623d'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:46.648060 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 996/1970] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:46.652383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad43ad5-b7cf-4eac-9d0d-6ab24b8f67ab admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:46.655184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5ad43ad5-b7cf-4eac-9d0d-6ab24b8f67ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:46.657011 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-5ef809a9-4f06-496e-a5e3-d907f5dd3a65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef1477a232ec4adb855044114410623d'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:46.675418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-5ef809a9-4f06-496e-a5e3-d907f5dd3a65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef1477a232ec4adb855044114410623d'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:46.685278 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 975/1971] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:46 2022] DELETE /identity/v3/users/ef1477a232ec4adb855044114410623d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:46.686302 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef809a9-4f06-496e-a5e3-d907f5dd3a65 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:46.687907 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-5ef809a9-4f06-496e-a5e3-d907f5dd3a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:46.709044 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad43ad5-b7cf-4eac-9d0d-6ab24b8f67ab admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:46.728632 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:46.773916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef809a9-4f06-496e-a5e3-d907f5dd3a65 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:46.779584 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293a2bf-e8ec-4b59-b2ac-a58e67a533af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:46.781070 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293a2bf-e8ec-4b59-b2ac-a58e67a533af service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:46.781633 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293a2bf-e8ec-4b59-b2ac-a58e67a533af service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:46.782485 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293a2bf-e8ec-4b59-b2ac-a58e67a533af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:46.785502 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-4293a2bf-e8ec-4b59-b2ac-a58e67a533af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:46.799695 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:46.854814 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b50f5-6830-4efe-a58f-352d8e4c02d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:46.856330 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b50f5-6830-4efe-a58f-352d8e4c02d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:46.857094 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b50f5-6830-4efe-a58f-352d8e4c02d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:46.857969 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b50f5-6830-4efe-a58f-352d8e4c02d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:46.860966 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b50f5-6830-4efe-a58f-352d8e4c02d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:46.866575 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b50f5-6830-4efe-a58f-352d8e4c02d7 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:46.891630 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 997/1972] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:15:46.895291 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293a2bf-e8ec-4b59-b2ac-a58e67a533af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:46.896181 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b50f5-6830-4efe-a58f-352d8e4c02d7 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:46.897539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293a2bf-e8ec-4b59-b2ac-a58e67a533af service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:46.909717 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 976/1973] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:46.912641 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b50f5-6830-4efe-a58f-352d8e4c02d7 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:46.917819 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d244593-500d-4739-9487-ef41d0794740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:46.918679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d244593-500d-4739-9487-ef41d0794740 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:46.918962 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d244593-500d-4739-9487-ef41d0794740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:46.919239 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d244593-500d-4739-9487-ef41d0794740 admin admin] PATH_INFO: `/v3/projects/268d4de5ad2b4c7bb78ef1718bd5b73f/users/bd0f934889a14c1e8e840ae3db4e6e08/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:46.941152 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d244593-500d-4739-9487-ef41d0794740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=268d4de5ad2b4c7bb78ef1718bd5b73f, user_id=bd0f934889a14c1e8e840ae3db4e6e08, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:46.944425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d244593-500d-4739-9487-ef41d0794740 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:46.963146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 998/1974] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:46 2022] PUT /identity/v3/projects/268d4de5ad2b4c7bb78ef1718bd5b73f/users/bd0f934889a14c1e8e840ae3db4e6e08/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:46.974072 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dce79f-fad2-41a2-877b-495995edb108 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:46.974363 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dce79f-fad2-41a2-877b-495995edb108 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:46.974639 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dce79f-fad2-41a2-877b-495995edb108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:46.987577 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d244593-500d-4739-9487-ef41d0794740 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:46.994049 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-1d244593-500d-4739-9487-ef41d0794740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:47.040090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-c2dce79f-fad2-41a2-877b-495995edb108 None None] MFA Rules not processed for user `bd0f934889a14c1e8e840ae3db4e6e08`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:47.041772 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-c2dce79f-fad2-41a2-877b-495995edb108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:47.083603 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d244593-500d-4739-9487-ef41d0794740 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:47.099465 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96343a5-819e-4b87-9d19-1d41a6fefb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:47.099465 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96343a5-819e-4b87-9d19-1d41a6fefb65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:47.099465 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96343a5-819e-4b87-9d19-1d41a6fefb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:47.099465 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96343a5-819e-4b87-9d19-1d41a6fefb65 admin admin] PATH_INFO: `/v3/projects/61df2c3cc0df4dfcb798e1026b516d5c` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:47.099916 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96343a5-819e-4b87-9d19-1d41a6fefb65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61df2c3cc0df4dfcb798e1026b516d5c)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:47.112376 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96343a5-819e-4b87-9d19-1d41a6fefb65 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:47.137558 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 977/1975] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:47.153364 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dce79f-fad2-41a2-877b-495995edb108 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:47.187621 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f96343a5-819e-4b87-9d19-1d41a6fefb65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61df2c3cc0df4dfcb798e1026b516d5c', 'request_id': 'req-f96343a5-819e-4b87-9d19-1d41a6fefb65'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:47.196745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f96343a5-819e-4b87-9d19-1d41a6fefb65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61df2c3cc0df4dfcb798e1026b516d5c', 'request_id': 'req-f96343a5-819e-4b87-9d19-1d41a6fefb65'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:47.218493 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f96343a5-819e-4b87-9d19-1d41a6fefb65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61df2c3cc0df4dfcb798e1026b516d5c', 'request_id': 'req-f96343a5-819e-4b87-9d19-1d41a6fefb65'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:47.235265 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f96343a5-819e-4b87-9d19-1d41a6fefb65 admin admin] The token cache is being invalidate because project 61df2c3cc0df4dfcb798e1026b516d5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:47.235617 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f96343a5-819e-4b87-9d19-1d41a6fefb65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:47.236447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f96343a5-819e-4b87-9d19-1d41a6fefb65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:47.241589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 999/1976] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:46 2022] DELETE /identity/v3/projects/61df2c3cc0df4dfcb798e1026b516d5c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:47.241753 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dce79f-fad2-41a2-877b-495995edb108 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:47.243779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa561bc-8ddd-4cf5-8539-fa282ee6d30a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:47.244162 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa561bc-8ddd-4cf5-8539-fa282ee6d30a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:47.244612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa561bc-8ddd-4cf5-8539-fa282ee6d30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:47.273015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-9fa561bc-8ddd-4cf5-8539-fa282ee6d30a None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:47.274722 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9fa561bc-8ddd-4cf5-8539-fa282ee6d30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:47.294306 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:47.326363 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c1230-34d0-4c0e-8cd3-788755462c03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:47.326999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c1230-34d0-4c0e-8cd3-788755462c03 service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:47.327349 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c1230-34d0-4c0e-8cd3-788755462c03 service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:47.328246 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c1230-34d0-4c0e-8cd3-788755462c03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:47.330569 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-e29c1230-34d0-4c0e-8cd3-788755462c03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:47.363351 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:47.425633 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1000/1977] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:47.426979 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa561bc-8ddd-4cf5-8539-fa282ee6d30a None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:47.429172 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9fa561bc-8ddd-4cf5-8539-fa282ee6d30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:47.459861 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa561bc-8ddd-4cf5-8539-fa282ee6d30a None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:47.472191 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5140675d-9003-4a62-9b7e-d6715dacd52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:47.472857 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140675d-9003-4a62-9b7e-d6715dacd52e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:47.473140 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140675d-9003-4a62-9b7e-d6715dacd52e admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:47.473417 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140675d-9003-4a62-9b7e-d6715dacd52e admin admin] PATH_INFO: `/v3/users/6173bb35c4d3444f8951c00649b8b3b6` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:47.475740 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5140675d-9003-4a62-9b7e-d6715dacd52e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6173bb35c4d3444f8951c00649b8b3b6)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:47.477710 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5140675d-9003-4a62-9b7e-d6715dacd52e admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:47.510331 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c1230-34d0-4c0e-8cd3-788755462c03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:47.512556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c1230-34d0-4c0e-8cd3-788755462c03 service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:47.525786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 978/1978] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:15:47.527193 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052837a-b245-44d0-aa0c-d4e5f82e1c3f None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:47.528638 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052837a-b245-44d0-aa0c-d4e5f82e1c3f None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:47.528922 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052837a-b245-44d0-aa0c-d4e5f82e1c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:47.565493 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5140675d-9003-4a62-9b7e-d6715dacd52e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6173bb35c4d3444f8951c00649b8b3b6'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:47.567923 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5140675d-9003-4a62-9b7e-d6715dacd52e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6173bb35c4d3444f8951c00649b8b3b6'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:47.569066 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-c052837a-b245-44d0-aa0c-d4e5f82e1c3f None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:47.570462 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-c052837a-b245-44d0-aa0c-d4e5f82e1c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:47.581012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5140675d-9003-4a62-9b7e-d6715dacd52e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6173bb35c4d3444f8951c00649b8b3b6'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:47.581982 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 979/1979] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:47.583164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052837a-b245-44d0-aa0c-d4e5f82e1c3f None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:47.585692 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-c052837a-b245-44d0-aa0c-d4e5f82e1c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:47.607667 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052837a-b245-44d0-aa0c-d4e5f82e1c3f None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:47.614379 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5140675d-9003-4a62-9b7e-d6715dacd52e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6173bb35c4d3444f8951c00649b8b3b6'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:47.614379 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5140675d-9003-4a62-9b7e-d6715dacd52e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6173bb35c4d3444f8951c00649b8b3b6'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:47.614635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da69fb6-937e-46cf-a330-4b0433f001df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:47.615232 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da69fb6-937e-46cf-a330-4b0433f001df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:47.615669 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da69fb6-937e-46cf-a330-4b0433f001df admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:47.616466 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da69fb6-937e-46cf-a330-4b0433f001df admin admin] PATH_INFO: `/v3/users/bd0f934889a14c1e8e840ae3db4e6e08` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:47.618251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da69fb6-937e-46cf-a330-4b0433f001df admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd0f934889a14c1e8e840ae3db4e6e08)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:47.620840 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da69fb6-937e-46cf-a330-4b0433f001df admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:47.639824 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1001/1980] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:47 2022] DELETE /identity/v3/users/6173bb35c4d3444f8951c00649b8b3b6 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:47.641017 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5140675d-9003-4a62-9b7e-d6715dacd52e admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:47.694839 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4da69fb6-937e-46cf-a330-4b0433f001df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd0f934889a14c1e8e840ae3db4e6e08'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:47.716963 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4da69fb6-937e-46cf-a330-4b0433f001df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd0f934889a14c1e8e840ae3db4e6e08'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:47.717718 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4da69fb6-937e-46cf-a330-4b0433f001df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd0f934889a14c1e8e840ae3db4e6e08'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:47.726553 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5140675d-9003-4a62-9b7e-d6715dacd52e admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:47.732108 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574e3cc-b939-4a1e-8f5a-f2dba53271fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:47.732882 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574e3cc-b939-4a1e-8f5a-f2dba53271fe admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:47.733249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574e3cc-b939-4a1e-8f5a-f2dba53271fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:47.733521 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574e3cc-b939-4a1e-8f5a-f2dba53271fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:47.734313 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574e3cc-b939-4a1e-8f5a-f2dba53271fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:15:47.734696 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574e3cc-b939-4a1e-8f5a-f2dba53271fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:47.735202 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4da69fb6-937e-46cf-a330-4b0433f001df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd0f934889a14c1e8e840ae3db4e6e08'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:47.736758 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574e3cc-b939-4a1e-8f5a-f2dba53271fe admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:47.745205 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4da69fb6-937e-46cf-a330-4b0433f001df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd0f934889a14c1e8e840ae3db4e6e08'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:47.751212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1002/1981] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:15:47.752351 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574e3cc-b939-4a1e-8f5a-f2dba53271fe admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:47.752766 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 980/1982] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:47 2022] DELETE /identity/v3/users/bd0f934889a14c1e8e840ae3db4e6e08 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:47.754318 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d34ed-ac0e-44c3-a27d-5364619f7b8e None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:47.754528 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3574e3cc-b939-4a1e-8f5a-f2dba53271fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:47.755068 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d34ed-ac0e-44c3-a27d-5364619f7b8e None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:47.755474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d34ed-ac0e-44c3-a27d-5364619f7b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:47.770653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574e3cc-b939-4a1e-8f5a-f2dba53271fe admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:47.776146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-807d34ed-ac0e-44c3-a27d-5364619f7b8e None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:47.777893 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-807d34ed-ac0e-44c3-a27d-5364619f7b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:47.809012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:47.885198 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877655d-052b-4cde-a26c-6ce6753da72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:47.886071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877655d-052b-4cde-a26c-6ce6753da72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:47.886424 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877655d-052b-4cde-a26c-6ce6753da72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:47.886805 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877655d-052b-4cde-a26c-6ce6753da72c admin admin] PATH_INFO: `/v3/projects/603b6e2439a94ad398747e26ca863b81` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:47.888298 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877655d-052b-4cde-a26c-6ce6753da72c admin admin] RBAC: Authorizing `identity:delete_project(project_id=603b6e2439a94ad398747e26ca863b81)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:47.894507 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877655d-052b-4cde-a26c-6ce6753da72c admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:47.898563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 981/1983] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:47.900413 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2c3ff-bcde-4022-b587-4540594950d5 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:47.900705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2c3ff-bcde-4022-b587-4540594950d5 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:47.900981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2c3ff-bcde-4022-b587-4540594950d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:47.924025 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-b1f2c3ff-bcde-4022-b587-4540594950d5 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:47.925361 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b1f2c3ff-bcde-4022-b587-4540594950d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:47.937561 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 982/1984] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:47.938424 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2c3ff-bcde-4022-b587-4540594950d5 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:47.939826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b1f2c3ff-bcde-4022-b587-4540594950d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:47.955894 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2c3ff-bcde-4022-b587-4540594950d5 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:47.971743 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8441bf-987b-41b8-af7b-926bc23ac869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:47.972536 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8441bf-987b-41b8-af7b-926bc23ac869 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:47.972830 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8441bf-987b-41b8-af7b-926bc23ac869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:47.973165 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8441bf-987b-41b8-af7b-926bc23ac869 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:47.973820 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8441bf-987b-41b8-af7b-926bc23ac869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:47.976298 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8441bf-987b-41b8-af7b-926bc23ac869 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:47.978571 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9877655d-052b-4cde-a26c-6ce6753da72c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '603b6e2439a94ad398747e26ca863b81', 'request_id': 'req-9877655d-052b-4cde-a26c-6ce6753da72c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:47.988840 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9877655d-052b-4cde-a26c-6ce6753da72c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '603b6e2439a94ad398747e26ca863b81', 'request_id': 'req-9877655d-052b-4cde-a26c-6ce6753da72c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:47.998329 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9877655d-052b-4cde-a26c-6ce6753da72c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '603b6e2439a94ad398747e26ca863b81', 'request_id': 'req-9877655d-052b-4cde-a26c-6ce6753da72c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:47.999376 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:48.021611 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9877655d-052b-4cde-a26c-6ce6753da72c admin admin] The token cache is being invalidate because project 603b6e2439a94ad398747e26ca863b81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:48.022393 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9877655d-052b-4cde-a26c-6ce6753da72c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:48.023420 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9877655d-052b-4cde-a26c-6ce6753da72c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:48.026178 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1003/1985] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:47 2022] DELETE /identity/v3/projects/603b6e2439a94ad398747e26ca863b81 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:48.028154 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877655d-052b-4cde-a26c-6ce6753da72c admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:48.030761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9877655d-052b-4cde-a26c-6ce6753da72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:48.053311 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 983/1986] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:47 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:48.055578 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8441bf-987b-41b8-af7b-926bc23ac869 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:48.059723 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-4e8441bf-987b-41b8-af7b-926bc23ac869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:48.127628 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877655d-052b-4cde-a26c-6ce6753da72c admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:48.180105 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8441bf-987b-41b8-af7b-926bc23ac869 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:48.185858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ee6cc-15da-4f1a-8f0d-bc994606e83a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:48.186498 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ee6cc-15da-4f1a-8f0d-bc994606e83a service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:48.186782 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ee6cc-15da-4f1a-8f0d-bc994606e83a service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:48.187460 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ee6cc-15da-4f1a-8f0d-bc994606e83a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:48.189937 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-1f2ee6cc-15da-4f1a-8f0d-bc994606e83a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:48.197176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808bedf-9757-4acc-9a69-9143f52a62b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:48.198402 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808bedf-9757-4acc-9a69-9143f52a62b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:48.199345 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808bedf-9757-4acc-9a69-9143f52a62b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:48.199680 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808bedf-9757-4acc-9a69-9143f52a62b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:48.202336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-1808bedf-9757-4acc-9a69-9143f52a62b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:48.238795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:48.286781 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ee6cc-15da-4f1a-8f0d-bc994606e83a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:48.288600 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ee6cc-15da-4f1a-8f0d-bc994606e83a service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:48.293191 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808bedf-9757-4acc-9a69-9143f52a62b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:48.295512 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808bedf-9757-4acc-9a69-9143f52a62b6 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:48.302623 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 984/1987] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:48.304460 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730dc138-8aa3-487c-996b-9c35c6f00d93 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:48.304907 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730dc138-8aa3-487c-996b-9c35c6f00d93 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:48.305211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730dc138-8aa3-487c-996b-9c35c6f00d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:48.307244 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1004/1988] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:48.308274 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808bedf-9757-4acc-9a69-9143f52a62b6 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:48.309592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-1808bedf-9757-4acc-9a69-9143f52a62b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:48.321781 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808bedf-9757-4acc-9a69-9143f52a62b6 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:48.327500 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ca938-79aa-43eb-b650-8d30a474292d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:48.327946 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ca938-79aa-43eb-b650-8d30a474292d admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:48.328187 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ca938-79aa-43eb-b650-8d30a474292d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:48.328459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ca938-79aa-43eb-b650-8d30a474292d admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:48.329252 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ca938-79aa-43eb-b650-8d30a474292d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:48.331205 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ca938-79aa-43eb-b650-8d30a474292d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:48.331900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-730dc138-8aa3-487c-996b-9c35c6f00d93 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:48.333591 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-730dc138-8aa3-487c-996b-9c35c6f00d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:48.352814 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 985/1989] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:48.355535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf463fcd-aa81-45f8-9ec6-df7a846c72d8 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:48.356076 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf463fcd-aa81-45f8-9ec6-df7a846c72d8 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:48.356598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf463fcd-aa81-45f8-9ec6-df7a846c72d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:48.362759 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1005/1990] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:48 2022] POST /identity/v3/users => generated 292 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:48.367870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ca938-79aa-43eb-b650-8d30a474292d admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:48.381310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-cf463fcd-aa81-45f8-9ec6-df7a846c72d8 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:48.382940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-cf463fcd-aa81-45f8-9ec6-df7a846c72d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:48.388097 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ca938-79aa-43eb-b650-8d30a474292d admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:48.395679 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 986/1991] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:48.396395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e445ba-5999-495a-b197-a4df2420e268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:48.396981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf463fcd-aa81-45f8-9ec6-df7a846c72d8 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:48.397098 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e445ba-5999-495a-b197-a4df2420e268 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:48.397308 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e445ba-5999-495a-b197-a4df2420e268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:48.397596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e445ba-5999-495a-b197-a4df2420e268 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:48.398379 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e445ba-5999-495a-b197-a4df2420e268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:48.400041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e445ba-5999-495a-b197-a4df2420e268 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:48.409565 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf463fcd-aa81-45f8-9ec6-df7a846c72d8 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:48.418715 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1006/1992] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:48.420144 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e445ba-5999-495a-b197-a4df2420e268 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:48.420932 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126a9d9-c6b8-421a-b7b0-50ed2dedd174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:48.422137 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126a9d9-c6b8-421a-b7b0-50ed2dedd174 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:48.422835 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126a9d9-c6b8-421a-b7b0-50ed2dedd174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:48.423211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126a9d9-c6b8-421a-b7b0-50ed2dedd174 admin admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:48.424008 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126a9d9-c6b8-421a-b7b0-50ed2dedd174 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:15:48.424478 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126a9d9-c6b8-421a-b7b0-50ed2dedd174 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:48.426237 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126a9d9-c6b8-421a-b7b0-50ed2dedd174 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:48.433242 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e445ba-5999-495a-b197-a4df2420e268 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:48.438166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7d016-c798-45b0-aaf7-2450a3622176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:48.438928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7d016-c798-45b0-aaf7-2450a3622176 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:48.439211 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7d016-c798-45b0-aaf7-2450a3622176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:48.439522 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7d016-c798-45b0-aaf7-2450a3622176 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:48.440171 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7d016-c798-45b0-aaf7-2450a3622176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:48.443493 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7d016-c798-45b0-aaf7-2450a3622176 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:48.443989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 987/1993] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:15:48.447796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126a9d9-c6b8-421a-b7b0-50ed2dedd174 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:48.463005 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1007/1994] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:48.464761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7d016-c798-45b0-aaf7-2450a3622176 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:48.465595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126a9d9-c6b8-421a-b7b0-50ed2dedd174 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:48.472276 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597add5b-245d-42bc-8057-5ea71c67eb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:48.473506 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597add5b-245d-42bc-8057-5ea71c67eb2c admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:48.474006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597add5b-245d-42bc-8057-5ea71c67eb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:48.475743 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597add5b-245d-42bc-8057-5ea71c67eb2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:48.478889 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597add5b-245d-42bc-8057-5ea71c67eb2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:48.482096 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597add5b-245d-42bc-8057-5ea71c67eb2c admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:48.482786 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7d016-c798-45b0-aaf7-2450a3622176 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:48.489188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a42917-a7ca-4862-867b-1c2aa2526c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:48.489986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a42917-a7ca-4862-867b-1c2aa2526c4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:48.490440 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a42917-a7ca-4862-867b-1c2aa2526c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:48.491399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a42917-a7ca-4862-867b-1c2aa2526c4b admin admin] PATH_INFO: `/v3/projects/c59803c81b594a0d8337e510f7d8c736/users/d3da04d6da8943df91a6a3e37d6456dc/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:48.512734 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a42917-a7ca-4862-867b-1c2aa2526c4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c59803c81b594a0d8337e510f7d8c736, user_id=d3da04d6da8943df91a6a3e37d6456dc, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:48.515609 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a42917-a7ca-4862-867b-1c2aa2526c4b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:48.530574 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 988/1995] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:48 2022] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:48.534936 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597add5b-245d-42bc-8057-5ea71c67eb2c admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:48.547471 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1008/1996] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:48 2022] PUT /identity/v3/projects/c59803c81b594a0d8337e510f7d8c736/users/d3da04d6da8943df91a6a3e37d6456dc/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:48.553651 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc288b-27ae-48fa-8b8b-9bab76612dc1 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:48.554390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc288b-27ae-48fa-8b8b-9bab76612dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:48.554807 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc288b-27ae-48fa-8b8b-9bab76612dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:48.600976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-02cc288b-27ae-48fa-8b8b-9bab76612dc1 None None] MFA Rules not processed for user `d3da04d6da8943df91a6a3e37d6456dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:48.602796 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-02cc288b-27ae-48fa-8b8b-9bab76612dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:48.624855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:48.675315 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597add5b-245d-42bc-8057-5ea71c67eb2c admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:48.688268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d9eef-b08e-4741-be66-c58d1b67e348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:48.688906 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d9eef-b08e-4741-be66-c58d1b67e348 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:48.689188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d9eef-b08e-4741-be66-c58d1b67e348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:48.689512 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d9eef-b08e-4741-be66-c58d1b67e348 admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:48.690169 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d9eef-b08e-4741-be66-c58d1b67e348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:48.698298 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d9eef-b08e-4741-be66-c58d1b67e348 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:48.765345 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 989/1997] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:48 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:48.772829 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d9eef-b08e-4741-be66-c58d1b67e348 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:48.799958 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d9eef-b08e-4741-be66-c58d1b67e348 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:48.809008 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bdcfcd-bf3d-4bd6-b7f1-e31765bc0f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:48.810381 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdcfcd-bf3d-4bd6-b7f1-e31765bc0f6c admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:48.810669 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdcfcd-bf3d-4bd6-b7f1-e31765bc0f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:48.810948 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdcfcd-bf3d-4bd6-b7f1-e31765bc0f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:48.811635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bdcfcd-bf3d-4bd6-b7f1-e31765bc0f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:48.813127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1009/1998] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:15:48.816780 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc288b-27ae-48fa-8b8b-9bab76612dc1 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:48.817285 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bdcfcd-bf3d-4bd6-b7f1-e31765bc0f6c admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:48.831075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc288b-27ae-48fa-8b8b-9bab76612dc1 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:48.836768 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 990/1999] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:48.838200 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bdcfcd-bf3d-4bd6-b7f1-e31765bc0f6c admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:48.840352 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7740cb7-4f5a-48bc-a33a-18d43da27e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:48.840983 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7740cb7-4f5a-48bc-a33a-18d43da27e48 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:48.841265 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7740cb7-4f5a-48bc-a33a-18d43da27e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:48.841539 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7740cb7-4f5a-48bc-a33a-18d43da27e48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:48.842240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7740cb7-4f5a-48bc-a33a-18d43da27e48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:48.844196 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7740cb7-4f5a-48bc-a33a-18d43da27e48 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:48.852387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bdcfcd-bf3d-4bd6-b7f1-e31765bc0f6c admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:48.862063 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d78430-592e-49e0-b0b6-38b2a5e13cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:48.862860 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d78430-592e-49e0-b0b6-38b2a5e13cea admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:48.863148 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d78430-592e-49e0-b0b6-38b2a5e13cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:48.863461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d78430-592e-49e0-b0b6-38b2a5e13cea admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:48.864652 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d78430-592e-49e0-b0b6-38b2a5e13cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:48.869155 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d78430-592e-49e0-b0b6-38b2a5e13cea admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:48.887015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1010/2000] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:48 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:48.892521 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7740cb7-4f5a-48bc-a33a-18d43da27e48 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:48.894008 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 991/2001] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:48.898446 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d78430-592e-49e0-b0b6-38b2a5e13cea admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:48.909571 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d78430-592e-49e0-b0b6-38b2a5e13cea admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:48.962226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:49.000905 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850235ee-0f94-4089-a58f-26c19b0e3b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:49.001584 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850235ee-0f94-4089-a58f-26c19b0e3b9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:49.001862 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850235ee-0f94-4089-a58f-26c19b0e3b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:49.002140 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850235ee-0f94-4089-a58f-26c19b0e3b9a admin admin] PATH_INFO: `/v3/projects/a9b52d689a7f4b02b4c016a0f9fcd1e7/users/e91fd62d38954429a492c2fcc2cd04e7/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:49.026366 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7740cb7-4f5a-48bc-a33a-18d43da27e48 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:49.043862 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17543ddf-bdad-40a6-8350-f913448dfcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:49.046147 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17543ddf-bdad-40a6-8350-f913448dfcf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:49.048688 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17543ddf-bdad-40a6-8350-f913448dfcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:49.049759 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17543ddf-bdad-40a6-8350-f913448dfcf4 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:49.052220 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17543ddf-bdad-40a6-8350-f913448dfcf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:49.052528 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850235ee-0f94-4089-a58f-26c19b0e3b9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9b52d689a7f4b02b4c016a0f9fcd1e7, user_id=e91fd62d38954429a492c2fcc2cd04e7, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:49.054662 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17543ddf-bdad-40a6-8350-f913448dfcf4 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:49.064803 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850235ee-0f94-4089-a58f-26c19b0e3b9a admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:49.094741 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1011/2002] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:48 2022] POST /identity/v3/users => generated 298 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:49.100785 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17543ddf-bdad-40a6-8350-f913448dfcf4 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:49.117556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 992/2003] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:48 2022] PUT /identity/v3/projects/a9b52d689a7f4b02b4c016a0f9fcd1e7/users/e91fd62d38954429a492c2fcc2cd04e7/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:49.122210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bfebe-2df6-4c85-a32d-6fdc05a28fde None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:49.122995 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bfebe-2df6-4c85-a32d-6fdc05a28fde None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:49.123358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bfebe-2df6-4c85-a32d-6fdc05a28fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:49.124856 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17543ddf-bdad-40a6-8350-f913448dfcf4 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:49.161927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-320bfebe-2df6-4c85-a32d-6fdc05a28fde None None] MFA Rules not processed for user `e91fd62d38954429a492c2fcc2cd04e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:49.163274 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-320bfebe-2df6-4c85-a32d-6fdc05a28fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:49.258191 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c59aa-1ad4-451d-a29e-24a087889007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:49.258191 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c59aa-1ad4-451d-a29e-24a087889007 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:49.258191 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c59aa-1ad4-451d-a29e-24a087889007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:49.258191 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c59aa-1ad4-451d-a29e-24a087889007 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:49.258992 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c59aa-1ad4-451d-a29e-24a087889007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:49.260093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c59aa-1ad4-451d-a29e-24a087889007 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:49.270842 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 993/2004] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:49.272787 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bfebe-2df6-4c85-a32d-6fdc05a28fde None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:49.281146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-320bfebe-2df6-4c85-a32d-6fdc05a28fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:49.298232 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1012/2005] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:49.299565 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c59aa-1ad4-451d-a29e-24a087889007 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:49.304061 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-278c59aa-1ad4-451d-a29e-24a087889007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:49.317052 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bfebe-2df6-4c85-a32d-6fdc05a28fde None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:49.326243 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e7cc6-fcb2-4d4b-8801-ffb3909f6869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:49.327809 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e7cc6-fcb2-4d4b-8801-ffb3909f6869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:49.328365 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e7cc6-fcb2-4d4b-8801-ffb3909f6869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:49.328820 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e7cc6-fcb2-4d4b-8801-ffb3909f6869 admin admin] PATH_INFO: `/v3/projects/e1a6eb96ccee4acabac1120de081f257` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:49.330421 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e7cc6-fcb2-4d4b-8801-ffb3909f6869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1a6eb96ccee4acabac1120de081f257)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:49.333378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e7cc6-fcb2-4d4b-8801-ffb3909f6869 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:49.369687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c59aa-1ad4-451d-a29e-24a087889007 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:49.374454 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ffb40-d99c-44b1-b990-46bff8692657 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:49.376338 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ffb40-d99c-44b1-b990-46bff8692657 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:49.376338 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ffb40-d99c-44b1-b990-46bff8692657 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:49.376338 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ffb40-d99c-44b1-b990-46bff8692657 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:49.386055 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ffb40-d99c-44b1-b990-46bff8692657 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:49.387598 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ffb40-d99c-44b1-b990-46bff8692657 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:49.389153 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:49.406251 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1013/2006] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:49.406555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ffb40-d99c-44b1-b990-46bff8692657 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:49.420453 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-340e7cc6-fcb2-4d4b-8801-ffb3909f6869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1a6eb96ccee4acabac1120de081f257', 'request_id': 'req-340e7cc6-fcb2-4d4b-8801-ffb3909f6869'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:49.426378 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ffb40-d99c-44b1-b990-46bff8692657 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:49.436210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-340e7cc6-fcb2-4d4b-8801-ffb3909f6869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1a6eb96ccee4acabac1120de081f257', 'request_id': 'req-340e7cc6-fcb2-4d4b-8801-ffb3909f6869'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:49.453818 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-340e7cc6-fcb2-4d4b-8801-ffb3909f6869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1a6eb96ccee4acabac1120de081f257', 'request_id': 'req-340e7cc6-fcb2-4d4b-8801-ffb3909f6869'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:49.473841 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-340e7cc6-fcb2-4d4b-8801-ffb3909f6869 admin admin] The token cache is being invalidate because project e1a6eb96ccee4acabac1120de081f257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:49.474134 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-340e7cc6-fcb2-4d4b-8801-ffb3909f6869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:49.474867 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-340e7cc6-fcb2-4d4b-8801-ffb3909f6869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:49.477234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 994/2007] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:49 2022] DELETE /identity/v3/projects/e1a6eb96ccee4acabac1120de081f257 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:49.481508 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e7cc6-fcb2-4d4b-8801-ffb3909f6869 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:49.487270 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-340e7cc6-fcb2-4d4b-8801-ffb3909f6869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:49.497178 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:49.509417 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a004c-25d6-4e49-84d0-55d4864a1b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:49.526252 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a004c-25d6-4e49-84d0-55d4864a1b23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:49.526657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a004c-25d6-4e49-84d0-55d4864a1b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:49.527936 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a004c-25d6-4e49-84d0-55d4864a1b23 admin admin] PATH_INFO: `/v3/projects/f6ad504ad3d642c8af4cecc740c5001a/users/6d6743620e994283af0e1877e5a1c1bc/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:49.597458 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a004c-25d6-4e49-84d0-55d4864a1b23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ad504ad3d642c8af4cecc740c5001a, user_id=6d6743620e994283af0e1877e5a1c1bc, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:49.610929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a004c-25d6-4e49-84d0-55d4864a1b23 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:49.626382 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e7cc6-fcb2-4d4b-8801-ffb3909f6869 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:49.642866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf477953-4805-4118-a83b-132c720006ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:49.643564 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf477953-4805-4118-a83b-132c720006ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:49.644026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf477953-4805-4118-a83b-132c720006ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:49.644328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf477953-4805-4118-a83b-132c720006ed admin admin] PATH_INFO: `/v3/users/bf834ff7b6304e0689ebaad2606bda10` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:49.645498 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf477953-4805-4118-a83b-132c720006ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf834ff7b6304e0689ebaad2606bda10)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:49.647526 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf477953-4805-4118-a83b-132c720006ed admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:49.659320 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1014/2008] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:49 2022] PUT /identity/v3/projects/f6ad504ad3d642c8af4cecc740c5001a/users/6d6743620e994283af0e1877e5a1c1bc/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:49.660779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a004c-25d6-4e49-84d0-55d4864a1b23 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:49.668806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-007a004c-25d6-4e49-84d0-55d4864a1b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:49.777803 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-cf477953-4805-4118-a83b-132c720006ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf834ff7b6304e0689ebaad2606bda10'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:49.827781 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a004c-25d6-4e49-84d0-55d4864a1b23 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:49.834093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7de59-0e19-44b1-931a-33bb110935e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:49.834277 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7de59-0e19-44b1-931a-33bb110935e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:49.834472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7de59-0e19-44b1-931a-33bb110935e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:49.834896 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7de59-0e19-44b1-931a-33bb110935e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:49.835705 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7de59-0e19-44b1-931a-33bb110935e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:49.837158 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-cf477953-4805-4118-a83b-132c720006ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf834ff7b6304e0689ebaad2606bda10'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:49.837737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7de59-0e19-44b1-931a-33bb110935e1 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:49.839519 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-cf477953-4805-4118-a83b-132c720006ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf834ff7b6304e0689ebaad2606bda10'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:49.854987 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-cf477953-4805-4118-a83b-132c720006ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf834ff7b6304e0689ebaad2606bda10'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:49.868882 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-cf477953-4805-4118-a83b-132c720006ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf834ff7b6304e0689ebaad2606bda10'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:49.874209 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1015/2009] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:49.878861 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7de59-0e19-44b1-931a-33bb110935e1 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:49.883148 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 995/2010] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:49 2022] DELETE /identity/v3/users/bf834ff7b6304e0689ebaad2606bda10 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:49.901454 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-1fc7de59-0e19-44b1-931a-33bb110935e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:49.937109 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf477953-4805-4118-a83b-132c720006ed admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:49.938764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-cf477953-4805-4118-a83b-132c720006ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:49.963333 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7de59-0e19-44b1-931a-33bb110935e1 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:50.078398 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:50.132374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d784f-8a38-4ee2-974c-353d16baf9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:50.133216 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d784f-8a38-4ee2-974c-353d16baf9c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:50.133391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d784f-8a38-4ee2-974c-353d16baf9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:50.133668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d784f-8a38-4ee2-974c-353d16baf9c3 admin admin] PATH_INFO: `/v3/projects/f6ad504ad3d642c8af4cecc740c5001a/users/6d6743620e994283af0e1877e5a1c1bc/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:50.136679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d784f-8a38-4ee2-974c-353d16baf9c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ad504ad3d642c8af4cecc740c5001a, user_id=6d6743620e994283af0e1877e5a1c1bc, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:50.139497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d784f-8a38-4ee2-974c-353d16baf9c3 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:50.146851 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf477953-4805-4118-a83b-132c720006ed admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:50.166492 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1016/2011] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:49 2022] PUT /identity/v3/projects/f6ad504ad3d642c8af4cecc740c5001a/users/6d6743620e994283af0e1877e5a1c1bc/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:50.170156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50993bb5-1444-464c-812a-94407d5f9c5c None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:50.170638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50993bb5-1444-464c-812a-94407d5f9c5c None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:50.171212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50993bb5-1444-464c-812a-94407d5f9c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:50.243705 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-50993bb5-1444-464c-812a-94407d5f9c5c None None] MFA Rules not processed for user `6d6743620e994283af0e1877e5a1c1bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:50.248808 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-50993bb5-1444-464c-812a-94407d5f9c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:50.301239 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebac61-9bb2-4209-ba3f-20ddb9f80b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:50.302187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebac61-9bb2-4209-ba3f-20ddb9f80b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:50.302450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebac61-9bb2-4209-ba3f-20ddb9f80b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:50.303236 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebac61-9bb2-4209-ba3f-20ddb9f80b35 admin admin] PATH_INFO: `/v3/projects/268d4de5ad2b4c7bb78ef1718bd5b73f` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:50.305172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ebac61-9bb2-4209-ba3f-20ddb9f80b35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=268d4de5ad2b4c7bb78ef1718bd5b73f)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:50.307627 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ebac61-9bb2-4209-ba3f-20ddb9f80b35 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:50.365810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:50.382298 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1017/2012] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:50.393709 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50993bb5-1444-464c-812a-94407d5f9c5c None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:50.399009 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-52ebac61-9bb2-4209-ba3f-20ddb9f80b35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '268d4de5ad2b4c7bb78ef1718bd5b73f', 'request_id': 'req-52ebac61-9bb2-4209-ba3f-20ddb9f80b35'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:50.399348 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-50993bb5-1444-464c-812a-94407d5f9c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:50.409730 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-52ebac61-9bb2-4209-ba3f-20ddb9f80b35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '268d4de5ad2b4c7bb78ef1718bd5b73f', 'request_id': 'req-52ebac61-9bb2-4209-ba3f-20ddb9f80b35'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:50.421412 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-52ebac61-9bb2-4209-ba3f-20ddb9f80b35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '268d4de5ad2b4c7bb78ef1718bd5b73f', 'request_id': 'req-52ebac61-9bb2-4209-ba3f-20ddb9f80b35'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:50.443537 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-52ebac61-9bb2-4209-ba3f-20ddb9f80b35 admin admin] The token cache is being invalidate because project 268d4de5ad2b4c7bb78ef1718bd5b73f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:50.443920 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-52ebac61-9bb2-4209-ba3f-20ddb9f80b35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:50.444665 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-52ebac61-9bb2-4209-ba3f-20ddb9f80b35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:50.450204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 996/2013] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:49 2022] DELETE /identity/v3/projects/268d4de5ad2b4c7bb78ef1718bd5b73f => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:50.452552 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2393c-60d1-4a18-a4e9-27aa1b037524 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:50.452911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2393c-60d1-4a18-a4e9-27aa1b037524 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:50.453258 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2393c-60d1-4a18-a4e9-27aa1b037524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:50.495304 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50993bb5-1444-464c-812a-94407d5f9c5c None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:50.501414 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-abb2393c-60d1-4a18-a4e9-27aa1b037524 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:50.509526 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-abb2393c-60d1-4a18-a4e9-27aa1b037524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:50.565503 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006b5fa-8709-4ed7-a737-05a77cd9552f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:50.566714 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006b5fa-8709-4ed7-a737-05a77cd9552f service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:50.566997 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006b5fa-8709-4ed7-a737-05a77cd9552f service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:50.567273 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006b5fa-8709-4ed7-a737-05a77cd9552f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:50.571088 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e006b5fa-8709-4ed7-a737-05a77cd9552f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:50.642476 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 997/2014] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:50.642476 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2393c-60d1-4a18-a4e9-27aa1b037524 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:50.648881 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-abb2393c-60d1-4a18-a4e9-27aa1b037524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:50.688142 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2393c-60d1-4a18-a4e9-27aa1b037524 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:50.704156 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d6e00-35ac-4f2d-80e8-0150e7262034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:50.704156 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d6e00-35ac-4f2d-80e8-0150e7262034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:50.704156 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d6e00-35ac-4f2d-80e8-0150e7262034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:50.704156 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d6e00-35ac-4f2d-80e8-0150e7262034 admin admin] PATH_INFO: `/v3/projects/774cb5256b64420bb76d45aec1bedfa6` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:50.704583 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d6e00-35ac-4f2d-80e8-0150e7262034 admin admin] RBAC: Authorizing `identity:delete_project(project_id=774cb5256b64420bb76d45aec1bedfa6)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:50.706967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d6e00-35ac-4f2d-80e8-0150e7262034 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:50.708701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006b5fa-8709-4ed7-a737-05a77cd9552f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:50.710146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006b5fa-8709-4ed7-a737-05a77cd9552f service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:50.724641 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:50.733912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1018/2015] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:50.747709 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8335c-c9dc-4b1d-99bb-412c4542fd71 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:50.748081 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8335c-c9dc-4b1d-99bb-412c4542fd71 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:50.748395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8335c-c9dc-4b1d-99bb-412c4542fd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:50.794821 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-03f8335c-c9dc-4b1d-99bb-412c4542fd71 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:50.796194 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-03f8335c-c9dc-4b1d-99bb-412c4542fd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:50.825481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1019/2016] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:50.830059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8335c-c9dc-4b1d-99bb-412c4542fd71 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:50.836820 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-908d6e00-35ac-4f2d-80e8-0150e7262034 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '774cb5256b64420bb76d45aec1bedfa6', 'request_id': 'req-908d6e00-35ac-4f2d-80e8-0150e7262034'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:50.843235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8335c-c9dc-4b1d-99bb-412c4542fd71 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:50.844893 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-908d6e00-35ac-4f2d-80e8-0150e7262034 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '774cb5256b64420bb76d45aec1bedfa6', 'request_id': 'req-908d6e00-35ac-4f2d-80e8-0150e7262034'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:50.865193 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-908d6e00-35ac-4f2d-80e8-0150e7262034 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '774cb5256b64420bb76d45aec1bedfa6', 'request_id': 'req-908d6e00-35ac-4f2d-80e8-0150e7262034'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:50.896293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-908d6e00-35ac-4f2d-80e8-0150e7262034 admin admin] The token cache is being invalidate because project 774cb5256b64420bb76d45aec1bedfa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:50.897097 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-908d6e00-35ac-4f2d-80e8-0150e7262034 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:50.898178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-908d6e00-35ac-4f2d-80e8-0150e7262034 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:50.900245 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 998/2017] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:50 2022] DELETE /identity/v3/projects/774cb5256b64420bb76d45aec1bedfa6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:50.902891 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d6e00-35ac-4f2d-80e8-0150e7262034 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:50.904713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-908d6e00-35ac-4f2d-80e8-0150e7262034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:50.956108 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:50.975090 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8bad0-0f45-4382-832b-4e018bf735ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:50.975771 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8bad0-0f45-4382-832b-4e018bf735ec admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:50.976057 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8bad0-0f45-4382-832b-4e018bf735ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:50.976333 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8bad0-0f45-4382-832b-4e018bf735ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:50.977028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8bad0-0f45-4382-832b-4e018bf735ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:15:50.977290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8bad0-0f45-4382-832b-4e018bf735ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:50.978909 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8bad0-0f45-4382-832b-4e018bf735ec admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:50.996422 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1020/2018] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:15:50.997834 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb8b88-e0cb-42d3-af64-fc4864251489 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:50.998128 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb8b88-e0cb-42d3-af64-fc4864251489 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:50.998593 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb8b88-e0cb-42d3-af64-fc4864251489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:51.022103 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d6e00-35ac-4f2d-80e8-0150e7262034 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:51.034908 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c3d59-6f70-473a-b6f7-158eaccd4869 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:51.035756 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c3d59-6f70-473a-b6f7-158eaccd4869 service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:51.035865 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c3d59-6f70-473a-b6f7-158eaccd4869 service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:51.045231 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c3d59-6f70-473a-b6f7-158eaccd4869 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:51.047112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-cceb8b88-e0cb-42d3-af64-fc4864251489 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:51.047489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-263c3d59-6f70-473a-b6f7-158eaccd4869 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:51.050507 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-cceb8b88-e0cb-42d3-af64-fc4864251489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:51.069265 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1021/2019] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:51.070871 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb8b88-e0cb-42d3-af64-fc4864251489 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:51.077598 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-cceb8b88-e0cb-42d3-af64-fc4864251489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:51.103249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb8b88-e0cb-42d3-af64-fc4864251489 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:51.116605 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f7fd7-456a-41fd-89be-5da9bd2ca424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:51.117264 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f7fd7-456a-41fd-89be-5da9bd2ca424 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:51.117554 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f7fd7-456a-41fd-89be-5da9bd2ca424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:51.117837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f7fd7-456a-41fd-89be-5da9bd2ca424 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:51.118485 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f7fd7-456a-41fd-89be-5da9bd2ca424 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:51.125367 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f7fd7-456a-41fd-89be-5da9bd2ca424 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:51.183517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1022/2020] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:51 2022] POST /identity/v3/projects => generated 361 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:51.186184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06ea62-43ed-4cba-bc9d-daa0768124c0 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:51.186624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06ea62-43ed-4cba-bc9d-daa0768124c0 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:51.187023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06ea62-43ed-4cba-bc9d-daa0768124c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:51.203103 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c3d59-6f70-473a-b6f7-158eaccd4869 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:51.204612 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c3d59-6f70-473a-b6f7-158eaccd4869 service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:51.212079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-8b06ea62-43ed-4cba-bc9d-daa0768124c0 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:51.213678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8b06ea62-43ed-4cba-bc9d-daa0768124c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:51.243471 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 999/2021] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:15:51.244445 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c3d59-6f70-473a-b6f7-158eaccd4869 service cinder] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:51.288513 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c3d59-6f70-473a-b6f7-158eaccd4869 service cinder] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:51.350685 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1023/2022] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:51.355095 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06ea62-43ed-4cba-bc9d-daa0768124c0 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:51.372727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06ea62-43ed-4cba-bc9d-daa0768124c0 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:51.379530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:51.386095 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b8f6c-beef-4f65-aa42-f5a353dea3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:51.386922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b8f6c-beef-4f65-aa42-f5a353dea3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:51.387358 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b8f6c-beef-4f65-aa42-f5a353dea3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:51.390965 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b8f6c-beef-4f65-aa42-f5a353dea3d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:51.392012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b8f6c-beef-4f65-aa42-f5a353dea3d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:15:51.392472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b8f6c-beef-4f65-aa42-f5a353dea3d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:51.394967 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b8f6c-beef-4f65-aa42-f5a353dea3d2 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:51.416254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f78e8-9399-47cc-87e0-1d8ceed82f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:51.418307 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f78e8-9399-47cc-87e0-1d8ceed82f3c admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:51.419914 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f78e8-9399-47cc-87e0-1d8ceed82f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:51.420349 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f78e8-9399-47cc-87e0-1d8ceed82f3c admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:51.422609 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f78e8-9399-47cc-87e0-1d8ceed82f3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:51.428880 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f78e8-9399-47cc-87e0-1d8ceed82f3c admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:51.435612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1024/2023] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:15:51.438701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b8f6c-beef-4f65-aa42-f5a353dea3d2 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:51.467477 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b8f6c-beef-4f65-aa42-f5a353dea3d2 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:51.484336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f91bd-f258-4d9a-9d1c-d1cd964ae9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:51.485337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f91bd-f258-4d9a-9d1c-d1cd964ae9d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:51.485768 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f91bd-f258-4d9a-9d1c-d1cd964ae9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:51.486185 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1000/2024] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:51 2022] POST /identity/v3/users => generated 281 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:51.486703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f91bd-f258-4d9a-9d1c-d1cd964ae9d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:51.487559 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f91bd-f258-4d9a-9d1c-d1cd964ae9d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:51.490512 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f78e8-9399-47cc-87e0-1d8ceed82f3c admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:51.492423 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f91bd-f258-4d9a-9d1c-d1cd964ae9d0 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:51.513875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f78e8-9399-47cc-87e0-1d8ceed82f3c admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:51.528011 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3e9ad-96dd-42c6-8e86-16005d1fffee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:51.528746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3e9ad-96dd-42c6-8e86-16005d1fffee admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:51.530419 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3e9ad-96dd-42c6-8e86-16005d1fffee admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:51.531266 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3e9ad-96dd-42c6-8e86-16005d1fffee admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:51.532772 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3e9ad-96dd-42c6-8e86-16005d1fffee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:51.537422 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3e9ad-96dd-42c6-8e86-16005d1fffee admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:51.564114 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1025/2025] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:51 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:51.568382 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f91bd-f258-4d9a-9d1c-d1cd964ae9d0 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:51.570427 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1001/2026] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:51.574840 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3e9ad-96dd-42c6-8e86-16005d1fffee admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:51.595320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3e9ad-96dd-42c6-8e86-16005d1fffee admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:51.773381 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f91bd-f258-4d9a-9d1c-d1cd964ae9d0 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:51.785836 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba045302-0798-4a50-8d6a-ae2e709984a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:51.786582 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba045302-0798-4a50-8d6a-ae2e709984a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:51.786871 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba045302-0798-4a50-8d6a-ae2e709984a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:51.787178 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba045302-0798-4a50-8d6a-ae2e709984a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:51.788019 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba045302-0798-4a50-8d6a-ae2e709984a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:51.803079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba045302-0798-4a50-8d6a-ae2e709984a6 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:51.803454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d2350-1ccf-47fd-8a41-601d1357a7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:51.803454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d2350-1ccf-47fd-8a41-601d1357a7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:51.803454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d2350-1ccf-47fd-8a41-601d1357a7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:51.805276 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d2350-1ccf-47fd-8a41-601d1357a7a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:51.811405 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d2350-1ccf-47fd-8a41-601d1357a7a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:51.811405 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d2350-1ccf-47fd-8a41-601d1357a7a0 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:51.859048 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1026/2027] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:51 2022] POST /identity/v3/users => generated 287 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:51.863726 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1002/2028] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:15:51.865957 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba045302-0798-4a50-8d6a-ae2e709984a6 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:51.867335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d2350-1ccf-47fd-8a41-601d1357a7a0 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:51.890070 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba045302-0798-4a50-8d6a-ae2e709984a6 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:51.890586 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d2350-1ccf-47fd-8a41-601d1357a7a0 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:51.902905 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674296a-bcdb-4a64-b075-135962e61d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:51.903850 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a234727-2874-440e-8b6c-49abc099f8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:51.904635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a234727-2874-440e-8b6c-49abc099f8eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:51.904979 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674296a-bcdb-4a64-b075-135962e61d59 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:51.905096 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a234727-2874-440e-8b6c-49abc099f8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:51.905215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674296a-bcdb-4a64-b075-135962e61d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:51.905487 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674296a-bcdb-4a64-b075-135962e61d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:51.906020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a234727-2874-440e-8b6c-49abc099f8eb admin admin] PATH_INFO: `/v3/projects/936694c9fb7243868dcdbb01e231926d/users/f14b9696ba934116bd0a7cdec9f6bdfe/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:51.907543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674296a-bcdb-4a64-b075-135962e61d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:51.914866 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674296a-bcdb-4a64-b075-135962e61d59 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:51.940615 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1027/2029] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:51.954234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a234727-2874-440e-8b6c-49abc099f8eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=936694c9fb7243868dcdbb01e231926d, user_id=f14b9696ba934116bd0a7cdec9f6bdfe, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:51.958158 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a234727-2874-440e-8b6c-49abc099f8eb admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:51.961392 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674296a-bcdb-4a64-b075-135962e61d59 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:51.972400 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:51.982982 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674296a-bcdb-4a64-b075-135962e61d59 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:51.994591 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1003/2030] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:51 2022] PUT /identity/v3/projects/936694c9fb7243868dcdbb01e231926d/users/f14b9696ba934116bd0a7cdec9f6bdfe/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:51.997182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273af637-45d9-4627-adf1-9cbeb54385f3 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:51.997564 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273af637-45d9-4627-adf1-9cbeb54385f3 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:51.997932 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273af637-45d9-4627-adf1-9cbeb54385f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:52.073815 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-273af637-45d9-4627-adf1-9cbeb54385f3 None None] MFA Rules not processed for user `f14b9696ba934116bd0a7cdec9f6bdfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:52.075301 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-273af637-45d9-4627-adf1-9cbeb54385f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:52.087251 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacd162-f0ca-45af-8c86-bb4f070ecb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:52.088077 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacd162-f0ca-45af-8c86-bb4f070ecb70 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:52.088344 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacd162-f0ca-45af-8c86-bb4f070ecb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:52.088629 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacd162-f0ca-45af-8c86-bb4f070ecb70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:52.089986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacd162-f0ca-45af-8c86-bb4f070ecb70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:52.092329 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacd162-f0ca-45af-8c86-bb4f070ecb70 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:52.107013 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1028/2031] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:52.110838 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacd162-f0ca-45af-8c86-bb4f070ecb70 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:52.131078 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacd162-f0ca-45af-8c86-bb4f070ecb70 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:52.155622 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e8c19-d8ce-4c12-86d9-35bba5acadb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:52.156304 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e8c19-d8ce-4c12-86d9-35bba5acadb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:52.157051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e8c19-d8ce-4c12-86d9-35bba5acadb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:52.157051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e8c19-d8ce-4c12-86d9-35bba5acadb6 admin admin] PATH_INFO: `/v3/projects/6bf096970a41494987893a74e4822be2/users/39562bea83f8425ba11975f7b3e37c47/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:52.202072 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1004/2032] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:52.206272 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e8c19-d8ce-4c12-86d9-35bba5acadb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf096970a41494987893a74e4822be2, user_id=39562bea83f8425ba11975f7b3e37c47, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:52.210871 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e8c19-d8ce-4c12-86d9-35bba5acadb6 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:52.250878 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273af637-45d9-4627-adf1-9cbeb54385f3 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:52.255416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1029/2033] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:52 2022] PUT /identity/v3/projects/6bf096970a41494987893a74e4822be2/users/39562bea83f8425ba11975f7b3e37c47/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:52.257498 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415930a-8b6e-40fc-8adf-b1a34e089b08 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:52.257498 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415930a-8b6e-40fc-8adf-b1a34e089b08 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:52.257692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415930a-8b6e-40fc-8adf-b1a34e089b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:52.290315 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-4415930a-8b6e-40fc-8adf-b1a34e089b08 None None] MFA Rules not processed for user `39562bea83f8425ba11975f7b3e37c47`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:52.291568 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-4415930a-8b6e-40fc-8adf-b1a34e089b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:52.320700 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:52.370270 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273af637-45d9-4627-adf1-9cbeb54385f3 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:52.387289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1030/2034] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:52.391292 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415930a-8b6e-40fc-8adf-b1a34e089b08 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:52.442319 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47b0c7-c610-42af-ba28-63d5387dd9fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:52.443358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47b0c7-c610-42af-ba28-63d5387dd9fd service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:52.443926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47b0c7-c610-42af-ba28-63d5387dd9fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:52.444478 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47b0c7-c610-42af-ba28-63d5387dd9fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:52.481161 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415930a-8b6e-40fc-8adf-b1a34e089b08 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:52.487667 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280e2bf-8755-4f4f-bc3e-c13c001c7035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:52.488481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280e2bf-8755-4f4f-bc3e-c13c001c7035 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:52.488765 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280e2bf-8755-4f4f-bc3e-c13c001c7035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:52.489038 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280e2bf-8755-4f4f-bc3e-c13c001c7035 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:52.490152 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280e2bf-8755-4f4f-bc3e-c13c001c7035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:52.492516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280e2bf-8755-4f4f-bc3e-c13c001c7035 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:52.509787 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:52.530561 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf47b0c7-c610-42af-ba28-63d5387dd9fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:52.532465 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf47b0c7-c610-42af-ba28-63d5387dd9fd service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:52.534537 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1031/2035] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:52 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:52.538426 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280e2bf-8755-4f4f-bc3e-c13c001c7035 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:52.562769 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1005/2036] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:15:52.563869 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47b0c7-c610-42af-ba28-63d5387dd9fd service cinder] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:52.583536 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47b0c7-c610-42af-ba28-63d5387dd9fd service cinder] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:52.671121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280e2bf-8755-4f4f-bc3e-c13c001c7035 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:52.680021 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33e14c-fc47-48a1-871e-8953e665db2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:52.681232 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33e14c-fc47-48a1-871e-8953e665db2c admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:52.681699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33e14c-fc47-48a1-871e-8953e665db2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:52.682517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33e14c-fc47-48a1-871e-8953e665db2c admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:52.683985 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33e14c-fc47-48a1-871e-8953e665db2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:52.687899 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33e14c-fc47-48a1-871e-8953e665db2c admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:52.695286 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f836d96-0825-43d3-bf5d-010abcfb629c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:52.696212 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f836d96-0825-43d3-bf5d-010abcfb629c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:52.696481 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f836d96-0825-43d3-bf5d-010abcfb629c admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:52.696852 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f836d96-0825-43d3-bf5d-010abcfb629c admin admin] PATH_INFO: `/v3/users/f14b9696ba934116bd0a7cdec9f6bdfe` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:52.698155 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f836d96-0825-43d3-bf5d-010abcfb629c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f14b9696ba934116bd0a7cdec9f6bdfe)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:52.703560 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f836d96-0825-43d3-bf5d-010abcfb629c admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:52.721341 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1032/2037] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:52 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:15:52.722843 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33e14c-fc47-48a1-871e-8953e665db2c admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:52.740455 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33e14c-fc47-48a1-871e-8953e665db2c admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:52.751390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed65be-4653-4ab3-9024-8c2d36ad468b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:52.752142 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed65be-4653-4ab3-9024-8c2d36ad468b admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:52.752422 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed65be-4653-4ab3-9024-8c2d36ad468b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:52.752701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed65be-4653-4ab3-9024-8c2d36ad468b admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:52.753509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed65be-4653-4ab3-9024-8c2d36ad468b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:52.755420 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed65be-4653-4ab3-9024-8c2d36ad468b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:52.774819 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1033/2038] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:52.779360 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed65be-4653-4ab3-9024-8c2d36ad468b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:52.805128 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed65be-4653-4ab3-9024-8c2d36ad468b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:52.813369 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:52.822464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f577d-e0f6-4def-a886-8bb52af03975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:52.826039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f577d-e0f6-4def-a886-8bb52af03975 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:52.826039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f577d-e0f6-4def-a886-8bb52af03975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:52.827968 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f577d-e0f6-4def-a886-8bb52af03975 admin admin] PATH_INFO: `/v3/projects/4ad59a2dac6246228ee5c7ae5596943e/users/1985de9d4a6a4633b00a81e9f69156d2/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:52.830021 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-7f836d96-0825-43d3-bf5d-010abcfb629c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f14b9696ba934116bd0a7cdec9f6bdfe'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:52.854141 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f577d-e0f6-4def-a886-8bb52af03975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ad59a2dac6246228ee5c7ae5596943e, user_id=1985de9d4a6a4633b00a81e9f69156d2, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:52.857044 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f577d-e0f6-4def-a886-8bb52af03975 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:52.864162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-7f836d96-0825-43d3-bf5d-010abcfb629c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f14b9696ba934116bd0a7cdec9f6bdfe'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:52.865255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-7f836d96-0825-43d3-bf5d-010abcfb629c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f14b9696ba934116bd0a7cdec9f6bdfe'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:52.882137 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-7f836d96-0825-43d3-bf5d-010abcfb629c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f14b9696ba934116bd0a7cdec9f6bdfe'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:52.889653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1034/2039] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:52 2022] PUT /identity/v3/projects/4ad59a2dac6246228ee5c7ae5596943e/users/1985de9d4a6a4633b00a81e9f69156d2/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:52.894505 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f577d-e0f6-4def-a886-8bb52af03975 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:52.897423 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-7f836d96-0825-43d3-bf5d-010abcfb629c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f14b9696ba934116bd0a7cdec9f6bdfe'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:52.901148 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-510f577d-e0f6-4def-a886-8bb52af03975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:52.905906 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1006/2040] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:52 2022] DELETE /identity/v3/users/f14b9696ba934116bd0a7cdec9f6bdfe => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:52.910127 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dac18-b126-4264-9ce9-b482e049f9da None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:52.910517 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dac18-b126-4264-9ce9-b482e049f9da None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:52.910888 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dac18-b126-4264-9ce9-b482e049f9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:52.940007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-fa6dac18-b126-4264-9ce9-b482e049f9da None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:52.941858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-fa6dac18-b126-4264-9ce9-b482e049f9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:53.031079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f577d-e0f6-4def-a886-8bb52af03975 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:53.090528 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1007/2041] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:53.101515 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dac18-b126-4264-9ce9-b482e049f9da None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:53.104724 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-fa6dac18-b126-4264-9ce9-b482e049f9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:53.125169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:53.158396 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f9cb4-0341-4cc2-bced-bd7817e459c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:53.159092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f9cb4-0341-4cc2-bced-bd7817e459c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:53.159464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f9cb4-0341-4cc2-bced-bd7817e459c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:53.159802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f9cb4-0341-4cc2-bced-bd7817e459c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:53.160841 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f9cb4-0341-4cc2-bced-bd7817e459c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:53.162687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f9cb4-0341-4cc2-bced-bd7817e459c1 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:53.183366 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1035/2042] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:53.184572 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f9cb4-0341-4cc2-bced-bd7817e459c1 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:53.199224 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f9cb4-0341-4cc2-bced-bd7817e459c1 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:53.214126 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d1474-1022-4a6c-b149-24df05577f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:53.214888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d1474-1022-4a6c-b149-24df05577f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:53.216415 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d1474-1022-4a6c-b149-24df05577f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:53.216705 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d1474-1022-4a6c-b149-24df05577f02 admin admin] PATH_INFO: `/v3/projects/4ad59a2dac6246228ee5c7ae5596943e/users/1985de9d4a6a4633b00a81e9f69156d2/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:53.218825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d1474-1022-4a6c-b149-24df05577f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ad59a2dac6246228ee5c7ae5596943e, user_id=1985de9d4a6a4633b00a81e9f69156d2, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:53.221880 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d1474-1022-4a6c-b149-24df05577f02 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:53.225643 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dac18-b126-4264-9ce9-b482e049f9da None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:53.231619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1cb6e-95d5-4bb1-96d8-b602731e5f4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:53.232403 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1cb6e-95d5-4bb1-96d8-b602731e5f4e service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:53.232687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1cb6e-95d5-4bb1-96d8-b602731e5f4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:53.232958 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1cb6e-95d5-4bb1-96d8-b602731e5f4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:53.249770 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1cb6e-95d5-4bb1-96d8-b602731e5f4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:53.250549 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1036/2043] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:53 2022] PUT /identity/v3/projects/4ad59a2dac6246228ee5c7ae5596943e/users/1985de9d4a6a4633b00a81e9f69156d2/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:53.260666 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1cb6e-95d5-4bb1-96d8-b602731e5f4e service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:53.261736 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc04d4-ae6b-47b8-87ef-5993f4f40fe7 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:53.262028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc04d4-ae6b-47b8-87ef-5993f4f40fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:53.262453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc04d4-ae6b-47b8-87ef-5993f4f40fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:53.275594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1008/2044] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:53.304607 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-01cc04d4-ae6b-47b8-87ef-5993f4f40fe7 None None] MFA Rules not processed for user `1985de9d4a6a4633b00a81e9f69156d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:53.306294 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-01cc04d4-ae6b-47b8-87ef-5993f4f40fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:53.421761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1037/2045] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:53.437110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1cb6e-95d5-4bb1-96d8-b602731e5f4e service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:53.438730 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-e8f1cb6e-95d5-4bb1-96d8-b602731e5f4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:53.517836 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1cb6e-95d5-4bb1-96d8-b602731e5f4e service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:53.535705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:53.590142 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d354a-868e-431f-9f7c-1f9ad167e2db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:53.591125 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d354a-868e-431f-9f7c-1f9ad167e2db service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:53.591414 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d354a-868e-431f-9f7c-1f9ad167e2db service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:53.592315 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d354a-868e-431f-9f7c-1f9ad167e2db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:53.596425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-8b2d354a-868e-431f-9f7c-1f9ad167e2db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:53.673603 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d354a-868e-431f-9f7c-1f9ad167e2db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:53.675047 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d354a-868e-431f-9f7c-1f9ad167e2db service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:53.684245 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1009/2046] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:53.777590 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc04d4-ae6b-47b8-87ef-5993f4f40fe7 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:53.779069 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-01cc04d4-ae6b-47b8-87ef-5993f4f40fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:53.895155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc04d4-ae6b-47b8-87ef-5993f4f40fe7 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:53.901534 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5ffc6-9b2a-477a-9e4d-bed548fcffcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:53.902205 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5ffc6-9b2a-477a-9e4d-bed548fcffcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:53.902850 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5ffc6-9b2a-477a-9e4d-bed548fcffcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:53.903144 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5ffc6-9b2a-477a-9e4d-bed548fcffcf admin admin] PATH_INFO: `/v3/projects/936694c9fb7243868dcdbb01e231926d` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:53.904454 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5ffc6-9b2a-477a-9e4d-bed548fcffcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=936694c9fb7243868dcdbb01e231926d)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:53.907264 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5ffc6-9b2a-477a-9e4d-bed548fcffcf admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:54.020172 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-1ca5ffc6-9b2a-477a-9e4d-bed548fcffcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '936694c9fb7243868dcdbb01e231926d', 'request_id': 'req-1ca5ffc6-9b2a-477a-9e4d-bed548fcffcf'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:54.026920 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-1ca5ffc6-9b2a-477a-9e4d-bed548fcffcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '936694c9fb7243868dcdbb01e231926d', 'request_id': 'req-1ca5ffc6-9b2a-477a-9e4d-bed548fcffcf'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:54.028931 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:54.035868 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-1ca5ffc6-9b2a-477a-9e4d-bed548fcffcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '936694c9fb7243868dcdbb01e231926d', 'request_id': 'req-1ca5ffc6-9b2a-477a-9e4d-bed548fcffcf'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:54.069146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-1ca5ffc6-9b2a-477a-9e4d-bed548fcffcf admin admin] The token cache is being invalidate because project 936694c9fb7243868dcdbb01e231926d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:54.071112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-1ca5ffc6-9b2a-477a-9e4d-bed548fcffcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:54.075569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-1ca5ffc6-9b2a-477a-9e4d-bed548fcffcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:54.079615 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1038/2047] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:53 2022] DELETE /identity/v3/projects/936694c9fb7243868dcdbb01e231926d => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:54.085152 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b8696-d105-47a7-9447-66b466ba6c23 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:54.085599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b8696-d105-47a7-9447-66b466ba6c23 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:54.087123 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b8696-d105-47a7-9447-66b466ba6c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:54.138820 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-ca4b8696-d105-47a7-9447-66b466ba6c23 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:54.143954 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-ca4b8696-d105-47a7-9447-66b466ba6c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:54.237594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1010/2048] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:54.245319 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41758f56-976c-47cb-aa28-7436e29c5533 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:54.245634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41758f56-976c-47cb-aa28-7436e29c5533 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:54.245907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41758f56-976c-47cb-aa28-7436e29c5533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:54.269432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-41758f56-976c-47cb-aa28-7436e29c5533 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:54.271642 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-41758f56-976c-47cb-aa28-7436e29c5533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:54.285831 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1039/2049] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:54.286572 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b8696-d105-47a7-9447-66b466ba6c23 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:54.300307 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b8696-d105-47a7-9447-66b466ba6c23 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:54.305083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141faa38-8516-4e7a-bc44-3fefda154f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:54.305721 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141faa38-8516-4e7a-bc44-3fefda154f35 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:54.306003 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141faa38-8516-4e7a-bc44-3fefda154f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:54.306276 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141faa38-8516-4e7a-bc44-3fefda154f35 admin admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:54.306926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141faa38-8516-4e7a-bc44-3fefda154f35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:15:54.307231 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141faa38-8516-4e7a-bc44-3fefda154f35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:54.309573 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141faa38-8516-4e7a-bc44-3fefda154f35 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:54.323361 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1011/2050] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:15:54.327812 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41758f56-976c-47cb-aa28-7436e29c5533 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:54.357546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41758f56-976c-47cb-aa28-7436e29c5533 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:54.366653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9526ef-5619-491f-afa3-e984f91ccdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:54.367276 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9526ef-5619-491f-afa3-e984f91ccdbf admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:54.367734 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9526ef-5619-491f-afa3-e984f91ccdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:54.368022 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9526ef-5619-491f-afa3-e984f91ccdbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:54.368916 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9526ef-5619-491f-afa3-e984f91ccdbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:54.371966 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9526ef-5619-491f-afa3-e984f91ccdbf admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:54.435326 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141faa38-8516-4e7a-bc44-3fefda154f35 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:54.437268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-141faa38-8516-4e7a-bc44-3fefda154f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:54.447250 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1040/2051] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:54 2022] POST /identity/v3/projects => generated 369 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:54.452381 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9526ef-5619-491f-afa3-e984f91ccdbf admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:54.460497 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141faa38-8516-4e7a-bc44-3fefda154f35 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:54.550182 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9526ef-5619-491f-afa3-e984f91ccdbf admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:54.559380 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c62a9-b6dc-4e17-bcae-bf904e4b1df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:54.560225 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c62a9-b6dc-4e17-bcae-bf904e4b1df7 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:54.560506 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c62a9-b6dc-4e17-bcae-bf904e4b1df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:54.561394 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c62a9-b6dc-4e17-bcae-bf904e4b1df7 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:54.562196 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c62a9-b6dc-4e17-bcae-bf904e4b1df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:54.564802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c62a9-b6dc-4e17-bcae-bf904e4b1df7 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:54.569809 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129830a-8ada-43cf-a331-70b2fdc9ab86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:54.570802 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129830a-8ada-43cf-a331-70b2fdc9ab86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:54.571238 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129830a-8ada-43cf-a331-70b2fdc9ab86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:54.571699 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129830a-8ada-43cf-a331-70b2fdc9ab86 admin admin] PATH_INFO: `/v3/users/d3da04d6da8943df91a6a3e37d6456dc` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:54.573020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129830a-8ada-43cf-a331-70b2fdc9ab86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3da04d6da8943df91a6a3e37d6456dc)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:54.575156 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129830a-8ada-43cf-a331-70b2fdc9ab86 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:54.577064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:54.602209 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1041/2052] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:54 2022] POST /identity/v3/users => generated 285 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:54.603198 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c62a9-b6dc-4e17-bcae-bf904e4b1df7 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:54.615756 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c62a9-b6dc-4e17-bcae-bf904e4b1df7 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:54.625140 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ec585-90c7-4b4c-8146-48fb38e54080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:54.625928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ec585-90c7-4b4c-8146-48fb38e54080 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:54.626473 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ec585-90c7-4b4c-8146-48fb38e54080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:54.626723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ec585-90c7-4b4c-8146-48fb38e54080 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:54.627384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ec585-90c7-4b4c-8146-48fb38e54080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:54.629362 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ec585-90c7-4b4c-8146-48fb38e54080 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:54.645056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1042/2053] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:15:54.646788 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ec585-90c7-4b4c-8146-48fb38e54080 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:54.659963 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ec585-90c7-4b4c-8146-48fb38e54080 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:54.665553 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc12e9-4f06-4e40-b98f-a49dd6f9087f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:54.666164 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc12e9-4f06-4e40-b98f-a49dd6f9087f admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:54.666442 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc12e9-4f06-4e40-b98f-a49dd6f9087f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:54.666716 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc12e9-4f06-4e40-b98f-a49dd6f9087f admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:54.667981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc12e9-4f06-4e40-b98f-a49dd6f9087f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:54.669600 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc12e9-4f06-4e40-b98f-a49dd6f9087f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:54.677112 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-e129830a-8ada-43cf-a331-70b2fdc9ab86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3da04d6da8943df91a6a3e37d6456dc'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:54.682295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1043/2054] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:15:54.686355 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc12e9-4f06-4e40-b98f-a49dd6f9087f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:54.696996 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc12e9-4f06-4e40-b98f-a49dd6f9087f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:54.706124 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-e129830a-8ada-43cf-a331-70b2fdc9ab86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3da04d6da8943df91a6a3e37d6456dc'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:54.706971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-e129830a-8ada-43cf-a331-70b2fdc9ab86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3da04d6da8943df91a6a3e37d6456dc'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:54.708767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc79ac-5175-4606-93a2-12301d50e71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:54.709589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc79ac-5175-4606-93a2-12301d50e71a admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:54.710006 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc79ac-5175-4606-93a2-12301d50e71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:54.710550 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc79ac-5175-4606-93a2-12301d50e71a admin admin] PATH_INFO: `/v3/projects/55f53b974c754cffb34be07ced2ebf7d/users/b5401c2ed61943109e1cb282b1b57289/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:54.717724 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-e129830a-8ada-43cf-a331-70b2fdc9ab86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3da04d6da8943df91a6a3e37d6456dc'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:54.726610 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-e129830a-8ada-43cf-a331-70b2fdc9ab86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3da04d6da8943df91a6a3e37d6456dc'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:54.733232 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1012/2055] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:54 2022] DELETE /identity/v3/users/d3da04d6da8943df91a6a3e37d6456dc => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:54.737817 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc79ac-5175-4606-93a2-12301d50e71a admin admin] RBAC: Authorizing `identity:create_grant(project_id=55f53b974c754cffb34be07ced2ebf7d, user_id=b5401c2ed61943109e1cb282b1b57289, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:54.740018 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e571b-188a-407e-97a7-b48496d6c768 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:54.740557 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e571b-188a-407e-97a7-b48496d6c768 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:54.740796 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc79ac-5175-4606-93a2-12301d50e71a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:54.741042 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e571b-188a-407e-97a7-b48496d6c768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:54.757208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1044/2056] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:54 2022] PUT /identity/v3/projects/55f53b974c754cffb34be07ced2ebf7d/users/b5401c2ed61943109e1cb282b1b57289/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:54.763415 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-b77e571b-188a-407e-97a7-b48496d6c768 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:54.764778 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b77e571b-188a-407e-97a7-b48496d6c768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:54.769414 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c0db3-5625-4287-880e-ac3c3482631e None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:54.769701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c0db3-5625-4287-880e-ac3c3482631e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:54.770372 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c0db3-5625-4287-880e-ac3c3482631e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:54.805175 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-8a8c0db3-5625-4287-880e-ac3c3482631e None None] MFA Rules not processed for user `b5401c2ed61943109e1cb282b1b57289`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:54.806609 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8a8c0db3-5625-4287-880e-ac3c3482631e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:54.862261 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1013/2057] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:15:54.873977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e571b-188a-407e-97a7-b48496d6c768 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:54.875528 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b77e571b-188a-407e-97a7-b48496d6c768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:54.881522 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:54.896311 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1045/2058] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:15:54.908796 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c0db3-5625-4287-880e-ac3c3482631e None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:54.910885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8a8c0db3-5625-4287-880e-ac3c3482631e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:54.950474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e571b-188a-407e-97a7-b48496d6c768 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:54.955126 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb32f1-ec44-4f71-82b5-9489802cc3a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:54.956125 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb32f1-ec44-4f71-82b5-9489802cc3a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:54.956125 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb32f1-ec44-4f71-82b5-9489802cc3a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:54.956327 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb32f1-ec44-4f71-82b5-9489802cc3a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:54.978597 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb32f1-ec44-4f71-82b5-9489802cc3a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:54.980041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c0db3-5625-4287-880e-ac3c3482631e None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:54.980172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb32f1-ec44-4f71-82b5-9489802cc3a8 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:54.983949 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3db278-6239-42d2-a3f2-a2339ddb5c99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:54.984678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3db278-6239-42d2-a3f2-a2339ddb5c99 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:54.984957 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3db278-6239-42d2-a3f2-a2339ddb5c99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:54.985228 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3db278-6239-42d2-a3f2-a2339ddb5c99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:54.990005 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1014/2059] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:15:54.994074 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3db278-6239-42d2-a3f2-a2339ddb5c99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:54.995774 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3db278-6239-42d2-a3f2-a2339ddb5c99 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:55.005581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1046/2060] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:55.032224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb32f1-ec44-4f71-82b5-9489802cc3a8 service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:55.033944 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-dadb32f1-ec44-4f71-82b5-9489802cc3a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:55.047254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb32f1-ec44-4f71-82b5-9489802cc3a8 service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:55.052040 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60974cf-9bd8-47de-9617-12fac6d36601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:55.052682 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60974cf-9bd8-47de-9617-12fac6d36601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:55.052963 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60974cf-9bd8-47de-9617-12fac6d36601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:55.053288 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60974cf-9bd8-47de-9617-12fac6d36601 admin admin] PATH_INFO: `/v3/users/b5401c2ed61943109e1cb282b1b57289` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:55.054447 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60974cf-9bd8-47de-9617-12fac6d36601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5401c2ed61943109e1cb282b1b57289)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:55.056409 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60974cf-9bd8-47de-9617-12fac6d36601 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:55.077109 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:55.117166 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-b60974cf-9bd8-47de-9617-12fac6d36601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5401c2ed61943109e1cb282b1b57289'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:55.140352 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-b60974cf-9bd8-47de-9617-12fac6d36601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5401c2ed61943109e1cb282b1b57289'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:55.141256 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-b60974cf-9bd8-47de-9617-12fac6d36601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5401c2ed61943109e1cb282b1b57289'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:55.152305 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-b60974cf-9bd8-47de-9617-12fac6d36601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5401c2ed61943109e1cb282b1b57289'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:55.165884 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-b60974cf-9bd8-47de-9617-12fac6d36601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5401c2ed61943109e1cb282b1b57289'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:55.174422 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1015/2061] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:55 2022] DELETE /identity/v3/users/b5401c2ed61943109e1cb282b1b57289 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:55.179252 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80114a-e1d2-46a4-8558-2c7a0de3c377 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:55.180875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80114a-e1d2-46a4-8558-2c7a0de3c377 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:55.181539 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80114a-e1d2-46a4-8558-2c7a0de3c377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:55.207511 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-0d80114a-e1d2-46a4-8558-2c7a0de3c377 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:55.208942 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0d80114a-e1d2-46a4-8558-2c7a0de3c377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:55.285086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1047/2062] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:55.292473 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60974cf-9bd8-47de-9617-12fac6d36601 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:55.294147 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b60974cf-9bd8-47de-9617-12fac6d36601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:55.318892 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80114a-e1d2-46a4-8558-2c7a0de3c377 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:55.320493 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0d80114a-e1d2-46a4-8558-2c7a0de3c377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:55.352029 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80114a-e1d2-46a4-8558-2c7a0de3c377 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:55.361585 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c19fd7-1043-484d-a807-c27c1b82354b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:55.362224 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c19fd7-1043-484d-a807-c27c1b82354b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:55.362595 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c19fd7-1043-484d-a807-c27c1b82354b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:55.362904 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c19fd7-1043-484d-a807-c27c1b82354b admin admin] PATH_INFO: `/v3/projects/c59803c81b594a0d8337e510f7d8c736` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:55.367096 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c19fd7-1043-484d-a807-c27c1b82354b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c59803c81b594a0d8337e510f7d8c736)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:55.369117 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c19fd7-1043-484d-a807-c27c1b82354b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:55.372956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60974cf-9bd8-47de-9617-12fac6d36601 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:55.376916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e896cd-5914-461d-b763-2b251811d507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:55.377818 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e896cd-5914-461d-b763-2b251811d507 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:55.378308 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e896cd-5914-461d-b763-2b251811d507 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:55.378630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e896cd-5914-461d-b763-2b251811d507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:55.389148 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e896cd-5914-461d-b763-2b251811d507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:55.390684 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e896cd-5914-461d-b763-2b251811d507 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:55.401829 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1016/2063] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:55.422805 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-95c19fd7-1043-484d-a807-c27c1b82354b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c59803c81b594a0d8337e510f7d8c736', 'request_id': 'req-95c19fd7-1043-484d-a807-c27c1b82354b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:55.429312 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-95c19fd7-1043-484d-a807-c27c1b82354b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c59803c81b594a0d8337e510f7d8c736', 'request_id': 'req-95c19fd7-1043-484d-a807-c27c1b82354b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:55.436207 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-95c19fd7-1043-484d-a807-c27c1b82354b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c59803c81b594a0d8337e510f7d8c736', 'request_id': 'req-95c19fd7-1043-484d-a807-c27c1b82354b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:55.450253 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-95c19fd7-1043-484d-a807-c27c1b82354b admin admin] The token cache is being invalidate because project c59803c81b594a0d8337e510f7d8c736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:55.450932 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-95c19fd7-1043-484d-a807-c27c1b82354b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:55.451402 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-95c19fd7-1043-484d-a807-c27c1b82354b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:55.453029 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1048/2064] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:55 2022] DELETE /identity/v3/projects/c59803c81b594a0d8337e510f7d8c736 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:55.457120 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e896cd-5914-461d-b763-2b251811d507 service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:55.468486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e896cd-5914-461d-b763-2b251811d507 service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:55.542556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18686e5e-bfd8-4082-a7c2-ae36bec73c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:55.543208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18686e5e-bfd8-4082-a7c2-ae36bec73c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:55.543547 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18686e5e-bfd8-4082-a7c2-ae36bec73c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:55.543793 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18686e5e-bfd8-4082-a7c2-ae36bec73c29 admin admin] PATH_INFO: `/v3/users/6d6743620e994283af0e1877e5a1c1bc` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:55.544960 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18686e5e-bfd8-4082-a7c2-ae36bec73c29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d6743620e994283af0e1877e5a1c1bc)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:55.546876 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18686e5e-bfd8-4082-a7c2-ae36bec73c29 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:55.601208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:55.615153 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-18686e5e-bfd8-4082-a7c2-ae36bec73c29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d6743620e994283af0e1877e5a1c1bc'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:55.639814 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-18686e5e-bfd8-4082-a7c2-ae36bec73c29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d6743620e994283af0e1877e5a1c1bc'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:55.641521 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-18686e5e-bfd8-4082-a7c2-ae36bec73c29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d6743620e994283af0e1877e5a1c1bc'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:55.665450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-18686e5e-bfd8-4082-a7c2-ae36bec73c29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d6743620e994283af0e1877e5a1c1bc'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:55.674823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-18686e5e-bfd8-4082-a7c2-ae36bec73c29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d6743620e994283af0e1877e5a1c1bc'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:55.681227 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1017/2065] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:55 2022] DELETE /identity/v3/users/6d6743620e994283af0e1877e5a1c1bc => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:55.750837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c19fd7-1043-484d-a807-c27c1b82354b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:55.753809 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-95c19fd7-1043-484d-a807-c27c1b82354b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:55.777899 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c19fd7-1043-484d-a807-c27c1b82354b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:55.805033 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:55.872975 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a1aed-00d4-4f1a-a4fb-fb911e0c5848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:55.873960 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a1aed-00d4-4f1a-a4fb-fb911e0c5848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:55.874315 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a1aed-00d4-4f1a-a4fb-fb911e0c5848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:55.874641 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a1aed-00d4-4f1a-a4fb-fb911e0c5848 admin admin] PATH_INFO: `/v3/projects/55f53b974c754cffb34be07ced2ebf7d` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:55.876008 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a1aed-00d4-4f1a-a4fb-fb911e0c5848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55f53b974c754cffb34be07ced2ebf7d)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:55.878292 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a1aed-00d4-4f1a-a4fb-fb911e0c5848 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:55.999040 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-845a1aed-00d4-4f1a-a4fb-fb911e0c5848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55f53b974c754cffb34be07ced2ebf7d', 'request_id': 'req-845a1aed-00d4-4f1a-a4fb-fb911e0c5848'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:56.018132 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-845a1aed-00d4-4f1a-a4fb-fb911e0c5848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55f53b974c754cffb34be07ced2ebf7d', 'request_id': 'req-845a1aed-00d4-4f1a-a4fb-fb911e0c5848'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:56.030707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-845a1aed-00d4-4f1a-a4fb-fb911e0c5848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55f53b974c754cffb34be07ced2ebf7d', 'request_id': 'req-845a1aed-00d4-4f1a-a4fb-fb911e0c5848'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:56.072515 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-845a1aed-00d4-4f1a-a4fb-fb911e0c5848 admin admin] The token cache is being invalidate because project 55f53b974c754cffb34be07ced2ebf7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:56.072782 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-845a1aed-00d4-4f1a-a4fb-fb911e0c5848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:56.073588 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-845a1aed-00d4-4f1a-a4fb-fb911e0c5848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:56.078723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1049/2066] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:55 2022] DELETE /identity/v3/projects/55f53b974c754cffb34be07ced2ebf7d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:56.081643 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d263c-472f-40c2-a52a-c3fa65373b2f None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:56.082361 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d263c-472f-40c2-a52a-c3fa65373b2f None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:56.083099 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d263c-472f-40c2-a52a-c3fa65373b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:56.113473 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a1aed-00d4-4f1a-a4fb-fb911e0c5848 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:56.117107 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-845a1aed-00d4-4f1a-a4fb-fb911e0c5848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:56.162500 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-319d263c-472f-40c2-a52a-c3fa65373b2f None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:56.163878 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-319d263c-472f-40c2-a52a-c3fa65373b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:56.220488 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a1aed-00d4-4f1a-a4fb-fb911e0c5848 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:56.225530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d4bb0-b9a0-44b6-848c-1bfcfc0dfce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:56.226245 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d4bb0-b9a0-44b6-848c-1bfcfc0dfce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:56.226597 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d4bb0-b9a0-44b6-848c-1bfcfc0dfce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:56.226944 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d4bb0-b9a0-44b6-848c-1bfcfc0dfce9 admin admin] PATH_INFO: `/v3/projects/f6ad504ad3d642c8af4cecc740c5001a` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:56.228454 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d4bb0-b9a0-44b6-848c-1bfcfc0dfce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6ad504ad3d642c8af4cecc740c5001a)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:56.230494 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d4bb0-b9a0-44b6-848c-1bfcfc0dfce9 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:56.235702 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1018/2067] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:56.243811 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36c010-08c3-4f84-9f3a-727bf74bc2c6 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:56.244133 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36c010-08c3-4f84-9f3a-727bf74bc2c6 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:56.244408 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36c010-08c3-4f84-9f3a-727bf74bc2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:56.265011 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-0a36c010-08c3-4f84-9f3a-727bf74bc2c6 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:56.266657 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-0a36c010-08c3-4f84-9f3a-727bf74bc2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:56.275367 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1019/2068] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:15:56.280044 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36c010-08c3-4f84-9f3a-727bf74bc2c6 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:56.287523 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-fa0d4bb0-b9a0-44b6-848c-1bfcfc0dfce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6ad504ad3d642c8af4cecc740c5001a', 'request_id': 'req-fa0d4bb0-b9a0-44b6-848c-1bfcfc0dfce9'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:56.289495 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:56.290320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36c010-08c3-4f84-9f3a-727bf74bc2c6 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:56.294463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-fa0d4bb0-b9a0-44b6-848c-1bfcfc0dfce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6ad504ad3d642c8af4cecc740c5001a', 'request_id': 'req-fa0d4bb0-b9a0-44b6-848c-1bfcfc0dfce9'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:56.302863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-fa0d4bb0-b9a0-44b6-848c-1bfcfc0dfce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6ad504ad3d642c8af4cecc740c5001a', 'request_id': 'req-fa0d4bb0-b9a0-44b6-848c-1bfcfc0dfce9'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:56.317235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-fa0d4bb0-b9a0-44b6-848c-1bfcfc0dfce9 admin admin] The token cache is being invalidate because project f6ad504ad3d642c8af4cecc740c5001a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:56.317777 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-fa0d4bb0-b9a0-44b6-848c-1bfcfc0dfce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:56.318233 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-fa0d4bb0-b9a0-44b6-848c-1bfcfc0dfce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:56.320035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1050/2069] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:56 2022] DELETE /identity/v3/projects/f6ad504ad3d642c8af4cecc740c5001a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:56.325276 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdc173-c3aa-45be-8f02-4a17dfd012eb None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:56.325505 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdc173-c3aa-45be-8f02-4a17dfd012eb None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:56.325771 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdc173-c3aa-45be-8f02-4a17dfd012eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:56.346272 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-28fdc173-c3aa-45be-8f02-4a17dfd012eb None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:56.348703 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001ab40-f317-4b58-914b-baa0cf9c0637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:56.349325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001ab40-f317-4b58-914b-baa0cf9c0637 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:56.349588 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001ab40-f317-4b58-914b-baa0cf9c0637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:56.349856 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001ab40-f317-4b58-914b-baa0cf9c0637 admin admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:56.350518 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001ab40-f317-4b58-914b-baa0cf9c0637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:15:56.350810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001ab40-f317-4b58-914b-baa0cf9c0637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:56.352533 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001ab40-f317-4b58-914b-baa0cf9c0637 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:56.352783 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-28fdc173-c3aa-45be-8f02-4a17dfd012eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:56.373997 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1051/2070] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:15:56.374416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1020/2071] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:15:56.374523 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdc173-c3aa-45be-8f02-4a17dfd012eb None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:56.374523 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-28fdc173-c3aa-45be-8f02-4a17dfd012eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:56.374689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001ab40-f317-4b58-914b-baa0cf9c0637 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:56.376347 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-8001ab40-f317-4b58-914b-baa0cf9c0637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:56.383901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdc173-c3aa-45be-8f02-4a17dfd012eb None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:56.389361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27662eae-17dd-4418-bf40-e036e0d51fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:56.390091 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27662eae-17dd-4418-bf40-e036e0d51fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:56.390239 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001ab40-f317-4b58-914b-baa0cf9c0637 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:56.390357 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27662eae-17dd-4418-bf40-e036e0d51fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:56.390645 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27662eae-17dd-4418-bf40-e036e0d51fb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:56.391278 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27662eae-17dd-4418-bf40-e036e0d51fb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:56.393192 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27662eae-17dd-4418-bf40-e036e0d51fb6 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:56.394850 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e1208-4a83-4faf-b97e-9f4182030cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:56.395498 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e1208-4a83-4faf-b97e-9f4182030cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:56.395914 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e1208-4a83-4faf-b97e-9f4182030cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:56.396041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e1208-4a83-4faf-b97e-9f4182030cd1 admin admin] PATH_INFO: `/v3/users/39562bea83f8425ba11975f7b3e37c47` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:56.397179 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e1208-4a83-4faf-b97e-9f4182030cd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39562bea83f8425ba11975f7b3e37c47)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:56.399130 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e1208-4a83-4faf-b97e-9f4182030cd1 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:56.425170 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1052/2072] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:56 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:15:56.426558 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d55c8-422d-4ea6-93de-bb3b3f3fe61d None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:56.426838 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d55c8-422d-4ea6-93de-bb3b3f3fe61d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:56.427104 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d55c8-422d-4ea6-93de-bb3b3f3fe61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:56.447566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:56.448777 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-2a2d55c8-422d-4ea6-93de-bb3b3f3fe61d None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:56.450120 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-2a2d55c8-422d-4ea6-93de-bb3b3f3fe61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:56.454910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-8d2e1208-4a83-4faf-b97e-9f4182030cd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39562bea83f8425ba11975f7b3e37c47'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:56.469014 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-8d2e1208-4a83-4faf-b97e-9f4182030cd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39562bea83f8425ba11975f7b3e37c47'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:56.469721 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-8d2e1208-4a83-4faf-b97e-9f4182030cd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39562bea83f8425ba11975f7b3e37c47'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:56.477264 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-8d2e1208-4a83-4faf-b97e-9f4182030cd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39562bea83f8425ba11975f7b3e37c47'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:56.484483 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-8d2e1208-4a83-4faf-b97e-9f4182030cd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39562bea83f8425ba11975f7b3e37c47'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:56.490592 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1021/2073] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:56 2022] DELETE /identity/v3/users/39562bea83f8425ba11975f7b3e37c47 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:56.494367 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e1208-4a83-4faf-b97e-9f4182030cd1 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:56.494367 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-8d2e1208-4a83-4faf-b97e-9f4182030cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:56.517317 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1053/2074] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:56.521342 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f0fc3-5638-4f52-8dc1-5636393c90f9 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:56.521342 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f0fc3-5638-4f52-8dc1-5636393c90f9 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:56.521342 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f0fc3-5638-4f52-8dc1-5636393c90f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:56.540419 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-455f0fc3-5638-4f52-8dc1-5636393c90f9 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:56.541636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-455f0fc3-5638-4f52-8dc1-5636393c90f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:56.565429 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e1208-4a83-4faf-b97e-9f4182030cd1 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:56.571307 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4f2c8-8068-4c49-ae4f-1e557eb0e57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:56.571983 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4f2c8-8068-4c49-ae4f-1e557eb0e57f admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:56.572277 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4f2c8-8068-4c49-ae4f-1e557eb0e57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:56.572538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4f2c8-8068-4c49-ae4f-1e557eb0e57f admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:56.573214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4f2c8-8068-4c49-ae4f-1e557eb0e57f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:56.575829 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4f2c8-8068-4c49-ae4f-1e557eb0e57f admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:56.600312 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1022/2075] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:56 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:56.600312 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4f2c8-8068-4c49-ae4f-1e557eb0e57f admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:56.608047 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4f2c8-8068-4c49-ae4f-1e557eb0e57f admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:56.610585 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1054/2076] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:56.611503 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f0fc3-5638-4f52-8dc1-5636393c90f9 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:56.616738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd975fc8-9bb2-410f-a809-43a3f5678fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:56.617766 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd975fc8-9bb2-410f-a809-43a3f5678fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:56.618094 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd975fc8-9bb2-410f-a809-43a3f5678fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:56.618583 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd975fc8-9bb2-410f-a809-43a3f5678fa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:56.619421 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd975fc8-9bb2-410f-a809-43a3f5678fa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:15:56.619768 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd975fc8-9bb2-410f-a809-43a3f5678fa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:56.622040 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd975fc8-9bb2-410f-a809-43a3f5678fa0 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:56.623423 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f0fc3-5638-4f52-8dc1-5636393c90f9 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:56.628741 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0843d5c-60b3-4854-9365-137f42b99f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:56.629349 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0843d5c-60b3-4854-9365-137f42b99f07 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:56.629625 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0843d5c-60b3-4854-9365-137f42b99f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:56.629892 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0843d5c-60b3-4854-9365-137f42b99f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:56.630533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0843d5c-60b3-4854-9365-137f42b99f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:56.632144 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0843d5c-60b3-4854-9365-137f42b99f07 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:56.638318 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1023/2077] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:15:56.639163 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd975fc8-9bb2-410f-a809-43a3f5678fa0 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:56.640998 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-dd975fc8-9bb2-410f-a809-43a3f5678fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:56.642775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1055/2078] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:56.643469 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0843d5c-60b3-4854-9365-137f42b99f07 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:56.656287 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0843d5c-60b3-4854-9365-137f42b99f07 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:56.661207 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9bea6-c7f5-4155-bf0d-0f97cbfe9016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:56.661914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9bea6-c7f5-4155-bf0d-0f97cbfe9016 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:56.662375 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9bea6-c7f5-4155-bf0d-0f97cbfe9016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:56.662704 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9bea6-c7f5-4155-bf0d-0f97cbfe9016 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:56.663399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9bea6-c7f5-4155-bf0d-0f97cbfe9016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:56.665451 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9bea6-c7f5-4155-bf0d-0f97cbfe9016 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:56.695919 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1056/2079] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:56 2022] POST /identity/v3/projects => generated 409 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:56.696595 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9bea6-c7f5-4155-bf0d-0f97cbfe9016 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:56.715377 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd975fc8-9bb2-410f-a809-43a3f5678fa0 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:56.720044 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:56.766999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:56.773424 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a748a0-243b-4a0c-9dd1-122edb035b76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:56.773952 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9bea6-c7f5-4155-bf0d-0f97cbfe9016 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:56.774274 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a748a0-243b-4a0c-9dd1-122edb035b76 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:56.774779 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a748a0-243b-4a0c-9dd1-122edb035b76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:56.775471 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a748a0-243b-4a0c-9dd1-122edb035b76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:56.779716 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6061af-a861-44e9-bd04-253b1c136f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:56.780493 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6061af-a861-44e9-bd04-253b1c136f59 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:56.780773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6061af-a861-44e9-bd04-253b1c136f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:56.781108 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6061af-a861-44e9-bd04-253b1c136f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:56.781757 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6061af-a861-44e9-bd04-253b1c136f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:56.783391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6061af-a861-44e9-bd04-253b1c136f59 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:56.785968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a748a0-243b-4a0c-9dd1-122edb035b76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:56.787380 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a748a0-243b-4a0c-9dd1-122edb035b76 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:56.793593 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1057/2080] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:56.797098 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1024/2081] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:56.797738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6061af-a861-44e9-bd04-253b1c136f59 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:56.798909 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a748a0-243b-4a0c-9dd1-122edb035b76 service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:56.809260 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a748a0-243b-4a0c-9dd1-122edb035b76 service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:56.809472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6061af-a861-44e9-bd04-253b1c136f59 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:56.814981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f69db8-a961-4f81-84c9-3240116f03e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:56.815261 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd0a02-7ef0-4386-a10b-9f4e79a7a67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:56.815862 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f69db8-a961-4f81-84c9-3240116f03e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:56.816165 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd0a02-7ef0-4386-a10b-9f4e79a7a67d admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:56.816275 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f69db8-a961-4f81-84c9-3240116f03e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:56.816552 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f69db8-a961-4f81-84c9-3240116f03e3 admin admin] PATH_INFO: `/v3/projects/521d8c6754524aa381ec042c45b97922/users/aef2f95206024484962ec4d3121d9c3f/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:56.816661 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd0a02-7ef0-4386-a10b-9f4e79a7a67d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:56.817387 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd0a02-7ef0-4386-a10b-9f4e79a7a67d admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:56.818133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd0a02-7ef0-4386-a10b-9f4e79a7a67d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:56.821580 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd0a02-7ef0-4386-a10b-9f4e79a7a67d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:56.835624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f69db8-a961-4f81-84c9-3240116f03e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=521d8c6754524aa381ec042c45b97922, user_id=aef2f95206024484962ec4d3121d9c3f, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:56.838636 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f69db8-a961-4f81-84c9-3240116f03e3 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:56.852499 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1058/2082] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:56 2022] POST /identity/v3/users => generated 305 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:56.858254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1025/2083] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:56 2022] PUT /identity/v3/projects/521d8c6754524aa381ec042c45b97922/users/aef2f95206024484962ec4d3121d9c3f/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:56.865224 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd0a02-7ef0-4386-a10b-9f4e79a7a67d admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:56.868815 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb161cd-6f35-4da3-9421-408d79067fbb None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:56.869103 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb161cd-6f35-4da3-9421-408d79067fbb None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:56.869375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb161cd-6f35-4da3-9421-408d79067fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:56.880814 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd0a02-7ef0-4386-a10b-9f4e79a7a67d admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:56.904540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-acb161cd-6f35-4da3-9421-408d79067fbb None None] MFA Rules not processed for user `aef2f95206024484962ec4d3121d9c3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:56.905951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-acb161cd-6f35-4da3-9421-408d79067fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:56.962367 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c8c04-2092-4d2b-bbc0-244eaf8be691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:56.962367 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c8c04-2092-4d2b-bbc0-244eaf8be691 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:56.962634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c8c04-2092-4d2b-bbc0-244eaf8be691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:56.962884 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c8c04-2092-4d2b-bbc0-244eaf8be691 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:56.963620 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c8c04-2092-4d2b-bbc0-244eaf8be691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:56.965269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c8c04-2092-4d2b-bbc0-244eaf8be691 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:56.976106 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1059/2084] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:56.980674 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c8c04-2092-4d2b-bbc0-244eaf8be691 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:56.990610 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c8c04-2092-4d2b-bbc0-244eaf8be691 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:56.997442 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b314216-f417-4280-a54b-fba6578f65aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:56.998205 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b314216-f417-4280-a54b-fba6578f65aa admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:56.998590 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b314216-f417-4280-a54b-fba6578f65aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:56.998981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b314216-f417-4280-a54b-fba6578f65aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:56.999757 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b314216-f417-4280-a54b-fba6578f65aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:57.001777 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b314216-f417-4280-a54b-fba6578f65aa admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:57.011996 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1026/2085] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:57.014356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1060/2086] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:15:57.020472 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb161cd-6f35-4da3-9421-408d79067fbb None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:57.024481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b314216-f417-4280-a54b-fba6578f65aa admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:57.026577 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8b314216-f417-4280-a54b-fba6578f65aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:57.031269 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb161cd-6f35-4da3-9421-408d79067fbb None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:57.037244 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5fdfc-b256-4d35-b373-ccc164fb2e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:57.037910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5fdfc-b256-4d35-b373-ccc164fb2e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:57.038193 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5fdfc-b256-4d35-b373-ccc164fb2e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:57.038467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5fdfc-b256-4d35-b373-ccc164fb2e19 admin admin] PATH_INFO: `/v3/projects/1e3407308dde41e0a451513e51e01574/users/628ade000ca4471c9417ae3ef7be2640/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:57.056400 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5fdfc-b256-4d35-b373-ccc164fb2e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3407308dde41e0a451513e51e01574, user_id=628ade000ca4471c9417ae3ef7be2640, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:57.059141 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5fdfc-b256-4d35-b373-ccc164fb2e19 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:57.087904 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1027/2087] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:57 2022] PUT /identity/v3/projects/1e3407308dde41e0a451513e51e01574/users/628ade000ca4471c9417ae3ef7be2640/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:57.089815 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a22de1-5ace-4b58-9d54-7a03277eaf7c None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:57.090160 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a22de1-5ace-4b58-9d54-7a03277eaf7c None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:57.090441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a22de1-5ace-4b58-9d54-7a03277eaf7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:57.106423 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b314216-f417-4280-a54b-fba6578f65aa admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:57.124654 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-23a22de1-5ace-4b58-9d54-7a03277eaf7c None None] MFA Rules not processed for user `628ade000ca4471c9417ae3ef7be2640`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:57.126147 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-23a22de1-5ace-4b58-9d54-7a03277eaf7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:57.177161 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:57.232946 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1028/2088] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:57 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:57.234446 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a22de1-5ace-4b58-9d54-7a03277eaf7c None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:57.236124 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c472ee-fe09-45d3-82b7-38d7a28991aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:57.238416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c472ee-fe09-45d3-82b7-38d7a28991aa service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:57.252851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c472ee-fe09-45d3-82b7-38d7a28991aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:57.257165 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c472ee-fe09-45d3-82b7-38d7a28991aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:57.303213 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:57.360986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c472ee-fe09-45d3-82b7-38d7a28991aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:57.361668 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a22de1-5ace-4b58-9d54-7a03277eaf7c None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:57.362977 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c472ee-fe09-45d3-82b7-38d7a28991aa service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:57.371133 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b241074-544e-4595-bf57-c1995ae02460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:57.371925 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b241074-544e-4595-bf57-c1995ae02460 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:57.372208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b241074-544e-4595-bf57-c1995ae02460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:57.372483 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b241074-544e-4595-bf57-c1995ae02460 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:57.373504 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b241074-544e-4595-bf57-c1995ae02460 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:57.376429 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b241074-544e-4595-bf57-c1995ae02460 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:57.383645 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1061/2089] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:57.432602 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1029/2090] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:57 2022] POST /identity/v3/projects => generated 407 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:57.437294 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c472ee-fe09-45d3-82b7-38d7a28991aa service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:57.450293 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c472ee-fe09-45d3-82b7-38d7a28991aa service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:57.562630 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d9c11-b108-4902-8d3d-0b8586391f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:57.563629 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d9c11-b108-4902-8d3d-0b8586391f18 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:57.564200 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d9c11-b108-4902-8d3d-0b8586391f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:57.564765 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d9c11-b108-4902-8d3d-0b8586391f18 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:57.565675 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d9c11-b108-4902-8d3d-0b8586391f18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:57.568464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d9c11-b108-4902-8d3d-0b8586391f18 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:57.636504 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1062/2091] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:57 2022] POST /identity/v3/users => generated 310 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:57.640423 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b241074-544e-4595-bf57-c1995ae02460 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:57.656653 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b241074-544e-4595-bf57-c1995ae02460 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:57.664638 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b90ff-26c9-40d3-97ac-d88a7c6484a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:57.664807 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b90ff-26c9-40d3-97ac-d88a7c6484a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:57.665022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b90ff-26c9-40d3-97ac-d88a7c6484a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:57.665570 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b90ff-26c9-40d3-97ac-d88a7c6484a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:57.666157 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b90ff-26c9-40d3-97ac-d88a7c6484a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:57.668804 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b90ff-26c9-40d3-97ac-d88a7c6484a3 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:57.683036 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1030/2092] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:57.687295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d9c11-b108-4902-8d3d-0b8586391f18 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:57.701794 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d9c11-b108-4902-8d3d-0b8586391f18 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:57.703532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b90ff-26c9-40d3-97ac-d88a7c6484a3 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:57.708434 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-822b90ff-26c9-40d3-97ac-d88a7c6484a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:57.723970 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ed8c1-c797-4ba1-bc67-1f0090708b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:57.727104 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ed8c1-c797-4ba1-bc67-1f0090708b40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:57.727495 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ed8c1-c797-4ba1-bc67-1f0090708b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:57.727855 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ed8c1-c797-4ba1-bc67-1f0090708b40 admin admin] PATH_INFO: `/v3/projects/69cfc03871a04107bd6654896ffc3b02/users/922aad6120764482a804bef61d9362e7/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:57.746749 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b90ff-26c9-40d3-97ac-d88a7c6484a3 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:57.760178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7f02e-8e74-4c47-9819-2da0ee01d1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:57.761682 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7f02e-8e74-4c47-9819-2da0ee01d1b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:57.762046 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7f02e-8e74-4c47-9819-2da0ee01d1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:57.762350 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7f02e-8e74-4c47-9819-2da0ee01d1b2 admin admin] PATH_INFO: `/v3/projects/6bf096970a41494987893a74e4822be2` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:57.763952 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7f02e-8e74-4c47-9819-2da0ee01d1b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bf096970a41494987893a74e4822be2)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:57.769597 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ed8c1-c797-4ba1-bc67-1f0090708b40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69cfc03871a04107bd6654896ffc3b02, user_id=922aad6120764482a804bef61d9362e7, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:57.773255 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ed8c1-c797-4ba1-bc67-1f0090708b40 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:57.777909 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7f02e-8e74-4c47-9819-2da0ee01d1b2 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:57.793691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1063/2093] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:57 2022] PUT /identity/v3/projects/69cfc03871a04107bd6654896ffc3b02/users/922aad6120764482a804bef61d9362e7/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:57.800622 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ed8c1-c797-4ba1-bc67-1f0090708b40 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:57.878785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-10d7f02e-8e74-4c47-9819-2da0ee01d1b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bf096970a41494987893a74e4822be2', 'request_id': 'req-10d7f02e-8e74-4c47-9819-2da0ee01d1b2'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:57.897934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-10d7f02e-8e74-4c47-9819-2da0ee01d1b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bf096970a41494987893a74e4822be2', 'request_id': 'req-10d7f02e-8e74-4c47-9819-2da0ee01d1b2'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:57.914244 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-10d7f02e-8e74-4c47-9819-2da0ee01d1b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bf096970a41494987893a74e4822be2', 'request_id': 'req-10d7f02e-8e74-4c47-9819-2da0ee01d1b2'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:57.932227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ed8c1-c797-4ba1-bc67-1f0090708b40 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:57.937888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:57.942939 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-10d7f02e-8e74-4c47-9819-2da0ee01d1b2 admin admin] The token cache is being invalidate because project 6bf096970a41494987893a74e4822be2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:57.943233 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-10d7f02e-8e74-4c47-9819-2da0ee01d1b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:57.944142 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-10d7f02e-8e74-4c47-9819-2da0ee01d1b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:57.946885 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1031/2094] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:57 2022] DELETE /identity/v3/projects/6bf096970a41494987893a74e4822be2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:57.951997 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7f02e-8e74-4c47-9819-2da0ee01d1b2 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:57.953489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-10d7f02e-8e74-4c47-9819-2da0ee01d1b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:58.033668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0894b5-ee86-49c6-ae47-c97a5569edc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:58.034523 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0894b5-ee86-49c6-ae47-c97a5569edc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:58.034997 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0894b5-ee86-49c6-ae47-c97a5569edc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:58.035330 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0894b5-ee86-49c6-ae47-c97a5569edc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:58.035982 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0894b5-ee86-49c6-ae47-c97a5569edc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:58.037665 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0894b5-ee86-49c6-ae47-c97a5569edc6 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:58.048782 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1064/2095] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:58.053144 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0894b5-ee86-49c6-ae47-c97a5569edc6 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:58.054809 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-fa0894b5-ee86-49c6-ae47-c97a5569edc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:58.056342 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7f02e-8e74-4c47-9819-2da0ee01d1b2 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:58.061858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d52896-e25f-4593-84b2-7a2fef5e3dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:58.062872 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d52896-e25f-4593-84b2-7a2fef5e3dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:58.063937 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d52896-e25f-4593-84b2-7a2fef5e3dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:58.063937 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d52896-e25f-4593-84b2-7a2fef5e3dcf admin admin] PATH_INFO: `/v3/users/1985de9d4a6a4633b00a81e9f69156d2` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:58.064843 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d52896-e25f-4593-84b2-7a2fef5e3dcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1985de9d4a6a4633b00a81e9f69156d2)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:58.066880 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d52896-e25f-4593-84b2-7a2fef5e3dcf admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:58.069078 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0894b5-ee86-49c6-ae47-c97a5569edc6 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:58.074427 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057cee19-84a2-4e65-ac13-fe31bf456f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:58.075195 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057cee19-84a2-4e65-ac13-fe31bf456f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:58.076215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057cee19-84a2-4e65-ac13-fe31bf456f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:58.076215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057cee19-84a2-4e65-ac13-fe31bf456f89 admin admin] PATH_INFO: `/v3/projects/69cfc03871a04107bd6654896ffc3b02/users/922aad6120764482a804bef61d9362e7/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:58.078206 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057cee19-84a2-4e65-ac13-fe31bf456f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69cfc03871a04107bd6654896ffc3b02, user_id=922aad6120764482a804bef61d9362e7, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:58.081189 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057cee19-84a2-4e65-ac13-fe31bf456f89 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:58.092927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:58.094442 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1065/2096] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:58 2022] PUT /identity/v3/projects/69cfc03871a04107bd6654896ffc3b02/users/922aad6120764482a804bef61d9362e7/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:58.106016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01507f35-9252-465f-bfc0-cb81e30e01fa None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:58.106287 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01507f35-9252-465f-bfc0-cb81e30e01fa None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:58.106579 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01507f35-9252-465f-bfc0-cb81e30e01fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:58.123821 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-81d52896-e25f-4593-84b2-7a2fef5e3dcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1985de9d4a6a4633b00a81e9f69156d2'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:58.137449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-81d52896-e25f-4593-84b2-7a2fef5e3dcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1985de9d4a6a4633b00a81e9f69156d2'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:58.137895 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-01507f35-9252-465f-bfc0-cb81e30e01fa None None] MFA Rules not processed for user `922aad6120764482a804bef61d9362e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:58.138152 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-81d52896-e25f-4593-84b2-7a2fef5e3dcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1985de9d4a6a4633b00a81e9f69156d2'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:58.139149 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-01507f35-9252-465f-bfc0-cb81e30e01fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:58.150911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-81d52896-e25f-4593-84b2-7a2fef5e3dcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1985de9d4a6a4633b00a81e9f69156d2'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:58.160508 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-81d52896-e25f-4593-84b2-7a2fef5e3dcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1985de9d4a6a4633b00a81e9f69156d2'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:58.167287 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1032/2097] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:15:57 2022] DELETE /identity/v3/users/1985de9d4a6a4633b00a81e9f69156d2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:58.216928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1066/2098] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:58 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:15:58.228929 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d52896-e25f-4593-84b2-7a2fef5e3dcf admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:58.230661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-81d52896-e25f-4593-84b2-7a2fef5e3dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:58.307169 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d52896-e25f-4593-84b2-7a2fef5e3dcf admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:58.311675 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b3a39-36b7-4205-8450-e9665712505c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:58.312288 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b3a39-36b7-4205-8450-e9665712505c service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:58.312571 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b3a39-36b7-4205-8450-e9665712505c service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:58.312841 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b3a39-36b7-4205-8450-e9665712505c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:58.391667 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b3a39-36b7-4205-8450-e9665712505c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:58.393399 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b3a39-36b7-4205-8450-e9665712505c service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:58.404249 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1033/2099] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:58 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:58.484940 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01507f35-9252-465f-bfc0-cb81e30e01fa None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:58.486449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-01507f35-9252-465f-bfc0-cb81e30e01fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:58.561905 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01507f35-9252-465f-bfc0-cb81e30e01fa None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:58.565384 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b3a39-36b7-4205-8450-e9665712505c service cinder] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:58.567898 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-879b3a39-36b7-4205-8450-e9665712505c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:58.582189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b3a39-36b7-4205-8450-e9665712505c service cinder] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:58.582806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:58.590722 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3aba5-6be7-4f40-bf9e-0492358be75f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:58.590722 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3aba5-6be7-4f40-bf9e-0492358be75f service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:58.590722 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3aba5-6be7-4f40-bf9e-0492358be75f service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:58.590722 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3aba5-6be7-4f40-bf9e-0492358be75f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:58.591172 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-0ca3aba5-6be7-4f40-bf9e-0492358be75f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:58.634159 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e6158-8e77-43de-8a9c-de3f0a696232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:58.634816 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e6158-8e77-43de-8a9c-de3f0a696232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:58.635100 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e6158-8e77-43de-8a9c-de3f0a696232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:58.635376 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e6158-8e77-43de-8a9c-de3f0a696232 admin admin] PATH_INFO: `/v3/projects/4ad59a2dac6246228ee5c7ae5596943e` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:58.636545 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e6158-8e77-43de-8a9c-de3f0a696232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ad59a2dac6246228ee5c7ae5596943e)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:58.639388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e6158-8e77-43de-8a9c-de3f0a696232 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:58.681721 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:58.717485 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b24e6158-8e77-43de-8a9c-de3f0a696232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ad59a2dac6246228ee5c7ae5596943e', 'request_id': 'req-b24e6158-8e77-43de-8a9c-de3f0a696232'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:58.726664 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3aba5-6be7-4f40-bf9e-0492358be75f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:58.737964 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b24e6158-8e77-43de-8a9c-de3f0a696232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ad59a2dac6246228ee5c7ae5596943e', 'request_id': 'req-b24e6158-8e77-43de-8a9c-de3f0a696232'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:58.739340 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3aba5-6be7-4f40-bf9e-0492358be75f service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:58.750345 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b24e6158-8e77-43de-8a9c-de3f0a696232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ad59a2dac6246228ee5c7ae5596943e', 'request_id': 'req-b24e6158-8e77-43de-8a9c-de3f0a696232'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:58.756941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1034/2100] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:58 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:15:58.780959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b24e6158-8e77-43de-8a9c-de3f0a696232 admin admin] The token cache is being invalidate because project 4ad59a2dac6246228ee5c7ae5596943e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:15:58.781259 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b24e6158-8e77-43de-8a9c-de3f0a696232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:58.781994 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b24e6158-8e77-43de-8a9c-de3f0a696232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:15:58.784763 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1067/2101] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:15:58 2022] DELETE /identity/v3/projects/4ad59a2dac6246228ee5c7ae5596943e => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:58.790129 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477079e3-fcf1-4517-9f80-2f769d6db848 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:58.790468 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477079e3-fcf1-4517-9f80-2f769d6db848 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:58.790813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477079e3-fcf1-4517-9f80-2f769d6db848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:58.835277 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-477079e3-fcf1-4517-9f80-2f769d6db848 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:58.839510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-477079e3-fcf1-4517-9f80-2f769d6db848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:58.983697 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1035/2102] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:58.991671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c07b4-7672-4c73-b1b1-219e372eae64 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:58.992035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c07b4-7672-4c73-b1b1-219e372eae64 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:58.992390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c07b4-7672-4c73-b1b1-219e372eae64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:59.013545 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-7e2c07b4-7672-4c73-b1b1-219e372eae64 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:59.014782 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7e2c07b4-7672-4c73-b1b1-219e372eae64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:59.023363 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1068/2103] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:59.027996 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477079e3-fcf1-4517-9f80-2f769d6db848 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:59.039292 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477079e3-fcf1-4517-9f80-2f769d6db848 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:59.044461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b85ee-04f4-4476-a6b7-da49c158f441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:59.045308 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b85ee-04f4-4476-a6b7-da49c158f441 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:59.045748 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b85ee-04f4-4476-a6b7-da49c158f441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:59.046224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b85ee-04f4-4476-a6b7-da49c158f441 admin admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:59.046996 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b85ee-04f4-4476-a6b7-da49c158f441 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:15:59.047333 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b85ee-04f4-4476-a6b7-da49c158f441 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:59.049372 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b85ee-04f4-4476-a6b7-da49c158f441 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:59.067077 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1036/2104] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:15:59.070638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c07b4-7672-4c73-b1b1-219e372eae64 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:59.084260 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c07b4-7672-4c73-b1b1-219e372eae64 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:59.091687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf052f7-18fd-463c-9869-02811342333d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:59.093928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf052f7-18fd-463c-9869-02811342333d admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:59.094622 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf052f7-18fd-463c-9869-02811342333d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:59.095111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf052f7-18fd-463c-9869-02811342333d admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:59.095908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf052f7-18fd-463c-9869-02811342333d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:59.097931 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf052f7-18fd-463c-9869-02811342333d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:59.133426 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1069/2105] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:59 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:59.137259 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf052f7-18fd-463c-9869-02811342333d admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:59.137493 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bc0cc-7d85-42fd-8386-2e86b921e135 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:59.137594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bc0cc-7d85-42fd-8386-2e86b921e135 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:59.137857 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bc0cc-7d85-42fd-8386-2e86b921e135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:59.171291 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-334bc0cc-7d85-42fd-8386-2e86b921e135 None None] MFA Rules not processed for user `aef2f95206024484962ec4d3121d9c3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:59.172583 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-334bc0cc-7d85-42fd-8386-2e86b921e135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:59.253757 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf052f7-18fd-463c-9869-02811342333d admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:59.260428 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428ea4c-6e4d-434c-856f-56f712605758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:59.261123 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1037/2106] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:15:59.261247 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428ea4c-6e4d-434c-856f-56f712605758 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:59.261496 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428ea4c-6e4d-434c-856f-56f712605758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:59.261898 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428ea4c-6e4d-434c-856f-56f712605758 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:59.262606 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428ea4c-6e4d-434c-856f-56f712605758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:59.271658 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428ea4c-6e4d-434c-856f-56f712605758 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:59.300748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1070/2107] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:59 2022] POST /identity/v3/users => generated 288 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:15:59.304869 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bc0cc-7d85-42fd-8386-2e86b921e135 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:59.315895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bc0cc-7d85-42fd-8386-2e86b921e135 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:59.320888 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8f810-f24e-4f4a-955c-89ba56a408ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:59.321712 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8f810-f24e-4f4a-955c-89ba56a408ae admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:59.321908 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8f810-f24e-4f4a-955c-89ba56a408ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:59.322248 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8f810-f24e-4f4a-955c-89ba56a408ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:59.322893 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8f810-f24e-4f4a-955c-89ba56a408ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:59.325067 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8f810-f24e-4f4a-955c-89ba56a408ae admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:59.335300 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1038/2108] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:59.339983 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428ea4c-6e4d-434c-856f-56f712605758 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:59.350334 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428ea4c-6e4d-434c-856f-56f712605758 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:59.355220 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2f111-ffaa-4415-a37c-d567b17e4a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:59.355879 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2f111-ffaa-4415-a37c-d567b17e4a35 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:59.356160 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2f111-ffaa-4415-a37c-d567b17e4a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:59.356434 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2f111-ffaa-4415-a37c-d567b17e4a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:59.357117 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2f111-ffaa-4415-a37c-d567b17e4a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:59.358739 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2f111-ffaa-4415-a37c-d567b17e4a35 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:59.374106 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1071/2109] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:15:59.375475 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8f810-f24e-4f4a-955c-89ba56a408ae admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:59.386433 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8f810-f24e-4f4a-955c-89ba56a408ae admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:59.391315 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d696be1-7248-42a6-8860-784f58d7e2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:59.392003 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d696be1-7248-42a6-8860-784f58d7e2d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:59.392286 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d696be1-7248-42a6-8860-784f58d7e2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:59.392583 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d696be1-7248-42a6-8860-784f58d7e2d2 admin admin] PATH_INFO: `/v3/projects/53d5add8983d4f0593789fc856308e7d/users/433d80581abf4dd98fd6566e29fbf740/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:59.407939 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d696be1-7248-42a6-8860-784f58d7e2d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53d5add8983d4f0593789fc856308e7d, user_id=433d80581abf4dd98fd6566e29fbf740, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:59.410765 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d696be1-7248-42a6-8860-784f58d7e2d2 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:59.426198 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1039/2110] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:59 2022] PUT /identity/v3/projects/53d5add8983d4f0593789fc856308e7d/users/433d80581abf4dd98fd6566e29fbf740/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:15:59.436636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c11f1-72a8-4602-a74d-08a40bb69367 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:59.436922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c11f1-72a8-4602-a74d-08a40bb69367 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:59.437196 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c11f1-72a8-4602-a74d-08a40bb69367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:59.444462 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:59.468830 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-7d9c11f1-72a8-4602-a74d-08a40bb69367 None None] MFA Rules not processed for user `433d80581abf4dd98fd6566e29fbf740`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:59.470070 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7d9c11f1-72a8-4602-a74d-08a40bb69367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:59.537585 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1072/2111] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:15:59.541917 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d696be1-7248-42a6-8860-784f58d7e2d2 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:59.590351 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:59.609556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d696be1-7248-42a6-8860-784f58d7e2d2 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:59.615357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07813f48-78ae-4dd5-ab3b-60f61fd54c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:59.616126 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07813f48-78ae-4dd5-ab3b-60f61fd54c52 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:59.616744 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07813f48-78ae-4dd5-ab3b-60f61fd54c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:59.617023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07813f48-78ae-4dd5-ab3b-60f61fd54c52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:59.617659 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07813f48-78ae-4dd5-ab3b-60f61fd54c52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:59.619863 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07813f48-78ae-4dd5-ab3b-60f61fd54c52 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:59.652733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1040/2112] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:15:59 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:59.654275 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c11f1-72a8-4602-a74d-08a40bb69367 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:59.665611 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c11f1-72a8-4602-a74d-08a40bb69367 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:59.733801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c54ae1-0bdb-4011-a470-ec3ccb1071e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:59.734798 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c54ae1-0bdb-4011-a470-ec3ccb1071e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:59.735092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c54ae1-0bdb-4011-a470-ec3ccb1071e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:59.735486 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c54ae1-0bdb-4011-a470-ec3ccb1071e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:59.736354 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c54ae1-0bdb-4011-a470-ec3ccb1071e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:59.738405 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c54ae1-0bdb-4011-a470-ec3ccb1071e6 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:59.763661 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1073/2113] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:15:59 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:15:59.767727 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07813f48-78ae-4dd5-ab3b-60f61fd54c52 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:59.782691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07813f48-78ae-4dd5-ab3b-60f61fd54c52 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:59.788800 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf7a2d-69fb-4415-90e8-86e2f87c46ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:59.789691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf7a2d-69fb-4415-90e8-86e2f87c46ec admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:59.790126 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf7a2d-69fb-4415-90e8-86e2f87c46ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:59.790699 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf7a2d-69fb-4415-90e8-86e2f87c46ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:59.791661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf7a2d-69fb-4415-90e8-86e2f87c46ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:59.793482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf7a2d-69fb-4415-90e8-86e2f87c46ec admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:59.807118 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1041/2114] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:15:59.811757 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c54ae1-0bdb-4011-a470-ec3ccb1071e6 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:59.824418 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c54ae1-0bdb-4011-a470-ec3ccb1071e6 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:59.847090 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966f499-020b-4001-918e-86684b618b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:59.847090 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966f499-020b-4001-918e-86684b618b41 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:59.847090 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966f499-020b-4001-918e-86684b618b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:59.847090 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966f499-020b-4001-918e-86684b618b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:59.848681 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966f499-020b-4001-918e-86684b618b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:59.849895 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966f499-020b-4001-918e-86684b618b41 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:59.862317 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1074/2115] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:15:59.866582 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf7a2d-69fb-4415-90e8-86e2f87c46ec admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:59.879109 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf7a2d-69fb-4415-90e8-86e2f87c46ec admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:59.884344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682a692-5b3b-4260-8a2a-e6ed3f2a4951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:59.885072 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682a692-5b3b-4260-8a2a-e6ed3f2a4951 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:59.885419 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682a692-5b3b-4260-8a2a-e6ed3f2a4951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:59.885818 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682a692-5b3b-4260-8a2a-e6ed3f2a4951 admin admin] PATH_INFO: `/v3/projects/be1ece71fa0e4f25b78677f4498709ce/users/e0d4cce1e73944c3878753b635163f15/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:59.902108 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682a692-5b3b-4260-8a2a-e6ed3f2a4951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be1ece71fa0e4f25b78677f4498709ce, user_id=e0d4cce1e73944c3878753b635163f15, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:59.904951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682a692-5b3b-4260-8a2a-e6ed3f2a4951 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:59.923541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1042/2116] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:15:59 2022] PUT /identity/v3/projects/be1ece71fa0e4f25b78677f4498709ce/users/e0d4cce1e73944c3878753b635163f15/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:15:59.934092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c8db3-4a73-4029-a8a8-69f80f05db51 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:59.934453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c8db3-4a73-4029-a8a8-69f80f05db51 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:59.934878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c8db3-4a73-4029-a8a8-69f80f05db51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:59.978734 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-801c8db3-4a73-4029-a8a8-69f80f05db51 None None] MFA Rules not processed for user `e0d4cce1e73944c3878753b635163f15`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:59.981021 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-801c8db3-4a73-4029-a8a8-69f80f05db51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:00.093992 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:00.101060 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1075/2117] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:15:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:00.106400 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682a692-5b3b-4260-8a2a-e6ed3f2a4951 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:00.217192 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682a692-5b3b-4260-8a2a-e6ed3f2a4951 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:00.222628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651dfd2e-6612-4539-bf72-150f5b724b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:00.223240 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651dfd2e-6612-4539-bf72-150f5b724b64 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:00.223638 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651dfd2e-6612-4539-bf72-150f5b724b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:00.223826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651dfd2e-6612-4539-bf72-150f5b724b64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:00.224447 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651dfd2e-6612-4539-bf72-150f5b724b64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:00.226956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651dfd2e-6612-4539-bf72-150f5b724b64 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:00.265562 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1043/2118] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:16:00 2022] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:16:00.281203 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c8db3-4a73-4029-a8a8-69f80f05db51 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:00.293892 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c8db3-4a73-4029-a8a8-69f80f05db51 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:00.373979 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79c8aa-1b61-457a-8a74-408b175c0e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:00.374813 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79c8aa-1b61-457a-8a74-408b175c0e7a admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:00.376613 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79c8aa-1b61-457a-8a74-408b175c0e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:00.377007 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79c8aa-1b61-457a-8a74-408b175c0e7a admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:00.377841 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79c8aa-1b61-457a-8a74-408b175c0e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:00.380487 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79c8aa-1b61-457a-8a74-408b175c0e7a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:00.411239 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1076/2119] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:16:00 2022] POST /identity/v3/users => generated 294 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:16:00.415410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651dfd2e-6612-4539-bf72-150f5b724b64 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:00.432947 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651dfd2e-6612-4539-bf72-150f5b724b64 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:00.438229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf7762-634c-44f8-a146-905058a281a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:00.438994 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf7762-634c-44f8-a146-905058a281a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:00.439351 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf7762-634c-44f8-a146-905058a281a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:00.439708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf7762-634c-44f8-a146-905058a281a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:00.440444 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf7762-634c-44f8-a146-905058a281a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:00.442121 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf7762-634c-44f8-a146-905058a281a6 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:00.453689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1044/2120] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:16:00.457917 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79c8aa-1b61-457a-8a74-408b175c0e7a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:00.476100 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79c8aa-1b61-457a-8a74-408b175c0e7a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:00.487588 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035428b-4568-4666-9af0-757df10cbb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:00.489626 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035428b-4568-4666-9af0-757df10cbb4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:00.490202 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035428b-4568-4666-9af0-757df10cbb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:00.490682 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035428b-4568-4666-9af0-757df10cbb4c admin admin] PATH_INFO: `/v3/projects/b431b641dfc04b82a59bba33645dd40e/users/79c7319f72b24323ac8de57eab955f30/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:00.514456 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035428b-4568-4666-9af0-757df10cbb4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b431b641dfc04b82a59bba33645dd40e, user_id=79c7319f72b24323ac8de57eab955f30, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:00.533893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035428b-4568-4666-9af0-757df10cbb4c admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:00.559663 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1077/2121] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:16:00 2022] PUT /identity/v3/projects/b431b641dfc04b82a59bba33645dd40e/users/79c7319f72b24323ac8de57eab955f30/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:00.561729 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf7762-634c-44f8-a146-905058a281a6 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:00.572128 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf7762-634c-44f8-a146-905058a281a6 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:00.634640 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc5b5d-d15d-4c01-9f72-fa45fa74dc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:00.635251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc5b5d-d15d-4c01-9f72-fa45fa74dc5d admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:00.635601 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc5b5d-d15d-4c01-9f72-fa45fa74dc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:00.636425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc5b5d-d15d-4c01-9f72-fa45fa74dc5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:00.637069 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc5b5d-d15d-4c01-9f72-fa45fa74dc5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:00.638655 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc5b5d-d15d-4c01-9f72-fa45fa74dc5d admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:00.648654 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1045/2122] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:16:00.652594 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035428b-4568-4666-9af0-757df10cbb4c admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:00.662683 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035428b-4568-4666-9af0-757df10cbb4c admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:00.668064 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98c7d0-0f0e-4b45-b59a-1eafb29a16fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:00.668789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98c7d0-0f0e-4b45-b59a-1eafb29a16fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:00.669139 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98c7d0-0f0e-4b45-b59a-1eafb29a16fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:00.669480 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98c7d0-0f0e-4b45-b59a-1eafb29a16fa admin admin] PATH_INFO: `/v3/projects/b431b641dfc04b82a59bba33645dd40e/users/79c7319f72b24323ac8de57eab955f30/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:00.671486 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98c7d0-0f0e-4b45-b59a-1eafb29a16fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b431b641dfc04b82a59bba33645dd40e, user_id=79c7319f72b24323ac8de57eab955f30, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:00.674113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98c7d0-0f0e-4b45-b59a-1eafb29a16fa admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:00.685133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1078/2123] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:16:00 2022] PUT /identity/v3/projects/b431b641dfc04b82a59bba33645dd40e/users/79c7319f72b24323ac8de57eab955f30/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:00.695738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad986eb-b141-4923-8a68-7becc35d1e45 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:00.696687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad986eb-b141-4923-8a68-7becc35d1e45 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:00.696687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad986eb-b141-4923-8a68-7becc35d1e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:00.710645 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:00.739169 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-1ad986eb-b141-4923-8a68-7becc35d1e45 None None] MFA Rules not processed for user `79c7319f72b24323ac8de57eab955f30`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:00.740711 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-1ad986eb-b141-4923-8a68-7becc35d1e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:00.815768 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1046/2124] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:00.827596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98c7d0-0f0e-4b45-b59a-1eafb29a16fa admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:00.829336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6b98c7d0-0f0e-4b45-b59a-1eafb29a16fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:00.889533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98c7d0-0f0e-4b45-b59a-1eafb29a16fa admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:00.894452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49caae-1604-4e15-9354-c54cd4e758c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:00.895339 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49caae-1604-4e15-9354-c54cd4e758c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:00.895602 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49caae-1604-4e15-9354-c54cd4e758c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:00.895878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49caae-1604-4e15-9354-c54cd4e758c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:00.964691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49caae-1604-4e15-9354-c54cd4e758c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:00.966125 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49caae-1604-4e15-9354-c54cd4e758c5 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:00.976087 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1079/2125] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:02.649768 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad986eb-b141-4923-8a68-7becc35d1e45 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:02.651223 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-1ad986eb-b141-4923-8a68-7becc35d1e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:02.665407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad986eb-b141-4923-8a68-7becc35d1e45 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:02.669838 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560d530-1631-4eeb-817b-31018a53e540 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:02.670709 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560d530-1631-4eeb-817b-31018a53e540 service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:02.671154 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560d530-1631-4eeb-817b-31018a53e540 service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:02.671539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560d530-1631-4eeb-817b-31018a53e540 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:02.757988 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560d530-1631-4eeb-817b-31018a53e540 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:02.759359 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560d530-1631-4eeb-817b-31018a53e540 service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:02.769533 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1047/2126] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:03.098747 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49caae-1604-4e15-9354-c54cd4e758c5 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:03.100342 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-2e49caae-1604-4e15-9354-c54cd4e758c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:03.122892 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:03.319649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49caae-1604-4e15-9354-c54cd4e758c5 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:03.345515 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbd7ae-9548-4d7e-83bb-d14a47fff9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:03.346955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbd7ae-9548-4d7e-83bb-d14a47fff9d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:03.347245 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbd7ae-9548-4d7e-83bb-d14a47fff9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:03.347535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbd7ae-9548-4d7e-83bb-d14a47fff9d3 admin admin] PATH_INFO: `/v3/users/e91fd62d38954429a492c2fcc2cd04e7` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:03.352413 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbd7ae-9548-4d7e-83bb-d14a47fff9d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e91fd62d38954429a492c2fcc2cd04e7)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:03.355351 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbd7ae-9548-4d7e-83bb-d14a47fff9d3 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:03.469076 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c9fbd7ae-9548-4d7e-83bb-d14a47fff9d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e91fd62d38954429a492c2fcc2cd04e7'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:03.471187 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c9fbd7ae-9548-4d7e-83bb-d14a47fff9d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e91fd62d38954429a492c2fcc2cd04e7'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:03.487147 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c9fbd7ae-9548-4d7e-83bb-d14a47fff9d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e91fd62d38954429a492c2fcc2cd04e7'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:03.501879 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c9fbd7ae-9548-4d7e-83bb-d14a47fff9d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e91fd62d38954429a492c2fcc2cd04e7'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:03.502990 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c9fbd7ae-9548-4d7e-83bb-d14a47fff9d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e91fd62d38954429a492c2fcc2cd04e7'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:03.533271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1080/2127] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:16:03 2022] DELETE /identity/v3/users/e91fd62d38954429a492c2fcc2cd04e7 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:03.537800 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0dae2-abf1-4409-8253-a71b25215f4e None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:03.538116 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0dae2-abf1-4409-8253-a71b25215f4e None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:03.538388 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0dae2-abf1-4409-8253-a71b25215f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:03.577406 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-72f0dae2-abf1-4409-8253-a71b25215f4e None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:03.578969 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-72f0dae2-abf1-4409-8253-a71b25215f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:03.663698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1048/2128] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:16:03.692798 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbd7ae-9548-4d7e-83bb-d14a47fff9d3 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:03.694483 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c9fbd7ae-9548-4d7e-83bb-d14a47fff9d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:03.819471 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0dae2-abf1-4409-8253-a71b25215f4e None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:03.819612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbd7ae-9548-4d7e-83bb-d14a47fff9d3 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:03.821117 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-72f0dae2-abf1-4409-8253-a71b25215f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:03.826395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9453c5-3791-44e4-a651-85a02405ec57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:03.827024 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9453c5-3791-44e4-a651-85a02405ec57 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:03.827355 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9453c5-3791-44e4-a651-85a02405ec57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:03.827602 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9453c5-3791-44e4-a651-85a02405ec57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:03.853223 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9453c5-3791-44e4-a651-85a02405ec57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:03.857253 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9453c5-3791-44e4-a651-85a02405ec57 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:03.883969 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1081/2129] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:03.896519 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:03.935338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0dae2-abf1-4409-8253-a71b25215f4e None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:03.940118 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886b767-d207-42bf-8b62-5635501ec0b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:03.941010 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886b767-d207-42bf-8b62-5635501ec0b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:03.941350 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886b767-d207-42bf-8b62-5635501ec0b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:03.941714 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886b767-d207-42bf-8b62-5635501ec0b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:03.944599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-8886b767-d207-42bf-8b62-5635501ec0b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:04.037147 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886b767-d207-42bf-8b62-5635501ec0b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:04.042110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886b767-d207-42bf-8b62-5635501ec0b0 service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:04.076720 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1049/2130] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:16:04.383730 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9453c5-3791-44e4-a651-85a02405ec57 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:04.385220 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ed9453c5-3791-44e4-a651-85a02405ec57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:04.409834 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9453c5-3791-44e4-a651-85a02405ec57 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:04.429494 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127cc5c2-09c2-41c0-b53e-b44b5d760718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:04.430142 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cc5c2-09c2-41c0-b53e-b44b5d760718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:04.430430 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cc5c2-09c2-41c0-b53e-b44b5d760718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:04.430726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cc5c2-09c2-41c0-b53e-b44b5d760718 admin admin] PATH_INFO: `/v3/projects/a9b52d689a7f4b02b4c016a0f9fcd1e7` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:04.431931 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127cc5c2-09c2-41c0-b53e-b44b5d760718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9b52d689a7f4b02b4c016a0f9fcd1e7)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:04.434061 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127cc5c2-09c2-41c0-b53e-b44b5d760718 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:04.480610 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:04.511328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-127cc5c2-09c2-41c0-b53e-b44b5d760718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9b52d689a7f4b02b4c016a0f9fcd1e7', 'request_id': 'req-127cc5c2-09c2-41c0-b53e-b44b5d760718'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:04.520385 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-127cc5c2-09c2-41c0-b53e-b44b5d760718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9b52d689a7f4b02b4c016a0f9fcd1e7', 'request_id': 'req-127cc5c2-09c2-41c0-b53e-b44b5d760718'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:04.529349 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-127cc5c2-09c2-41c0-b53e-b44b5d760718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9b52d689a7f4b02b4c016a0f9fcd1e7', 'request_id': 'req-127cc5c2-09c2-41c0-b53e-b44b5d760718'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:04.549975 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-127cc5c2-09c2-41c0-b53e-b44b5d760718 admin admin] The token cache is being invalidate because project a9b52d689a7f4b02b4c016a0f9fcd1e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:16:04.550427 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-127cc5c2-09c2-41c0-b53e-b44b5d760718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:04.551203 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-127cc5c2-09c2-41c0-b53e-b44b5d760718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:04.553291 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1082/2131] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:16:04 2022] DELETE /identity/v3/projects/a9b52d689a7f4b02b4c016a0f9fcd1e7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:04.558910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db47a55-fb85-4a8f-b38b-2f65f006978d None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:04.559382 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db47a55-fb85-4a8f-b38b-2f65f006978d None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:04.559686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db47a55-fb85-4a8f-b38b-2f65f006978d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:04.588038 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-1db47a55-fb85-4a8f-b38b-2f65f006978d None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:04.590125 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-1db47a55-fb85-4a8f-b38b-2f65f006978d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:04.686317 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cee3e2-fe99-434c-8cf3-5dd185091df7 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:04.686872 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cee3e2-fe99-434c-8cf3-5dd185091df7 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:04.687316 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cee3e2-fe99-434c-8cf3-5dd185091df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:04.687488 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1050/2132] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:16:04.688455 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db47a55-fb85-4a8f-b38b-2f65f006978d None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:04.689940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-1db47a55-fb85-4a8f-b38b-2f65f006978d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:04.710715 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db47a55-fb85-4a8f-b38b-2f65f006978d None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:04.711393 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-97cee3e2-fe99-434c-8cf3-5dd185091df7 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:04.712692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-97cee3e2-fe99-434c-8cf3-5dd185091df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:04.722308 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1083/2133] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:04.722495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d34a5-98dd-4ead-8b42-e15243a0120a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:04.724217 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d34a5-98dd-4ead-8b42-e15243a0120a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:04.725407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d34a5-98dd-4ead-8b42-e15243a0120a admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:04.725690 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d34a5-98dd-4ead-8b42-e15243a0120a admin admin] PATH_INFO: `/v3/users/628ade000ca4471c9417ae3ef7be2640` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:04.726868 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d34a5-98dd-4ead-8b42-e15243a0120a admin admin] RBAC: Authorizing `identity:delete_user(user_id=628ade000ca4471c9417ae3ef7be2640)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:04.726986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cee3e2-fe99-434c-8cf3-5dd185091df7 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:04.741560 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cee3e2-fe99-434c-8cf3-5dd185091df7 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:04.746969 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d34a5-98dd-4ead-8b42-e15243a0120a admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:04.750139 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06667585-e6bb-4867-90e4-c8955bf1e889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:04.750770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06667585-e6bb-4867-90e4-c8955bf1e889 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:04.751056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06667585-e6bb-4867-90e4-c8955bf1e889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:04.751330 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06667585-e6bb-4867-90e4-c8955bf1e889 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:04.752038 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06667585-e6bb-4867-90e4-c8955bf1e889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:16:04.752348 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06667585-e6bb-4867-90e4-c8955bf1e889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:04.754347 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06667585-e6bb-4867-90e4-c8955bf1e889 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:04.771557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1084/2134] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:16:04.772667 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06667585-e6bb-4867-90e4-c8955bf1e889 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:04.788757 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06667585-e6bb-4867-90e4-c8955bf1e889 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:04.795241 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa3f1b-fef1-4322-9202-1b07c20076bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:04.796047 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa3f1b-fef1-4322-9202-1b07c20076bd admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:04.796420 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa3f1b-fef1-4322-9202-1b07c20076bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:04.797257 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa3f1b-fef1-4322-9202-1b07c20076bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:04.798256 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa3f1b-fef1-4322-9202-1b07c20076bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:04.800954 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa3f1b-fef1-4322-9202-1b07c20076bd admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:04.809009 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-040d34a5-98dd-4ead-8b42-e15243a0120a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '628ade000ca4471c9417ae3ef7be2640'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:04.821758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-040d34a5-98dd-4ead-8b42-e15243a0120a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '628ade000ca4471c9417ae3ef7be2640'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:04.823740 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-040d34a5-98dd-4ead-8b42-e15243a0120a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '628ade000ca4471c9417ae3ef7be2640'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:04.832241 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-040d34a5-98dd-4ead-8b42-e15243a0120a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '628ade000ca4471c9417ae3ef7be2640'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:04.834659 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:04.835478 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1085/2135] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:16:04 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:16:04.839900 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa3f1b-fef1-4322-9202-1b07c20076bd admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:04.843249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-90fa3f1b-fef1-4322-9202-1b07c20076bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:04.844404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-040d34a5-98dd-4ead-8b42-e15243a0120a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '628ade000ca4471c9417ae3ef7be2640'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:04.853603 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1051/2136] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:16:04 2022] DELETE /identity/v3/users/628ade000ca4471c9417ae3ef7be2640 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:04.858835 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a443d-39e3-4680-a991-c7d3519a2aa5 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:04.859949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a443d-39e3-4680-a991-c7d3519a2aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:04.860488 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a443d-39e3-4680-a991-c7d3519a2aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:04.883739 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-571a443d-39e3-4680-a991-c7d3519a2aa5 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:04.885234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-571a443d-39e3-4680-a991-c7d3519a2aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:04.924836 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa3f1b-fef1-4322-9202-1b07c20076bd admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:04.964384 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1052/2137] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:04.972244 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a443d-39e3-4680-a991-c7d3519a2aa5 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:04.974425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-571a443d-39e3-4680-a991-c7d3519a2aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:04.996404 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cde08-5165-4ca8-bc84-165b90c26e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:04.997026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cde08-5165-4ca8-bc84-165b90c26e0f admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:04.997313 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cde08-5165-4ca8-bc84-165b90c26e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:04.997647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cde08-5165-4ca8-bc84-165b90c26e0f admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:04.998230 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cde08-5165-4ca8-bc84-165b90c26e0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:05.000193 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cde08-5165-4ca8-bc84-165b90c26e0f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:05.024301 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1086/2138] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:16:04 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:16:05.028922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cde08-5165-4ca8-bc84-165b90c26e0f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:05.038980 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cde08-5165-4ca8-bc84-165b90c26e0f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:05.045782 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a443d-39e3-4680-a991-c7d3519a2aa5 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:05.045936 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330fa906-8ffe-42ec-aefa-b46c278c1e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:05.047050 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fa906-8ffe-42ec-aefa-b46c278c1e60 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:05.047337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fa906-8ffe-42ec-aefa-b46c278c1e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:05.047654 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fa906-8ffe-42ec-aefa-b46c278c1e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:05.048309 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330fa906-8ffe-42ec-aefa-b46c278c1e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:05.049912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330fa906-8ffe-42ec-aefa-b46c278c1e60 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:05.050151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e15b0-29aa-4201-9e24-f71f117bd0f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:05.050827 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e15b0-29aa-4201-9e24-f71f117bd0f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:05.051189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e15b0-29aa-4201-9e24-f71f117bd0f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:05.051546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e15b0-29aa-4201-9e24-f71f117bd0f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:05.051670 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:05.063177 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e15b0-29aa-4201-9e24-f71f117bd0f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:05.066123 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1087/2139] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:16:05.066619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e15b0-29aa-4201-9e24-f71f117bd0f8 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:05.066728 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330fa906-8ffe-42ec-aefa-b46c278c1e60 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:05.079734 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1053/2140] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:05.097098 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330fa906-8ffe-42ec-aefa-b46c278c1e60 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:05.106212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822e64f-3afc-40e4-ab60-0a821cd1d4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:05.107168 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822e64f-3afc-40e4-ab60-0a821cd1d4ae admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:05.107322 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822e64f-3afc-40e4-ab60-0a821cd1d4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:05.107639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822e64f-3afc-40e4-ab60-0a821cd1d4ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:05.108510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822e64f-3afc-40e4-ab60-0a821cd1d4ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:05.110427 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822e64f-3afc-40e4-ab60-0a821cd1d4ae admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:05.127621 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1088/2141] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:16:05.132693 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e15b0-29aa-4201-9e24-f71f117bd0f8 service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:05.144844 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e15b0-29aa-4201-9e24-f71f117bd0f8 service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:05.150354 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e0056-1e45-4b31-9662-ac47fb033487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:05.151729 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e0056-1e45-4b31-9662-ac47fb033487 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:05.152756 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e0056-1e45-4b31-9662-ac47fb033487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:05.153036 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e0056-1e45-4b31-9662-ac47fb033487 admin admin] PATH_INFO: `/v3/projects/1504d59b5c094a3693878e524a4bac33/users/09c9db375bb84d3abdaa29f3af5a73e5/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:05.174971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e0056-1e45-4b31-9662-ac47fb033487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1504d59b5c094a3693878e524a4bac33, user_id=09c9db375bb84d3abdaa29f3af5a73e5, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:05.178000 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e0056-1e45-4b31-9662-ac47fb033487 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:05.197336 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1054/2142] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:16:05 2022] PUT /identity/v3/projects/1504d59b5c094a3693878e524a4bac33/users/09c9db375bb84d3abdaa29f3af5a73e5/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:05.203982 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ad26d-eacc-4f08-83c4-05eb5d12b259 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:05.204918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ad26d-eacc-4f08-83c4-05eb5d12b259 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:05.205316 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ad26d-eacc-4f08-83c4-05eb5d12b259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:05.242580 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-237ad26d-eacc-4f08-83c4-05eb5d12b259 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:05.244581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-237ad26d-eacc-4f08-83c4-05eb5d12b259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:05.338867 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1089/2143] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:05.380996 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e0056-1e45-4b31-9662-ac47fb033487 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:05.384390 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-546e0056-1e45-4b31-9662-ac47fb033487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:05.483627 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e0056-1e45-4b31-9662-ac47fb033487 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:05.488150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bc329-8a6b-40c6-8aad-b75d3c186432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:05.490114 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bc329-8a6b-40c6-8aad-b75d3c186432 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:05.490600 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bc329-8a6b-40c6-8aad-b75d3c186432 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:05.491071 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bc329-8a6b-40c6-8aad-b75d3c186432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:05.512162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bc329-8a6b-40c6-8aad-b75d3c186432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:05.513821 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bc329-8a6b-40c6-8aad-b75d3c186432 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:05.529239 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1055/2144] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:06.005973 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ad26d-eacc-4f08-83c4-05eb5d12b259 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:06.008016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-237ad26d-eacc-4f08-83c4-05eb5d12b259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:06.031674 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ad26d-eacc-4f08-83c4-05eb5d12b259 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:06.044078 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbdfc3-efea-45b9-b332-23591dd936d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:06.045206 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbdfc3-efea-45b9-b332-23591dd936d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:06.045818 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbdfc3-efea-45b9-b332-23591dd936d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:06.046198 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbdfc3-efea-45b9-b332-23591dd936d7 admin admin] PATH_INFO: `/v3/projects/1e3407308dde41e0a451513e51e01574` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:06.049552 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bbdfc3-efea-45b9-b332-23591dd936d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e3407308dde41e0a451513e51e01574)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:06.052111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bbdfc3-efea-45b9-b332-23591dd936d7 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:06.124835 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c4bbdfc3-efea-45b9-b332-23591dd936d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e3407308dde41e0a451513e51e01574', 'request_id': 'req-c4bbdfc3-efea-45b9-b332-23591dd936d7'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:06.139109 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c4bbdfc3-efea-45b9-b332-23591dd936d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e3407308dde41e0a451513e51e01574', 'request_id': 'req-c4bbdfc3-efea-45b9-b332-23591dd936d7'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:06.149419 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c4bbdfc3-efea-45b9-b332-23591dd936d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e3407308dde41e0a451513e51e01574', 'request_id': 'req-c4bbdfc3-efea-45b9-b332-23591dd936d7'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:06.173274 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c4bbdfc3-efea-45b9-b332-23591dd936d7 admin admin] The token cache is being invalidate because project 1e3407308dde41e0a451513e51e01574 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:16:06.173577 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c4bbdfc3-efea-45b9-b332-23591dd936d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:06.174574 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c4bbdfc3-efea-45b9-b332-23591dd936d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:06.176330 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1090/2145] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:16:06 2022] DELETE /identity/v3/projects/1e3407308dde41e0a451513e51e01574 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:06.180457 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bc329-8a6b-40c6-8aad-b75d3c186432 service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:06.196317 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bc329-8a6b-40c6-8aad-b75d3c186432 service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:06.209748 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:06.307040 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a87a80-59bb-44de-b846-ee62db6ea18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:06.307863 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a87a80-59bb-44de-b846-ee62db6ea18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:06.308146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a87a80-59bb-44de-b846-ee62db6ea18e admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:06.308491 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a87a80-59bb-44de-b846-ee62db6ea18e admin admin] PATH_INFO: `/v3/users/922aad6120764482a804bef61d9362e7` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:06.309938 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a87a80-59bb-44de-b846-ee62db6ea18e admin admin] RBAC: Authorizing `identity:delete_user(user_id=922aad6120764482a804bef61d9362e7)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:06.312152 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a87a80-59bb-44de-b846-ee62db6ea18e admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:06.389184 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-70a87a80-59bb-44de-b846-ee62db6ea18e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '922aad6120764482a804bef61d9362e7'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:06.405465 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-70a87a80-59bb-44de-b846-ee62db6ea18e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '922aad6120764482a804bef61d9362e7'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:06.406234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-70a87a80-59bb-44de-b846-ee62db6ea18e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '922aad6120764482a804bef61d9362e7'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:06.415246 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-70a87a80-59bb-44de-b846-ee62db6ea18e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '922aad6120764482a804bef61d9362e7'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:06.425668 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-70a87a80-59bb-44de-b846-ee62db6ea18e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '922aad6120764482a804bef61d9362e7'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:06.434619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1056/2146] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:16:06 2022] DELETE /identity/v3/users/922aad6120764482a804bef61d9362e7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:06.637420 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bb9cd-cb9f-452f-b6db-d4f912f4736c None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:06.637708 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bb9cd-cb9f-452f-b6db-d4f912f4736c None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:06.637984 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bb9cd-cb9f-452f-b6db-d4f912f4736c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:06.710056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-7e3bb9cd-cb9f-452f-b6db-d4f912f4736c None None] MFA Rules not processed for user `09c9db375bb84d3abdaa29f3af5a73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:06.711487 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7e3bb9cd-cb9f-452f-b6db-d4f912f4736c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:06.826391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:06.847468 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1091/2147] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:06.882864 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a87a80-59bb-44de-b846-ee62db6ea18e admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:06.884986 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-70a87a80-59bb-44de-b846-ee62db6ea18e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:07.027510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a87a80-59bb-44de-b846-ee62db6ea18e admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:07.031955 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa09e7-5326-4e5b-81ca-6e37cacb6ea0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:07.032791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa09e7-5326-4e5b-81ca-6e37cacb6ea0 service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:07.033630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa09e7-5326-4e5b-81ca-6e37cacb6ea0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:07.034076 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa09e7-5326-4e5b-81ca-6e37cacb6ea0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:07.050877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa09e7-5326-4e5b-81ca-6e37cacb6ea0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:07.053014 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa09e7-5326-4e5b-81ca-6e37cacb6ea0 service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:07.068407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1057/2148] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:07.164699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bb9cd-cb9f-452f-b6db-d4f912f4736c None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:07.166774 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7e3bb9cd-cb9f-452f-b6db-d4f912f4736c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:07.351016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bb9cd-cb9f-452f-b6db-d4f912f4736c None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:07.357764 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05729a4-99d3-4753-92d4-4e5bad3ffa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:07.358365 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05729a4-99d3-4753-92d4-4e5bad3ffa18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:07.358636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05729a4-99d3-4753-92d4-4e5bad3ffa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:07.358912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05729a4-99d3-4753-92d4-4e5bad3ffa18 admin admin] PATH_INFO: `/v3/projects/69cfc03871a04107bd6654896ffc3b02` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:07.360795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05729a4-99d3-4753-92d4-4e5bad3ffa18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69cfc03871a04107bd6654896ffc3b02)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:07.362968 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05729a4-99d3-4753-92d4-4e5bad3ffa18 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:07.435019 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f05729a4-99d3-4753-92d4-4e5bad3ffa18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69cfc03871a04107bd6654896ffc3b02', 'request_id': 'req-f05729a4-99d3-4753-92d4-4e5bad3ffa18'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:07.442012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f05729a4-99d3-4753-92d4-4e5bad3ffa18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69cfc03871a04107bd6654896ffc3b02', 'request_id': 'req-f05729a4-99d3-4753-92d4-4e5bad3ffa18'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:07.451857 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f05729a4-99d3-4753-92d4-4e5bad3ffa18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69cfc03871a04107bd6654896ffc3b02', 'request_id': 'req-f05729a4-99d3-4753-92d4-4e5bad3ffa18'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:07.474487 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f05729a4-99d3-4753-92d4-4e5bad3ffa18 admin admin] The token cache is being invalidate because project 69cfc03871a04107bd6654896ffc3b02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:16:07.474782 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f05729a4-99d3-4753-92d4-4e5bad3ffa18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:07.476323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f05729a4-99d3-4753-92d4-4e5bad3ffa18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:07.477996 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1092/2149] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:16:07 2022] DELETE /identity/v3/projects/69cfc03871a04107bd6654896ffc3b02 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:07.483015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bb0ae-143c-4970-b9bf-6505d6569943 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:07.483495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bb0ae-143c-4970-b9bf-6505d6569943 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:07.483577 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bb0ae-143c-4970-b9bf-6505d6569943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:07.512374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-875bb0ae-143c-4970-b9bf-6505d6569943 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:07.513614 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-875bb0ae-143c-4970-b9bf-6505d6569943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:07.549104 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:07.551807 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a924c90-df16-4de8-ac2b-94802888423c None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:07.552838 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a924c90-df16-4de8-ac2b-94802888423c None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:07.553133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a924c90-df16-4de8-ac2b-94802888423c None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:07.555256 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1093/2150] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 28 12:16:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:16:07.582426 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1058/2151] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:07.585871 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901f6f9-c338-4ca3-8a66-1d5bd9e907ee None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:07.586443 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901f6f9-c338-4ca3-8a66-1d5bd9e907ee None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:07.586908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901f6f9-c338-4ca3-8a66-1d5bd9e907ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:07.591573 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4600264-a5f5-4474-b577-2c8f4108dece None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:07.591865 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4600264-a5f5-4474-b577-2c8f4108dece None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:07.592141 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4600264-a5f5-4474-b577-2c8f4108dece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:07.621830 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-b4600264-a5f5-4474-b577-2c8f4108dece None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:07.624830 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-3901f6f9-c338-4ca3-8a66-1d5bd9e907ee None None] MFA Rules not processed for user `09e495edc6fd47c892679bb908c3f5bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:07.626314 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3901f6f9-c338-4ca3-8a66-1d5bd9e907ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:07.627392 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b4600264-a5f5-4474-b577-2c8f4108dece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:07.639201 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1059/2152] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:16:07.640272 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4600264-a5f5-4474-b577-2c8f4108dece None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:07.641778 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b4600264-a5f5-4474-b577-2c8f4108dece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:07.658668 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4600264-a5f5-4474-b577-2c8f4108dece None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:07.665798 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41424cb9-b21c-402c-b927-a68b3cea2ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:07.666644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41424cb9-b21c-402c-b927-a68b3cea2ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:07.666997 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41424cb9-b21c-402c-b927-a68b3cea2ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:07.667341 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41424cb9-b21c-402c-b927-a68b3cea2ef8 admin admin] PATH_INFO: `/v3/users/a1f7c9ea93684f498e0b223d91382a1c` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:07.668884 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41424cb9-b21c-402c-b927-a68b3cea2ef8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f7c9ea93684f498e0b223d91382a1c)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:07.670910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41424cb9-b21c-402c-b927-a68b3cea2ef8 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:07.730543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1094/2153] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 28 12:16:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:07.731203 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901f6f9-c338-4ca3-8a66-1d5bd9e907ee None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:07.751364 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-41424cb9-b21c-402c-b927-a68b3cea2ef8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f7c9ea93684f498e0b223d91382a1c'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:07.759868 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901f6f9-c338-4ca3-8a66-1d5bd9e907ee None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:07.770235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0ebb9-58a3-49d3-a9e5-67d301076fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:07.770925 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0ebb9-58a3-49d3-a9e5-67d301076fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:07.771212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0ebb9-58a3-49d3-a9e5-67d301076fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:07.771558 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0ebb9-58a3-49d3-a9e5-67d301076fb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:07.772311 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0ebb9-58a3-49d3-a9e5-67d301076fb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:16:07.772619 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0ebb9-58a3-49d3-a9e5-67d301076fb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:07.774376 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0ebb9-58a3-49d3-a9e5-67d301076fb0 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:07.775911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-41424cb9-b21c-402c-b927-a68b3cea2ef8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f7c9ea93684f498e0b223d91382a1c'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:07.777783 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-41424cb9-b21c-402c-b927-a68b3cea2ef8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f7c9ea93684f498e0b223d91382a1c'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:07.786731 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-41424cb9-b21c-402c-b927-a68b3cea2ef8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f7c9ea93684f498e0b223d91382a1c'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:07.795924 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1095/2154] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:16:07.796849 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760668b9-e3f2-4969-8c73-258e07940154 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:07.797136 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760668b9-e3f2-4969-8c73-258e07940154 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:07.797467 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760668b9-e3f2-4969-8c73-258e07940154 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:07.798773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1096/2155] 10.222.0.16 () {54 vars in 961 bytes} [Wed Sep 28 12:16:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:16:07.799601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760668b9-e3f2-4969-8c73-258e07940154 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:07.801253 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-41424cb9-b21c-402c-b927-a68b3cea2ef8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f7c9ea93684f498e0b223d91382a1c'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:07.801923 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-760668b9-e3f2-4969-8c73-258e07940154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:07.811113 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1060/2156] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:16:07 2022] DELETE /identity/v3/users/a1f7c9ea93684f498e0b223d91382a1c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:07.812154 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918ba0e-3f87-4491-98e4-93240d31be34 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:07.812537 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918ba0e-3f87-4491-98e4-93240d31be34 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:07.813176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918ba0e-3f87-4491-98e4-93240d31be34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:07.819215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760668b9-e3f2-4969-8c73-258e07940154 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:07.828529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:07.840599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-d918ba0e-3f87-4491-98e4-93240d31be34 None None] MFA Rules not processed for user `09e495edc6fd47c892679bb908c3f5bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:07.841816 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-d918ba0e-3f87-4491-98e4-93240d31be34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:07.907849 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b7cd7-ad76-4aab-82e5-62432b30f983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:07.908742 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b7cd7-ad76-4aab-82e5-62432b30f983 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:07.909549 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b7cd7-ad76-4aab-82e5-62432b30f983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:07.909833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b7cd7-ad76-4aab-82e5-62432b30f983 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:07.910806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b7cd7-ad76-4aab-82e5-62432b30f983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:07.913137 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b7cd7-ad76-4aab-82e5-62432b30f983 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:07.926344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1061/2157] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Sep 28 12:16:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:07.934972 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918ba0e-3f87-4491-98e4-93240d31be34 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:07.946505 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918ba0e-3f87-4491-98e4-93240d31be34 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:07.953670 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1097/2158] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:16:07 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:16:07.954080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf82ed7-1cda-4910-bf0e-d259e9f05263 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09e495edc6fd47c892679bb908c3f5bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:07.954785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf82ed7-1cda-4910-bf0e-d259e9f05263 service placement] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:07.955079 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf82ed7-1cda-4910-bf0e-d259e9f05263 service placement] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:07.955345 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf82ed7-1cda-4910-bf0e-d259e9f05263 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:07.957717 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-ddf82ed7-1cda-4910-bf0e-d259e9f05263 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:07.957902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b7cd7-ad76-4aab-82e5-62432b30f983 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:07.980053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf82ed7-1cda-4910-bf0e-d259e9f05263 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:07.981657 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf82ed7-1cda-4910-bf0e-d259e9f05263 service placement] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:07.998500 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1062/2159] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:16:08.033848 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf82ed7-1cda-4910-bf0e-d259e9f05263 service placement] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:08.035814 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-ddf82ed7-1cda-4910-bf0e-d259e9f05263 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:08.036846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b7cd7-ad76-4aab-82e5-62432b30f983 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:08.042810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa862e-d66b-4850-9da2-f9ea8a052288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:08.044770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa862e-d66b-4850-9da2-f9ea8a052288 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:08.044914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa862e-d66b-4850-9da2-f9ea8a052288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:08.045288 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa862e-d66b-4850-9da2-f9ea8a052288 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:08.046028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa862e-d66b-4850-9da2-f9ea8a052288 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:08.048336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa862e-d66b-4850-9da2-f9ea8a052288 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:08.053233 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf82ed7-1cda-4910-bf0e-d259e9f05263 service placement] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:08.059969 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79fbcc-4967-4971-ab5d-3ca00f43c5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:08.060916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79fbcc-4967-4971-ab5d-3ca00f43c5eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:08.061391 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79fbcc-4967-4971-ab5d-3ca00f43c5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:08.061672 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79fbcc-4967-4971-ab5d-3ca00f43c5eb admin admin] PATH_INFO: `/v3/projects/399af453ac3741968d9af04c080bfb58` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:08.063235 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79fbcc-4967-4971-ab5d-3ca00f43c5eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=399af453ac3741968d9af04c080bfb58)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:08.064936 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79fbcc-4967-4971-ab5d-3ca00f43c5eb admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:08.085075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1098/2160] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:16:07 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:16:08.089830 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:08.090188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa862e-d66b-4850-9da2-f9ea8a052288 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:08.101673 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa862e-d66b-4850-9da2-f9ea8a052288 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:08.108176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22535a4-dec8-45a0-83be-4b867d62e4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:08.108787 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22535a4-dec8-45a0-83be-4b867d62e4ab admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:08.109093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22535a4-dec8-45a0-83be-4b867d62e4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:08.109365 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22535a4-dec8-45a0-83be-4b867d62e4ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:08.110014 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22535a4-dec8-45a0-83be-4b867d62e4ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:08.111625 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22535a4-dec8-45a0-83be-4b867d62e4ab admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:08.122246 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1099/2161] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:16:08.122825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-0c79fbcc-4967-4971-ab5d-3ca00f43c5eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '399af453ac3741968d9af04c080bfb58', 'request_id': 'req-0c79fbcc-4967-4971-ab5d-3ca00f43c5eb'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:08.126613 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22535a4-dec8-45a0-83be-4b867d62e4ab admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:08.129786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-0c79fbcc-4967-4971-ab5d-3ca00f43c5eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '399af453ac3741968d9af04c080bfb58', 'request_id': 'req-0c79fbcc-4967-4971-ab5d-3ca00f43c5eb'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:08.136756 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22535a4-dec8-45a0-83be-4b867d62e4ab admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:08.138443 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-0c79fbcc-4967-4971-ab5d-3ca00f43c5eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '399af453ac3741968d9af04c080bfb58', 'request_id': 'req-0c79fbcc-4967-4971-ab5d-3ca00f43c5eb'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:08.152771 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-0c79fbcc-4967-4971-ab5d-3ca00f43c5eb admin admin] The token cache is being invalidate because project 399af453ac3741968d9af04c080bfb58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:16:08.153099 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-0c79fbcc-4967-4971-ab5d-3ca00f43c5eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:08.153752 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-0c79fbcc-4967-4971-ab5d-3ca00f43c5eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:08.155470 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1063/2162] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:16:08 2022] DELETE /identity/v3/projects/399af453ac3741968d9af04c080bfb58 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:16:08.160173 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b0cd7-53e5-4eac-b3c2-201fbb06ab85 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:08.160457 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b0cd7-53e5-4eac-b3c2-201fbb06ab85 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:08.160725 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b0cd7-53e5-4eac-b3c2-201fbb06ab85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:08.185339 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-9f1b0cd7-53e5-4eac-b3c2-201fbb06ab85 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:08.186950 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-9f1b0cd7-53e5-4eac-b3c2-201fbb06ab85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:08.204701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfb9f8-259c-47e8-a4ee-6caded79947d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:08.205307 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfb9f8-259c-47e8-a4ee-6caded79947d admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:08.205589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfb9f8-259c-47e8-a4ee-6caded79947d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:08.205858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfb9f8-259c-47e8-a4ee-6caded79947d admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:08.206499 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdfb9f8-259c-47e8-a4ee-6caded79947d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:08.208133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdfb9f8-259c-47e8-a4ee-6caded79947d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:08.219152 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1100/2163] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:16:08.222986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfb9f8-259c-47e8-a4ee-6caded79947d admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:08.225172 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3bdfb9f8-259c-47e8-a4ee-6caded79947d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:08.238214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfb9f8-259c-47e8-a4ee-6caded79947d admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:08.244107 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49f970-0bcf-4b02-b530-1a9c8cefc78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:08.245073 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49f970-0bcf-4b02-b530-1a9c8cefc78f admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:08.245690 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49f970-0bcf-4b02-b530-1a9c8cefc78f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:08.245996 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49f970-0bcf-4b02-b530-1a9c8cefc78f admin admin] PATH_INFO: `/v3/projects/fa4a6a1d999341f693f5daf7201fd226/users/8786e816fc714933bcd4b61beb0fb9a6/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:08.254715 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:08.257261 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1064/2164] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:16:08.263623 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49f970-0bcf-4b02-b530-1a9c8cefc78f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa4a6a1d999341f693f5daf7201fd226, user_id=8786e816fc714933bcd4b61beb0fb9a6, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:08.265445 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac608695-712a-4dd3-931c-dbe2d5f12f94 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:08.265739 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac608695-712a-4dd3-931c-dbe2d5f12f94 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:08.266012 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac608695-712a-4dd3-931c-dbe2d5f12f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:08.266560 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49f970-0bcf-4b02-b530-1a9c8cefc78f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:08.281283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1101/2165] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:16:08 2022] PUT /identity/v3/projects/fa4a6a1d999341f693f5daf7201fd226/users/8786e816fc714933bcd4b61beb0fb9a6/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:08.289224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-ac608695-712a-4dd3-931c-dbe2d5f12f94 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:08.289224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-ac608695-712a-4dd3-931c-dbe2d5f12f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:08.292474 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a6b92-6b30-46d5-b9db-184ffcb72325 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:08.292794 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a6b92-6b30-46d5-b9db-184ffcb72325 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:08.293072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a6b92-6b30-46d5-b9db-184ffcb72325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:08.325424 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-d55a6b92-6b30-46d5-b9db-184ffcb72325 None None] MFA Rules not processed for user `8786e816fc714933bcd4b61beb0fb9a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:08.327123 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d55a6b92-6b30-46d5-b9db-184ffcb72325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:08.359370 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1065/2166] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:16:08.363358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac608695-712a-4dd3-931c-dbe2d5f12f94 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:08.376509 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac608695-712a-4dd3-931c-dbe2d5f12f94 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:08.381536 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81616b8-837d-459b-aff4-db6fff8b8692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:08.382136 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81616b8-837d-459b-aff4-db6fff8b8692 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:08.382423 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81616b8-837d-459b-aff4-db6fff8b8692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:08.382803 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81616b8-837d-459b-aff4-db6fff8b8692 admin admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:08.383478 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81616b8-837d-459b-aff4-db6fff8b8692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:16:08.383886 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81616b8-837d-459b-aff4-db6fff8b8692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:08.386054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81616b8-837d-459b-aff4-db6fff8b8692 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:08.398867 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1066/2167] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:16:08.399722 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81616b8-837d-459b-aff4-db6fff8b8692 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:08.401945 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-d81616b8-837d-459b-aff4-db6fff8b8692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:08.407907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1102/2168] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:16:08.408946 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a6b92-6b30-46d5-b9db-184ffcb72325 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:08.415083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81616b8-837d-459b-aff4-db6fff8b8692 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:08.420958 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe188afb-332e-4554-b3eb-271ba8060af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:08.421999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe188afb-332e-4554-b3eb-271ba8060af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:08.422414 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe188afb-332e-4554-b3eb-271ba8060af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:08.422569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a6b92-6b30-46d5-b9db-184ffcb72325 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:08.422812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe188afb-332e-4554-b3eb-271ba8060af6 admin admin] PATH_INFO: `/v3/users/433d80581abf4dd98fd6566e29fbf740` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:08.424262 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe188afb-332e-4554-b3eb-271ba8060af6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=433d80581abf4dd98fd6566e29fbf740)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:08.426677 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe188afb-332e-4554-b3eb-271ba8060af6 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:08.428519 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a39784-0cff-448b-9c3f-4f1044236e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:08.429206 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a39784-0cff-448b-9c3f-4f1044236e83 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:08.429490 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a39784-0cff-448b-9c3f-4f1044236e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:08.429851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a39784-0cff-448b-9c3f-4f1044236e83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:08.430483 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a39784-0cff-448b-9c3f-4f1044236e83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:08.432426 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a39784-0cff-448b-9c3f-4f1044236e83 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:08.460773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1103/2169] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:16:08 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:16:08.461618 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a39784-0cff-448b-9c3f-4f1044236e83 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:08.462915 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:08.463389 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-75a39784-0cff-448b-9c3f-4f1044236e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:08.479077 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-fe188afb-332e-4554-b3eb-271ba8060af6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '433d80581abf4dd98fd6566e29fbf740'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:08.491625 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-fe188afb-332e-4554-b3eb-271ba8060af6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '433d80581abf4dd98fd6566e29fbf740'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:08.492624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-fe188afb-332e-4554-b3eb-271ba8060af6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '433d80581abf4dd98fd6566e29fbf740'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:08.508791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-fe188afb-332e-4554-b3eb-271ba8060af6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '433d80581abf4dd98fd6566e29fbf740'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:08.517193 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-fe188afb-332e-4554-b3eb-271ba8060af6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '433d80581abf4dd98fd6566e29fbf740'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:08.523565 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1067/2170] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:16:08 2022] DELETE /identity/v3/users/433d80581abf4dd98fd6566e29fbf740 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:08.524336 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe188afb-332e-4554-b3eb-271ba8060af6 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:08.525713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-fe188afb-332e-4554-b3eb-271ba8060af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:08.528182 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a39784-0cff-448b-9c3f-4f1044236e83 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:08.583166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51db81a-895e-47de-b464-e4293d506791 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:08.583881 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51db81a-895e-47de-b464-e4293d506791 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:08.584173 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51db81a-895e-47de-b464-e4293d506791 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:08.584438 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51db81a-895e-47de-b464-e4293d506791 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:08.586289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f51db81a-895e-47de-b464-e4293d506791 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:08.603005 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe188afb-332e-4554-b3eb-271ba8060af6 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:08.607777 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f454b3b-66b4-4418-897b-e30577d83814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:08.608382 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f454b3b-66b4-4418-897b-e30577d83814 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:08.608667 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f454b3b-66b4-4418-897b-e30577d83814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:08.608941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f454b3b-66b4-4418-897b-e30577d83814 admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:08.609567 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f454b3b-66b4-4418-897b-e30577d83814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:08.611470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:08.611601 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f454b3b-66b4-4418-897b-e30577d83814 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:08.634015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1068/2171] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:16:08 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:16:08.635546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9b52a-9048-48b0-9794-0033c0f9963e None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:08.636345 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9b52a-9048-48b0-9794-0033c0f9963e None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:08.636663 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9b52a-9048-48b0-9794-0033c0f9963e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:08.652296 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51db81a-895e-47de-b464-e4293d506791 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:08.653795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51db81a-895e-47de-b464-e4293d506791 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:08.660763 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-10b9b52a-9048-48b0-9794-0033c0f9963e None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:08.662216 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-10b9b52a-9048-48b0-9794-0033c0f9963e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:08.663791 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1104/2172] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:08.664995 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09379668-f123-408f-b5df-aec8b99f9f7f None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:08.665350 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09379668-f123-408f-b5df-aec8b99f9f7f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:08.665688 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09379668-f123-408f-b5df-aec8b99f9f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:08.674686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1069/2173] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:08.674686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b9b52a-9048-48b0-9794-0033c0f9963e None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:08.686795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-09379668-f123-408f-b5df-aec8b99f9f7f None None] MFA Rules not processed for user `09c9db375bb84d3abdaa29f3af5a73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:08.688183 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-09379668-f123-408f-b5df-aec8b99f9f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:08.692038 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b9b52a-9048-48b0-9794-0033c0f9963e None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:08.696682 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771f158-8fe8-4498-b9d1-ddd7f5514b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:08.697286 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771f158-8fe8-4498-b9d1-ddd7f5514b4f admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:08.697564 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771f158-8fe8-4498-b9d1-ddd7f5514b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:08.697840 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771f158-8fe8-4498-b9d1-ddd7f5514b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:08.699099 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771f158-8fe8-4498-b9d1-ddd7f5514b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:08.700733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771f158-8fe8-4498-b9d1-ddd7f5514b4f admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:08.711390 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1070/2174] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:16:08.712237 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771f158-8fe8-4498-b9d1-ddd7f5514b4f admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:08.715675 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-d771f158-8fe8-4498-b9d1-ddd7f5514b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:08.750737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1105/2175] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:08.751765 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09379668-f123-408f-b5df-aec8b99f9f7f None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:08.753059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-09379668-f123-408f-b5df-aec8b99f9f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:08.767461 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09379668-f123-408f-b5df-aec8b99f9f7f None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:08.772244 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbd337-556d-438b-825c-63c68611ac28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:08.772874 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbd337-556d-438b-825c-63c68611ac28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:08.773157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbd337-556d-438b-825c-63c68611ac28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:08.773433 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbd337-556d-438b-825c-63c68611ac28 admin admin] PATH_INFO: `/v3/users/8786e816fc714933bcd4b61beb0fb9a6` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:08.774690 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbd337-556d-438b-825c-63c68611ac28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8786e816fc714933bcd4b61beb0fb9a6)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:08.776679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbd337-556d-438b-825c-63c68611ac28 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:08.785043 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771f158-8fe8-4498-b9d1-ddd7f5514b4f admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:08.789301 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015fbed-3b70-4144-aeeb-93021c7ba130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:08.789918 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015fbed-3b70-4144-aeeb-93021c7ba130 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:08.790479 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015fbed-3b70-4144-aeeb-93021c7ba130 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:08.790761 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015fbed-3b70-4144-aeeb-93021c7ba130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:08.803657 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015fbed-3b70-4144-aeeb-93021c7ba130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:08.805155 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015fbed-3b70-4144-aeeb-93021c7ba130 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:08.816756 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1071/2176] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:08.817578 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015fbed-3b70-4144-aeeb-93021c7ba130 service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:08.837340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-38dbd337-556d-438b-825c-63c68611ac28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8786e816fc714933bcd4b61beb0fb9a6'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:08.838316 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-38dbd337-556d-438b-825c-63c68611ac28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8786e816fc714933bcd4b61beb0fb9a6'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:08.848623 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-38dbd337-556d-438b-825c-63c68611ac28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8786e816fc714933bcd4b61beb0fb9a6'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:08.852247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015fbed-3b70-4144-aeeb-93021c7ba130 service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:08.859586 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa29564-dffc-4f47-9d3d-7fb62b9c9f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:08.860540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa29564-dffc-4f47-9d3d-7fb62b9c9f97 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:08.860947 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa29564-dffc-4f47-9d3d-7fb62b9c9f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:08.861289 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa29564-dffc-4f47-9d3d-7fb62b9c9f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:08.861701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-38dbd337-556d-438b-825c-63c68611ac28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8786e816fc714933bcd4b61beb0fb9a6'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:08.862200 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa29564-dffc-4f47-9d3d-7fb62b9c9f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:08.863784 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-38dbd337-556d-438b-825c-63c68611ac28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8786e816fc714933bcd4b61beb0fb9a6'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:08.864675 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa29564-dffc-4f47-9d3d-7fb62b9c9f97 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:08.880436 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1072/2177] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:16:08.886695 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa29564-dffc-4f47-9d3d-7fb62b9c9f97 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:08.889134 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-cfa29564-dffc-4f47-9d3d-7fb62b9c9f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:08.890102 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1106/2178] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:16:08 2022] DELETE /identity/v3/users/8786e816fc714933bcd4b61beb0fb9a6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:08.895231 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd06f6-cd9b-4676-9035-7fbe6e4b005b None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:08.895764 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd06f6-cd9b-4676-9035-7fbe6e4b005b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:08.896115 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd06f6-cd9b-4676-9035-7fbe6e4b005b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:08.909235 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa29564-dffc-4f47-9d3d-7fb62b9c9f97 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:08.923055 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:08.926213 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-eacd06f6-cd9b-4676-9035-7fbe6e4b005b None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:08.928293 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-eacd06f6-cd9b-4676-9035-7fbe6e4b005b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:09.025084 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:09.046340 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa82a5-5b0b-45f0-b6f4-cc8c380f4421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:09.051038 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa82a5-5b0b-45f0-b6f4-cc8c380f4421 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:09.052950 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa82a5-5b0b-45f0-b6f4-cc8c380f4421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:09.054494 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa82a5-5b0b-45f0-b6f4-cc8c380f4421 admin admin] PATH_INFO: `/v3/projects/73e9bfe0bb26448eb7ee095e843875ee/users/3a69e60dfcae44bca65d20c34c7b9a48/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:09.070766 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1107/2179] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:09.093677 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa82a5-5b0b-45f0-b6f4-cc8c380f4421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73e9bfe0bb26448eb7ee095e843875ee, user_id=3a69e60dfcae44bca65d20c34c7b9a48, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:09.096475 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa82a5-5b0b-45f0-b6f4-cc8c380f4421 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:09.110061 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd06f6-cd9b-4676-9035-7fbe6e4b005b None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:09.112973 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-eacd06f6-cd9b-4676-9035-7fbe6e4b005b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:09.131729 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1073/2180] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:16:08 2022] PUT /identity/v3/projects/73e9bfe0bb26448eb7ee095e843875ee/users/3a69e60dfcae44bca65d20c34c7b9a48/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:09.141737 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629b911-9667-4f20-8233-7d20fb4e4f6a None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:09.142020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629b911-9667-4f20-8233-7d20fb4e4f6a None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:09.142302 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629b911-9667-4f20-8233-7d20fb4e4f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:09.180685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-3629b911-9667-4f20-8233-7d20fb4e4f6a None None] MFA Rules not processed for user `3a69e60dfcae44bca65d20c34c7b9a48`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:09.183475 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-3629b911-9667-4f20-8233-7d20fb4e4f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:09.211177 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd06f6-cd9b-4676-9035-7fbe6e4b005b None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:09.307857 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1074/2181] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:16:09.308732 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629b911-9667-4f20-8233-7d20fb4e4f6a None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:09.312528 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-3629b911-9667-4f20-8233-7d20fb4e4f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:09.325190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e219c3-9e53-4ea7-b889-b210435318ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:09.325942 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e219c3-9e53-4ea7-b889-b210435318ec service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:09.326095 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e219c3-9e53-4ea7-b889-b210435318ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:09.326408 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e219c3-9e53-4ea7-b889-b210435318ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:09.408931 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e219c3-9e53-4ea7-b889-b210435318ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:09.410622 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e219c3-9e53-4ea7-b889-b210435318ec service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:09.423838 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1108/2182] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:09.425133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e219c3-9e53-4ea7-b889-b210435318ec service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:09.441106 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e219c3-9e53-4ea7-b889-b210435318ec service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:09.466724 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b47846-01df-41c1-bea9-0d23155cc54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:09.471215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b47846-01df-41c1-bea9-0d23155cc54f admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:09.473143 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b47846-01df-41c1-bea9-0d23155cc54f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:09.473143 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b47846-01df-41c1-bea9-0d23155cc54f admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:09.474095 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b47846-01df-41c1-bea9-0d23155cc54f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:09.480096 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b47846-01df-41c1-bea9-0d23155cc54f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:09.483480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629b911-9667-4f20-8233-7d20fb4e4f6a None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:09.506005 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5155b-d81c-4b63-ad80-2a3ea01a2f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:09.506808 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5155b-d81c-4b63-ad80-2a3ea01a2f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:09.507899 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5155b-d81c-4b63-ad80-2a3ea01a2f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:09.508279 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5155b-d81c-4b63-ad80-2a3ea01a2f6d admin admin] PATH_INFO: `/v3/projects/53d5add8983d4f0593789fc856308e7d` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:09.513836 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5155b-d81c-4b63-ad80-2a3ea01a2f6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=53d5add8983d4f0593789fc856308e7d)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:09.516121 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5155b-d81c-4b63-ad80-2a3ea01a2f6d admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:09.549810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1109/2183] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:16:09 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:16:09.553635 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b47846-01df-41c1-bea9-0d23155cc54f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:09.583592 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:09.608163 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-2ae5155b-d81c-4b63-ad80-2a3ea01a2f6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53d5add8983d4f0593789fc856308e7d', 'request_id': 'req-2ae5155b-d81c-4b63-ad80-2a3ea01a2f6d'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:09.624929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:09.630647 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-2ae5155b-d81c-4b63-ad80-2a3ea01a2f6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53d5add8983d4f0593789fc856308e7d', 'request_id': 'req-2ae5155b-d81c-4b63-ad80-2a3ea01a2f6d'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:09.645171 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-2ae5155b-d81c-4b63-ad80-2a3ea01a2f6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53d5add8983d4f0593789fc856308e7d', 'request_id': 'req-2ae5155b-d81c-4b63-ad80-2a3ea01a2f6d'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:09.670223 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-2ae5155b-d81c-4b63-ad80-2a3ea01a2f6d admin admin] The token cache is being invalidate because project 53d5add8983d4f0593789fc856308e7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:16:09.670675 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-2ae5155b-d81c-4b63-ad80-2a3ea01a2f6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:09.673837 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-2ae5155b-d81c-4b63-ad80-2a3ea01a2f6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:09.676269 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1075/2184] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:16:09 2022] DELETE /identity/v3/projects/53d5add8983d4f0593789fc856308e7d => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:09.680175 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5155b-d81c-4b63-ad80-2a3ea01a2f6d admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:09.684339 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-2ae5155b-d81c-4b63-ad80-2a3ea01a2f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:09.689814 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b47846-01df-41c1-bea9-0d23155cc54f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:09.793604 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fc092-ae87-499c-a540-48869ec5ad35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:09.794336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fc092-ae87-499c-a540-48869ec5ad35 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:09.794839 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fc092-ae87-499c-a540-48869ec5ad35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:09.795641 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fc092-ae87-499c-a540-48869ec5ad35 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:09.796407 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10fc092-ae87-499c-a540-48869ec5ad35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:09.798592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10fc092-ae87-499c-a540-48869ec5ad35 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:09.827604 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1110/2185] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:16:09 2022] POST /identity/v3/users => generated 292 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:16:09.831115 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fc092-ae87-499c-a540-48869ec5ad35 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:09.833293 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f10fc092-ae87-499c-a540-48869ec5ad35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:09.840630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5155b-d81c-4b63-ad80-2a3ea01a2f6d admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:09.846921 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc2665-b696-421b-81b5-8af49ed2b60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:09.847608 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc2665-b696-421b-81b5-8af49ed2b60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:09.847890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc2665-b696-421b-81b5-8af49ed2b60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:09.848161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc2665-b696-421b-81b5-8af49ed2b60e admin admin] PATH_INFO: `/v3/users/e0d4cce1e73944c3878753b635163f15` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:09.849325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc2665-b696-421b-81b5-8af49ed2b60e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0d4cce1e73944c3878753b635163f15)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:09.849453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fc092-ae87-499c-a540-48869ec5ad35 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:09.851472 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc2665-b696-421b-81b5-8af49ed2b60e admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:09.857905 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7d311-c736-4c48-add7-bc76f47f39b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:09.858784 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7d311-c736-4c48-add7-bc76f47f39b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:09.859539 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7d311-c736-4c48-add7-bc76f47f39b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:09.860168 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7d311-c736-4c48-add7-bc76f47f39b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:09.860895 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7d311-c736-4c48-add7-bc76f47f39b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:09.862589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7d311-c736-4c48-add7-bc76f47f39b6 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:09.880792 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1111/2186] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:16:09.888114 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7d311-c736-4c48-add7-bc76f47f39b6 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:09.900898 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7d311-c736-4c48-add7-bc76f47f39b6 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:09.906569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0fe47-f098-44d1-b297-7af6662489ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:09.907538 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0fe47-f098-44d1-b297-7af6662489ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:09.908107 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0fe47-f098-44d1-b297-7af6662489ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:09.908359 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0fe47-f098-44d1-b297-7af6662489ab admin admin] PATH_INFO: `/v3/projects/305a607d00154d69a337b6be23920539/users/43987a818aa647258b72b14f1768eb16/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:09.930535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0fe47-f098-44d1-b297-7af6662489ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=305a607d00154d69a337b6be23920539, user_id=43987a818aa647258b72b14f1768eb16, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:09.933067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0fe47-f098-44d1-b297-7af6662489ab admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:09.933817 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-90bc2665-b696-421b-81b5-8af49ed2b60e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0d4cce1e73944c3878753b635163f15'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:09.950727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1112/2187] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:16:09 2022] PUT /identity/v3/projects/305a607d00154d69a337b6be23920539/users/43987a818aa647258b72b14f1768eb16/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:09.954249 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-90bc2665-b696-421b-81b5-8af49ed2b60e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0d4cce1e73944c3878753b635163f15'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:09.954943 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0fe47-f098-44d1-b297-7af6662489ab admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:09.955110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-90bc2665-b696-421b-81b5-8af49ed2b60e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0d4cce1e73944c3878753b635163f15'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:09.956868 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-cce0fe47-f098-44d1-b297-7af6662489ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:09.966338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-90bc2665-b696-421b-81b5-8af49ed2b60e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0d4cce1e73944c3878753b635163f15'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:09.978958 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-90bc2665-b696-421b-81b5-8af49ed2b60e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0d4cce1e73944c3878753b635163f15'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:09.986471 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1076/2188] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:16:09 2022] DELETE /identity/v3/users/e0d4cce1e73944c3878753b635163f15 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:16:09.987311 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc2665-b696-421b-81b5-8af49ed2b60e admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:09.988855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-90bc2665-b696-421b-81b5-8af49ed2b60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:10.054837 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:10.073795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0fe47-f098-44d1-b297-7af6662489ab admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:10.104196 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc2665-b696-421b-81b5-8af49ed2b60e admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:10.110467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1714e1b-39ce-4d6e-a8f6-5dd896f80c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:10.111212 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1714e1b-39ce-4d6e-a8f6-5dd896f80c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:10.111833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1714e1b-39ce-4d6e-a8f6-5dd896f80c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:10.112118 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1714e1b-39ce-4d6e-a8f6-5dd896f80c0d admin admin] PATH_INFO: `/v3/projects/fa4a6a1d999341f693f5daf7201fd226` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:10.113349 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1714e1b-39ce-4d6e-a8f6-5dd896f80c0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa4a6a1d999341f693f5daf7201fd226)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:10.115304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1714e1b-39ce-4d6e-a8f6-5dd896f80c0d admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:10.137350 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:10.174134 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2be4b-5c5f-4eba-bf81-6a9faf4eb54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:10.174811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2be4b-5c5f-4eba-bf81-6a9faf4eb54b admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:10.175012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2be4b-5c5f-4eba-bf81-6a9faf4eb54b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:10.175618 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2be4b-5c5f-4eba-bf81-6a9faf4eb54b admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:10.176269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2be4b-5c5f-4eba-bf81-6a9faf4eb54b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:10.178602 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2be4b-5c5f-4eba-bf81-6a9faf4eb54b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:10.194104 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1113/2189] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:16:10.195105 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2be4b-5c5f-4eba-bf81-6a9faf4eb54b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:10.202401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c1714e1b-39ce-4d6e-a8f6-5dd896f80c0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa4a6a1d999341f693f5daf7201fd226', 'request_id': 'req-c1714e1b-39ce-4d6e-a8f6-5dd896f80c0d'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:10.209707 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c1714e1b-39ce-4d6e-a8f6-5dd896f80c0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa4a6a1d999341f693f5daf7201fd226', 'request_id': 'req-c1714e1b-39ce-4d6e-a8f6-5dd896f80c0d'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:10.212323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2be4b-5c5f-4eba-bf81-6a9faf4eb54b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:10.221772 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c1714e1b-39ce-4d6e-a8f6-5dd896f80c0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa4a6a1d999341f693f5daf7201fd226', 'request_id': 'req-c1714e1b-39ce-4d6e-a8f6-5dd896f80c0d'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:10.236065 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c1714e1b-39ce-4d6e-a8f6-5dd896f80c0d admin admin] The token cache is being invalidate because project fa4a6a1d999341f693f5daf7201fd226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:16:10.236681 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c1714e1b-39ce-4d6e-a8f6-5dd896f80c0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:10.237869 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c1714e1b-39ce-4d6e-a8f6-5dd896f80c0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:10.239807 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1077/2190] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:16:09 2022] DELETE /identity/v3/projects/fa4a6a1d999341f693f5daf7201fd226 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:10.245184 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2726ee8-9ff5-45f8-b3a5-c2cb81a9bb9d None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:10.245632 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2726ee8-9ff5-45f8-b3a5-c2cb81a9bb9d None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:10.246031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2726ee8-9ff5-45f8-b3a5-c2cb81a9bb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:10.271026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-d2726ee8-9ff5-45f8-b3a5-c2cb81a9bb9d None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:10.272794 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-d2726ee8-9ff5-45f8-b3a5-c2cb81a9bb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:10.289500 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbac861-f354-4388-a2a1-6fa3c53cde09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:10.290154 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbac861-f354-4388-a2a1-6fa3c53cde09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:10.290436 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbac861-f354-4388-a2a1-6fa3c53cde09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:10.290713 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbac861-f354-4388-a2a1-6fa3c53cde09 admin admin] PATH_INFO: `/v3/projects/305a607d00154d69a337b6be23920539/users/43987a818aa647258b72b14f1768eb16/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:10.292858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbac861-f354-4388-a2a1-6fa3c53cde09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=305a607d00154d69a337b6be23920539, user_id=43987a818aa647258b72b14f1768eb16, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:10.295528 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbac861-f354-4388-a2a1-6fa3c53cde09 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:10.321054 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1114/2191] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:16:10 2022] PUT /identity/v3/projects/305a607d00154d69a337b6be23920539/users/43987a818aa647258b72b14f1768eb16/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:16:10.324681 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f29410-7a50-431d-8670-93b6ebe3f012 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:10.325289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f29410-7a50-431d-8670-93b6ebe3f012 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:10.325983 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f29410-7a50-431d-8670-93b6ebe3f012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:10.340817 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1078/2192] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:16:10.341678 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2726ee8-9ff5-45f8-b3a5-c2cb81a9bb9d None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:10.342992 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-d2726ee8-9ff5-45f8-b3a5-c2cb81a9bb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:10.357759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2726ee8-9ff5-45f8-b3a5-c2cb81a9bb9d None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:10.362195 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-09f29410-7a50-431d-8670-93b6ebe3f012 None None] MFA Rules not processed for user `43987a818aa647258b72b14f1768eb16`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:10.363727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-09f29410-7a50-431d-8670-93b6ebe3f012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:10.429534 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90c647-a301-4935-a531-1550a9cb96c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:10.430160 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90c647-a301-4935-a531-1550a9cb96c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:10.430441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90c647-a301-4935-a531-1550a9cb96c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:10.430706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90c647-a301-4935-a531-1550a9cb96c9 admin admin] PATH_INFO: `/v3/projects/be1ece71fa0e4f25b78677f4498709ce` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:10.432037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f90c647-a301-4935-a531-1550a9cb96c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be1ece71fa0e4f25b78677f4498709ce)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:10.434415 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f90c647-a301-4935-a531-1550a9cb96c9 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:10.441576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:10.453071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1115/2193] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:16:10.454266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede1536-686e-4bd6-bce5-c9681da3d895 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:10.454561 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede1536-686e-4bd6-bce5-c9681da3d895 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:10.454821 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede1536-686e-4bd6-bce5-c9681da3d895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:10.485049 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-dede1536-686e-4bd6-bce5-c9681da3d895 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:10.486314 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-dede1536-686e-4bd6-bce5-c9681da3d895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:10.499755 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4f90c647-a301-4935-a531-1550a9cb96c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be1ece71fa0e4f25b78677f4498709ce', 'request_id': 'req-4f90c647-a301-4935-a531-1550a9cb96c9'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:10.505328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4f90c647-a301-4935-a531-1550a9cb96c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be1ece71fa0e4f25b78677f4498709ce', 'request_id': 'req-4f90c647-a301-4935-a531-1550a9cb96c9'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:10.513455 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4f90c647-a301-4935-a531-1550a9cb96c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be1ece71fa0e4f25b78677f4498709ce', 'request_id': 'req-4f90c647-a301-4935-a531-1550a9cb96c9'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:10.528985 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4f90c647-a301-4935-a531-1550a9cb96c9 admin admin] The token cache is being invalidate because project be1ece71fa0e4f25b78677f4498709ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:16:10.529273 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4f90c647-a301-4935-a531-1550a9cb96c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:10.529955 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4f90c647-a301-4935-a531-1550a9cb96c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:10.531482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1079/2194] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:16:10 2022] DELETE /identity/v3/projects/be1ece71fa0e4f25b78677f4498709ce => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:10.532252 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90c647-a301-4935-a531-1550a9cb96c9 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:10.533515 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-4f90c647-a301-4935-a531-1550a9cb96c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:10.543163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:10.560749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1116/2195] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:10.561633 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede1536-686e-4bd6-bce5-c9681da3d895 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:10.562895 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-dede1536-686e-4bd6-bce5-c9681da3d895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:10.574780 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede1536-686e-4bd6-bce5-c9681da3d895 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:10.579714 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63442b-4206-4d78-8a8a-108fb6f676a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:10.580332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63442b-4206-4d78-8a8a-108fb6f676a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:10.580607 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63442b-4206-4d78-8a8a-108fb6f676a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:10.580872 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63442b-4206-4d78-8a8a-108fb6f676a4 admin admin] PATH_INFO: `/v3/users/79c7319f72b24323ac8de57eab955f30` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:10.582167 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63442b-4206-4d78-8a8a-108fb6f676a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79c7319f72b24323ac8de57eab955f30)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:10.584140 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63442b-4206-4d78-8a8a-108fb6f676a4 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:10.595673 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90c647-a301-4935-a531-1550a9cb96c9 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:10.599326 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdffcca-ef73-4623-8f4b-486b5bcfe455 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:10.599967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdffcca-ef73-4623-8f4b-486b5bcfe455 service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:10.600251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdffcca-ef73-4623-8f4b-486b5bcfe455 service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:10.600523 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdffcca-ef73-4623-8f4b-486b5bcfe455 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:10.602299 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-2cdffcca-ef73-4623-8f4b-486b5bcfe455 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:10.637755 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9b63442b-4206-4d78-8a8a-108fb6f676a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79c7319f72b24323ac8de57eab955f30'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:10.638465 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9b63442b-4206-4d78-8a8a-108fb6f676a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79c7319f72b24323ac8de57eab955f30'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:10.648124 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9b63442b-4206-4d78-8a8a-108fb6f676a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79c7319f72b24323ac8de57eab955f30'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:10.658211 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9b63442b-4206-4d78-8a8a-108fb6f676a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79c7319f72b24323ac8de57eab955f30'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:10.658988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9b63442b-4206-4d78-8a8a-108fb6f676a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79c7319f72b24323ac8de57eab955f30'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:10.679760 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdffcca-ef73-4623-8f4b-486b5bcfe455 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:10.682310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdffcca-ef73-4623-8f4b-486b5bcfe455 service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:10.686393 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1117/2196] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:16:10 2022] DELETE /identity/v3/users/79c7319f72b24323ac8de57eab955f30 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:10.687235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63442b-4206-4d78-8a8a-108fb6f676a4 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:10.690476 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9b63442b-4206-4d78-8a8a-108fb6f676a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:10.715498 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1080/2197] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:10 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:10.799164 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63442b-4206-4d78-8a8a-108fb6f676a4 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:10.809207 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c455ad-f0eb-4813-98ce-9c123e4356aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:10.810152 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c455ad-f0eb-4813-98ce-9c123e4356aa admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:10.813247 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c455ad-f0eb-4813-98ce-9c123e4356aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:10.814316 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c455ad-f0eb-4813-98ce-9c123e4356aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:10.815721 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c455ad-f0eb-4813-98ce-9c123e4356aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:16:10.817892 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c455ad-f0eb-4813-98ce-9c123e4356aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:10.820076 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c455ad-f0eb-4813-98ce-9c123e4356aa admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:10.838982 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdffcca-ef73-4623-8f4b-486b5bcfe455 service cinder] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:10.844847 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1118/2198] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:16:10.849127 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdffcca-ef73-4623-8f4b-486b5bcfe455 service cinder] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:10.851351 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c455ad-f0eb-4813-98ce-9c123e4356aa admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:10.874886 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c455ad-f0eb-4813-98ce-9c123e4356aa admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:10.882413 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5da7b-d37e-4940-a44f-b24b7c69442f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:10.883126 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5da7b-d37e-4940-a44f-b24b7c69442f admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:10.883668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5da7b-d37e-4940-a44f-b24b7c69442f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:10.883945 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5da7b-d37e-4940-a44f-b24b7c69442f admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:10.884782 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5da7b-d37e-4940-a44f-b24b7c69442f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:10.887468 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5da7b-d37e-4940-a44f-b24b7c69442f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:10.906596 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:10.922882 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb097a8-fb17-4944-a5d1-d23c0ccad705 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:10.923542 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb097a8-fb17-4944-a5d1-d23c0ccad705 service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:10.923825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb097a8-fb17-4944-a5d1-d23c0ccad705 service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:10.924097 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb097a8-fb17-4944-a5d1-d23c0ccad705 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:10.925921 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-dbb097a8-fb17-4944-a5d1-d23c0ccad705 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:10.947974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1119/2199] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:16:10 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:16:10.952679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5da7b-d37e-4940-a44f-b24b7c69442f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:11.016353 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:11.036763 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb097a8-fb17-4944-a5d1-d23c0ccad705 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:11.038329 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb097a8-fb17-4944-a5d1-d23c0ccad705 service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:11.042955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5da7b-d37e-4940-a44f-b24b7c69442f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:11.049091 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307de07d-e159-48d7-8e56-508e7f7e8e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:11.049091 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307de07d-e159-48d7-8e56-508e7f7e8e67 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:11.049091 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307de07d-e159-48d7-8e56-508e7f7e8e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:11.049487 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307de07d-e159-48d7-8e56-508e7f7e8e67 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:11.050930 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307de07d-e159-48d7-8e56-508e7f7e8e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:11.051662 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1081/2200] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:16:11.052011 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307de07d-e159-48d7-8e56-508e7f7e8e67 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:11.077722 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb097a8-fb17-4944-a5d1-d23c0ccad705 service cinder] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:11.080139 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1120/2201] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:16:10 2022] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:16:11.083849 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307de07d-e159-48d7-8e56-508e7f7e8e67 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:11.085247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-dbb097a8-fb17-4944-a5d1-d23c0ccad705 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:11.108085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307de07d-e159-48d7-8e56-508e7f7e8e67 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:11.118063 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8880c-0568-4947-8412-c5ae6df821dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:11.118820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8880c-0568-4947-8412-c5ae6df821dd admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:11.119103 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8880c-0568-4947-8412-c5ae6df821dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:11.119413 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8880c-0568-4947-8412-c5ae6df821dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:11.120827 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb097a8-fb17-4944-a5d1-d23c0ccad705 service cinder] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:11.121037 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8880c-0568-4947-8412-c5ae6df821dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:11.123079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8880c-0568-4947-8412-c5ae6df821dd admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:11.130685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef42139-9d29-47dd-9fe1-76322258cc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:11.131968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef42139-9d29-47dd-9fe1-76322258cc99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:11.133814 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef42139-9d29-47dd-9fe1-76322258cc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:11.134102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef42139-9d29-47dd-9fe1-76322258cc99 admin admin] PATH_INFO: `/v3/projects/b431b641dfc04b82a59bba33645dd40e` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:11.135983 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef42139-9d29-47dd-9fe1-76322258cc99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b431b641dfc04b82a59bba33645dd40e)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:11.140733 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1121/2202] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:16:11.140868 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef42139-9d29-47dd-9fe1-76322258cc99 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:11.142922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8880c-0568-4947-8412-c5ae6df821dd admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:11.158057 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8880c-0568-4947-8412-c5ae6df821dd admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:11.165196 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb13bea-e159-45a1-bd95-70689f6444cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:11.166084 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb13bea-e159-45a1-bd95-70689f6444cb admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:11.166347 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb13bea-e159-45a1-bd95-70689f6444cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:11.167477 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb13bea-e159-45a1-bd95-70689f6444cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:11.168752 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb13bea-e159-45a1-bd95-70689f6444cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:11.170875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb13bea-e159-45a1-bd95-70689f6444cb admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:11.190052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1122/2203] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:16:11.190052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb13bea-e159-45a1-bd95-70689f6444cb admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:11.204158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb13bea-e159-45a1-bd95-70689f6444cb admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:11.217636 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-cef42139-9d29-47dd-9fe1-76322258cc99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b431b641dfc04b82a59bba33645dd40e', 'request_id': 'req-cef42139-9d29-47dd-9fe1-76322258cc99'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:11.223846 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-cef42139-9d29-47dd-9fe1-76322258cc99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b431b641dfc04b82a59bba33645dd40e', 'request_id': 'req-cef42139-9d29-47dd-9fe1-76322258cc99'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:11.237897 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-cef42139-9d29-47dd-9fe1-76322258cc99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b431b641dfc04b82a59bba33645dd40e', 'request_id': 'req-cef42139-9d29-47dd-9fe1-76322258cc99'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:11.251033 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-cef42139-9d29-47dd-9fe1-76322258cc99 admin admin] The token cache is being invalidate because project b431b641dfc04b82a59bba33645dd40e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:16:11.251747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-cef42139-9d29-47dd-9fe1-76322258cc99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:11.252429 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-cef42139-9d29-47dd-9fe1-76322258cc99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:11.254385 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1082/2204] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:16:11 2022] DELETE /identity/v3/projects/b431b641dfc04b82a59bba33645dd40e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:11.273424 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b591a2-3257-4323-bd2e-c617c4445d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:11.274156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b591a2-3257-4323-bd2e-c617c4445d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:11.274417 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b591a2-3257-4323-bd2e-c617c4445d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:11.274687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b591a2-3257-4323-bd2e-c617c4445d06 admin admin] PATH_INFO: `/v3/projects/a030543ca1b449138d75c238ed5a562a/users/a4e1324dfbcb480ba76660793d93a2ca/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:11.293409 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b591a2-3257-4323-bd2e-c617c4445d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a030543ca1b449138d75c238ed5a562a, user_id=a4e1324dfbcb480ba76660793d93a2ca, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:11.296183 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b591a2-3257-4323-bd2e-c617c4445d06 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:11.314225 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1123/2205] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:16:11 2022] PUT /identity/v3/projects/a030543ca1b449138d75c238ed5a562a/users/a4e1324dfbcb480ba76660793d93a2ca/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:11.326040 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26046b4a-394f-4765-998a-50f90a167320 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:11.326432 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26046b4a-394f-4765-998a-50f90a167320 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:11.326827 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26046b4a-394f-4765-998a-50f90a167320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:11.358621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-26046b4a-394f-4765-998a-50f90a167320 None None] MFA Rules not processed for user `a4e1324dfbcb480ba76660793d93a2ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:11.360034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-26046b4a-394f-4765-998a-50f90a167320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:11.431365 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1083/2206] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:11.443008 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b591a2-3257-4323-bd2e-c617c4445d06 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:11.444870 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e4b591a2-3257-4323-bd2e-c617c4445d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:11.502530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b591a2-3257-4323-bd2e-c617c4445d06 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:11.506229 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab22378-b47c-4201-80c8-9e08040e4dc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:11.506831 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab22378-b47c-4201-80c8-9e08040e4dc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:11.507106 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab22378-b47c-4201-80c8-9e08040e4dc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:11.507374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab22378-b47c-4201-80c8-9e08040e4dc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:11.515708 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab22378-b47c-4201-80c8-9e08040e4dc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:11.517105 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab22378-b47c-4201-80c8-9e08040e4dc8 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:11.525761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1124/2207] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:14.600697 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26046b4a-394f-4765-998a-50f90a167320 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:14.602820 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-26046b4a-394f-4765-998a-50f90a167320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:14.617295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:14.672999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26046b4a-394f-4765-998a-50f90a167320 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:14.677973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f10fc-e4be-453d-9e40-8188810bda68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:14.678705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f10fc-e4be-453d-9e40-8188810bda68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:14.678984 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f10fc-e4be-453d-9e40-8188810bda68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:14.679289 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f10fc-e4be-453d-9e40-8188810bda68 admin admin] PATH_INFO: `/v3/users/a4e1324dfbcb480ba76660793d93a2ca` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:14.680532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f10fc-e4be-453d-9e40-8188810bda68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4e1324dfbcb480ba76660793d93a2ca)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:14.682983 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f10fc-e4be-453d-9e40-8188810bda68 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:14.742350 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-387f10fc-e4be-453d-9e40-8188810bda68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4e1324dfbcb480ba76660793d93a2ca'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:14.755585 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-387f10fc-e4be-453d-9e40-8188810bda68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4e1324dfbcb480ba76660793d93a2ca'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:14.756290 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-387f10fc-e4be-453d-9e40-8188810bda68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4e1324dfbcb480ba76660793d93a2ca'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:14.764613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-387f10fc-e4be-453d-9e40-8188810bda68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4e1324dfbcb480ba76660793d93a2ca'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:14.774531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-387f10fc-e4be-453d-9e40-8188810bda68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4e1324dfbcb480ba76660793d93a2ca'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:14.782260 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1084/2208] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:16:14 2022] DELETE /identity/v3/users/a4e1324dfbcb480ba76660793d93a2ca => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:14.787534 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15b0b6-9c1e-46e4-b39d-e962f3f99955 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:14.788019 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15b0b6-9c1e-46e4-b39d-e962f3f99955 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:14.788283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15b0b6-9c1e-46e4-b39d-e962f3f99955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:14.808608 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-cf15b0b6-9c1e-46e4-b39d-e962f3f99955 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:14.810161 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-cf15b0b6-9c1e-46e4-b39d-e962f3f99955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:14.838064 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:14.884786 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1125/2209] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:14.894393 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f10fc-e4be-453d-9e40-8188810bda68 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:14.895979 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-387f10fc-e4be-453d-9e40-8188810bda68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:15.012419 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f10fc-e4be-453d-9e40-8188810bda68 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:15.020620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f63a14-809d-4e69-a08c-6caaf0b94e0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:15.022364 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f63a14-809d-4e69-a08c-6caaf0b94e0c service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:15.022759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f63a14-809d-4e69-a08c-6caaf0b94e0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:15.023090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f63a14-809d-4e69-a08c-6caaf0b94e0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:15.044152 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f63a14-809d-4e69-a08c-6caaf0b94e0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:15.045962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f63a14-809d-4e69-a08c-6caaf0b94e0c service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:15.059034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1085/2210] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:15.434170 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15b0b6-9c1e-46e4-b39d-e962f3f99955 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:15.436358 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-cf15b0b6-9c1e-46e4-b39d-e962f3f99955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:15.468540 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15b0b6-9c1e-46e4-b39d-e962f3f99955 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:15.482932 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dff1c2-c4af-4b68-a831-314cc3c95b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:15.483658 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dff1c2-c4af-4b68-a831-314cc3c95b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:15.483924 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dff1c2-c4af-4b68-a831-314cc3c95b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:15.484200 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dff1c2-c4af-4b68-a831-314cc3c95b57 admin admin] PATH_INFO: `/v3/projects/a030543ca1b449138d75c238ed5a562a` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:15.486122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dff1c2-c4af-4b68-a831-314cc3c95b57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a030543ca1b449138d75c238ed5a562a)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:15.488223 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dff1c2-c4af-4b68-a831-314cc3c95b57 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:15.582871 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-67dff1c2-c4af-4b68-a831-314cc3c95b57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a030543ca1b449138d75c238ed5a562a', 'request_id': 'req-67dff1c2-c4af-4b68-a831-314cc3c95b57'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:15.604914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-67dff1c2-c4af-4b68-a831-314cc3c95b57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a030543ca1b449138d75c238ed5a562a', 'request_id': 'req-67dff1c2-c4af-4b68-a831-314cc3c95b57'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:15.620467 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-67dff1c2-c4af-4b68-a831-314cc3c95b57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a030543ca1b449138d75c238ed5a562a', 'request_id': 'req-67dff1c2-c4af-4b68-a831-314cc3c95b57'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:15.645223 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-67dff1c2-c4af-4b68-a831-314cc3c95b57 admin admin] The token cache is being invalidate because project a030543ca1b449138d75c238ed5a562a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:16:15.645637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-67dff1c2-c4af-4b68-a831-314cc3c95b57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:15.647008 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-67dff1c2-c4af-4b68-a831-314cc3c95b57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:15.650623 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1126/2211] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:16:15 2022] DELETE /identity/v3/projects/a030543ca1b449138d75c238ed5a562a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:17.052511 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ea0fe-5ab5-407f-81cf-a3cd7d4da370 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:17.052959 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ea0fe-5ab5-407f-81cf-a3cd7d4da370 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:17.053037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ea0fe-5ab5-407f-81cf-a3cd7d4da370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:17.078335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-261ea0fe-5ab5-407f-81cf-a3cd7d4da370 None None] MFA Rules not processed for user `c0e57ea982d349c1a86b544e9a6e7758`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:17.079613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-261ea0fe-5ab5-407f-81cf-a3cd7d4da370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:17.127548 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:17.164814 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1086/2212] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 28 12:16:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:17.178625 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dff1c2-c4af-4b68-a831-314cc3c95b57 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:17.180621 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-67dff1c2-c4af-4b68-a831-314cc3c95b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:17.269539 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dff1c2-c4af-4b68-a831-314cc3c95b57 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:17.274907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39832abd-0516-46ce-ad46-955e927d0fc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '822e394e80fd41adb54d330adaf65a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:17.275543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39832abd-0516-46ce-ad46-955e927d0fc4 service swift] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:17.275947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39832abd-0516-46ce-ad46-955e927d0fc4 service swift] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:17.276141 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39832abd-0516-46ce-ad46-955e927d0fc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:17.285063 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39832abd-0516-46ce-ad46-955e927d0fc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:17.286747 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39832abd-0516-46ce-ad46-955e927d0fc4 service swift] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:17.296518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1127/2213] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 28 12:16:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 12:16:17.839148 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8f4d3-2479-4e53-b467-f0fff5ea9067 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:17.839418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8f4d3-2479-4e53-b467-f0fff5ea9067 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:17.839704 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8f4d3-2479-4e53-b467-f0fff5ea9067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:17.859353 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-29c8f4d3-2479-4e53-b467-f0fff5ea9067 None None] MFA Rules not processed for user `c0e57ea982d349c1a86b544e9a6e7758`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:17.860520 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-29c8f4d3-2479-4e53-b467-f0fff5ea9067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:17.867991 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1087/2214] 10.222.0.16 () {58 vars in 967 bytes} [Wed Sep 28 12:16:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:17.890745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39832abd-0516-46ce-ad46-955e927d0fc4 service swift] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:17.901837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39832abd-0516-46ce-ad46-955e927d0fc4 service swift] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:17.906898 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5d30f-88b1-462d-aad5-63231a6dcb39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '822e394e80fd41adb54d330adaf65a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:17.907522 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5d30f-88b1-462d-aad5-63231a6dcb39 service swift] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:17.907800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5d30f-88b1-462d-aad5-63231a6dcb39 service swift] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:17.908068 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5d30f-88b1-462d-aad5-63231a6dcb39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:17.917142 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5d30f-88b1-462d-aad5-63231a6dcb39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:17.918707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5d30f-88b1-462d-aad5-63231a6dcb39 service swift] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:17.926725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1128/2215] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 28 12:16:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 12:16:18.174981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efae8a-cdcf-4770-a6a3-2e48a54fc2d0 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:18.175480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efae8a-cdcf-4770-a6a3-2e48a54fc2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:18.175710 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efae8a-cdcf-4770-a6a3-2e48a54fc2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:18.195688 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-86efae8a-cdcf-4770-a6a3-2e48a54fc2d0 None None] MFA Rules not processed for user `c0e57ea982d349c1a86b544e9a6e7758`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:18.196900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-86efae8a-cdcf-4770-a6a3-2e48a54fc2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:18.204477 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1088/2216] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 28 12:16:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:18.216381 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5d30f-88b1-462d-aad5-63231a6dcb39 service swift] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:18.227057 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5d30f-88b1-462d-aad5-63231a6dcb39 service swift] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:18.232754 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbacb5-a2c0-418d-b35f-b2ad8762b5dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '822e394e80fd41adb54d330adaf65a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:18.233499 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbacb5-a2c0-418d-b35f-b2ad8762b5dd service swift] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:18.233750 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbacb5-a2c0-418d-b35f-b2ad8762b5dd service swift] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:18.234021 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbacb5-a2c0-418d-b35f-b2ad8762b5dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:18.242645 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbacb5-a2c0-418d-b35f-b2ad8762b5dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:18.244319 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbacb5-a2c0-418d-b35f-b2ad8762b5dd service swift] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:18.252744 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1129/2217] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 28 12:16:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 28 12:16:18.613967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f73b35-ed45-45ec-baaf-2794447fed33 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:18.614334 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f73b35-ed45-45ec-baaf-2794447fed33 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:18.614614 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f73b35-ed45-45ec-baaf-2794447fed33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:18.635861 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-32f73b35-ed45-45ec-baaf-2794447fed33 None None] MFA Rules not processed for user `c0e57ea982d349c1a86b544e9a6e7758`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:18.637101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-32f73b35-ed45-45ec-baaf-2794447fed33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:18.645770 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1089/2218] 10.222.0.16 () {58 vars in 967 bytes} [Wed Sep 28 12:16:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:18.658650 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbacb5-a2c0-418d-b35f-b2ad8762b5dd service swift] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:18.670553 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbacb5-a2c0-418d-b35f-b2ad8762b5dd service swift] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:18.676142 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28390e3d-188b-4fa1-849e-c4d1dca800a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '822e394e80fd41adb54d330adaf65a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:18.676750 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28390e3d-188b-4fa1-849e-c4d1dca800a1 service swift] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:18.677064 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28390e3d-188b-4fa1-849e-c4d1dca800a1 service swift] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:18.677341 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28390e3d-188b-4fa1-849e-c4d1dca800a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:18.685581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28390e3d-188b-4fa1-849e-c4d1dca800a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:18.687170 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28390e3d-188b-4fa1-849e-c4d1dca800a1 service swift] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:18.695190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1130/2219] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 28 12:16:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 12:16:20.822621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f73b35-ed45-45ec-baaf-2794447fed33 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:20.824063 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-32f73b35-ed45-45ec-baaf-2794447fed33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:20.887845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f73b35-ed45-45ec-baaf-2794447fed33 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:20.892352 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c0901-181a-48a3-9a6a-9e2a4ee02d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:20.892968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c0901-181a-48a3-9a6a-9e2a4ee02d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:20.893247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c0901-181a-48a3-9a6a-9e2a4ee02d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:20.893521 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c0901-181a-48a3-9a6a-9e2a4ee02d88 admin admin] PATH_INFO: `/v3/users/aef2f95206024484962ec4d3121d9c3f` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:20.894639 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c0901-181a-48a3-9a6a-9e2a4ee02d88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aef2f95206024484962ec4d3121d9c3f)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:20.896588 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c0901-181a-48a3-9a6a-9e2a4ee02d88 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:20.941684 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-368c0901-181a-48a3-9a6a-9e2a4ee02d88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aef2f95206024484962ec4d3121d9c3f'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:20.954029 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-368c0901-181a-48a3-9a6a-9e2a4ee02d88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aef2f95206024484962ec4d3121d9c3f'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:20.954618 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-368c0901-181a-48a3-9a6a-9e2a4ee02d88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aef2f95206024484962ec4d3121d9c3f'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:20.963042 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-368c0901-181a-48a3-9a6a-9e2a4ee02d88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aef2f95206024484962ec4d3121d9c3f'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:20.971569 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-368c0901-181a-48a3-9a6a-9e2a4ee02d88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aef2f95206024484962ec4d3121d9c3f'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:20.977783 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1090/2220] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:16:20 2022] DELETE /identity/v3/users/aef2f95206024484962ec4d3121d9c3f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:16:20.982127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545351e-3a30-49de-aa5d-70ab0dd81790 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:20.982535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545351e-3a30-49de-aa5d-70ab0dd81790 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:20.982731 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545351e-3a30-49de-aa5d-70ab0dd81790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:20.990154 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:21.007525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-e545351e-3a30-49de-aa5d-70ab0dd81790 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:21.009296 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e545351e-3a30-49de-aa5d-70ab0dd81790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:21.084165 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1131/2221] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:21.094917 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c0901-181a-48a3-9a6a-9e2a4ee02d88 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:21.096369 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-368c0901-181a-48a3-9a6a-9e2a4ee02d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:21.147620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:21.169005 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c0901-181a-48a3-9a6a-9e2a4ee02d88 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:21.172958 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57698621-2ce1-4265-a731-ebdd28be3311 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:21.173631 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57698621-2ce1-4265-a731-ebdd28be3311 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:21.173911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57698621-2ce1-4265-a731-ebdd28be3311 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:21.174219 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57698621-2ce1-4265-a731-ebdd28be3311 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:21.185630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57698621-2ce1-4265-a731-ebdd28be3311 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:21.187379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57698621-2ce1-4265-a731-ebdd28be3311 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:21.201734 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1091/2222] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:21.439559 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545351e-3a30-49de-aa5d-70ab0dd81790 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:21.440661 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e545351e-3a30-49de-aa5d-70ab0dd81790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:21.454628 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545351e-3a30-49de-aa5d-70ab0dd81790 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:21.459411 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa4a7c-861f-4c0f-973a-f2a8918f8ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:21.460173 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa4a7c-861f-4c0f-973a-f2a8918f8ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:21.460551 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa4a7c-861f-4c0f-973a-f2a8918f8ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:21.460929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa4a7c-861f-4c0f-973a-f2a8918f8ae9 admin admin] PATH_INFO: `/v3/projects/521d8c6754524aa381ec042c45b97922` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:21.462827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa4a7c-861f-4c0f-973a-f2a8918f8ae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=521d8c6754524aa381ec042c45b97922)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:21.464980 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa4a7c-861f-4c0f-973a-f2a8918f8ae9 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:21.515377 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9baa4a7c-861f-4c0f-973a-f2a8918f8ae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '521d8c6754524aa381ec042c45b97922', 'request_id': 'req-9baa4a7c-861f-4c0f-973a-f2a8918f8ae9'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:21.521118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9baa4a7c-861f-4c0f-973a-f2a8918f8ae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '521d8c6754524aa381ec042c45b97922', 'request_id': 'req-9baa4a7c-861f-4c0f-973a-f2a8918f8ae9'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:21.527429 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9baa4a7c-861f-4c0f-973a-f2a8918f8ae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '521d8c6754524aa381ec042c45b97922', 'request_id': 'req-9baa4a7c-861f-4c0f-973a-f2a8918f8ae9'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:21.539703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9baa4a7c-861f-4c0f-973a-f2a8918f8ae9 admin admin] The token cache is being invalidate because project 521d8c6754524aa381ec042c45b97922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:16:21.539991 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9baa4a7c-861f-4c0f-973a-f2a8918f8ae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:21.540616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9baa4a7c-861f-4c0f-973a-f2a8918f8ae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:21.542114 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1132/2223] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:16:21 2022] DELETE /identity/v3/projects/521d8c6754524aa381ec042c45b97922 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:29.583255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260e71a-6dbb-42bf-a2be-7f865e1fdb72 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:29.583785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260e71a-6dbb-42bf-a2be-7f865e1fdb72 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:29.583877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260e71a-6dbb-42bf-a2be-7f865e1fdb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:29.602395 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-8260e71a-6dbb-42bf-a2be-7f865e1fdb72 None None] MFA Rules not processed for user `09c9db375bb84d3abdaa29f3af5a73e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:29.603661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-8260e71a-6dbb-42bf-a2be-7f865e1fdb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:29.659998 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1092/2224] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:31.536830 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:39.653286 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=34 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:40.881984 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa4a7c-861f-4c0f-973a-f2a8918f8ae9 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:40.883381 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9baa4a7c-861f-4c0f-973a-f2a8918f8ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:40.949119 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa4a7c-861f-4c0f-973a-f2a8918f8ae9 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:40.953730 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ba3ce-6d45-4c79-80db-b1d72ace794b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:40.954357 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ba3ce-6d45-4c79-80db-b1d72ace794b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:40.954637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ba3ce-6d45-4c79-80db-b1d72ace794b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:40.954911 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ba3ce-6d45-4c79-80db-b1d72ace794b admin admin] PATH_INFO: `/v3/users/3a69e60dfcae44bca65d20c34c7b9a48` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:40.956042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ba3ce-6d45-4c79-80db-b1d72ace794b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a69e60dfcae44bca65d20c34c7b9a48)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:40.957961 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ba3ce-6d45-4c79-80db-b1d72ace794b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:41.003496 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-372ba3ce-6d45-4c79-80db-b1d72ace794b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a69e60dfcae44bca65d20c34c7b9a48'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:41.004134 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-372ba3ce-6d45-4c79-80db-b1d72ace794b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a69e60dfcae44bca65d20c34c7b9a48'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:41.012020 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-372ba3ce-6d45-4c79-80db-b1d72ace794b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a69e60dfcae44bca65d20c34c7b9a48'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:41.019314 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-372ba3ce-6d45-4c79-80db-b1d72ace794b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a69e60dfcae44bca65d20c34c7b9a48'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:41.019962 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-372ba3ce-6d45-4c79-80db-b1d72ace794b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a69e60dfcae44bca65d20c34c7b9a48'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:41.037247 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1133/2225] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:16:40 2022] DELETE /identity/v3/users/3a69e60dfcae44bca65d20c34c7b9a48 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:41.041804 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe0da5-5d0a-4720-b2fe-f7c3e416a728 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:41.042244 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe0da5-5d0a-4720-b2fe-f7c3e416a728 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:41.042338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe0da5-5d0a-4720-b2fe-f7c3e416a728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:41.062390 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-1efe0da5-5d0a-4720-b2fe-f7c3e416a728 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:41.063613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-1efe0da5-5d0a-4720-b2fe-f7c3e416a728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:41.122307 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1093/2226] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:16:41.132168 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ba3ce-6d45-4c79-80db-b1d72ace794b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:41.133579 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-372ba3ce-6d45-4c79-80db-b1d72ace794b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:41.191216 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ba3ce-6d45-4c79-80db-b1d72ace794b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:41.200763 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ff18e-08c0-42e2-abc6-792e427699ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:41.201377 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ff18e-08c0-42e2-abc6-792e427699ef service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:41.201655 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ff18e-08c0-42e2-abc6-792e427699ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:41.201950 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ff18e-08c0-42e2-abc6-792e427699ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:41.213094 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ff18e-08c0-42e2-abc6-792e427699ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:41.214664 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ff18e-08c0-42e2-abc6-792e427699ef service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:41.224423 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1134/2227] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:41.573656 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe0da5-5d0a-4720-b2fe-f7c3e416a728 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:41.575136 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-1efe0da5-5d0a-4720-b2fe-f7c3e416a728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:41.588042 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe0da5-5d0a-4720-b2fe-f7c3e416a728 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:41.593653 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e80015-cbaa-458d-b7da-0187b969b380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:41.594285 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e80015-cbaa-458d-b7da-0187b969b380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:41.594558 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e80015-cbaa-458d-b7da-0187b969b380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:41.594824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e80015-cbaa-458d-b7da-0187b969b380 admin admin] PATH_INFO: `/v3/projects/73e9bfe0bb26448eb7ee095e843875ee` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:41.597365 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e80015-cbaa-458d-b7da-0187b969b380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73e9bfe0bb26448eb7ee095e843875ee)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:41.600336 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e80015-cbaa-458d-b7da-0187b969b380 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:41.653422 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-44e80015-cbaa-458d-b7da-0187b969b380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73e9bfe0bb26448eb7ee095e843875ee', 'request_id': 'req-44e80015-cbaa-458d-b7da-0187b969b380'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:41.659041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-44e80015-cbaa-458d-b7da-0187b969b380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73e9bfe0bb26448eb7ee095e843875ee', 'request_id': 'req-44e80015-cbaa-458d-b7da-0187b969b380'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:41.666717 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-44e80015-cbaa-458d-b7da-0187b969b380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73e9bfe0bb26448eb7ee095e843875ee', 'request_id': 'req-44e80015-cbaa-458d-b7da-0187b969b380'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:41.678949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-44e80015-cbaa-458d-b7da-0187b969b380 admin admin] The token cache is being invalidate because project 73e9bfe0bb26448eb7ee095e843875ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:16:41.679237 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-44e80015-cbaa-458d-b7da-0187b969b380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:41.679918 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-44e80015-cbaa-458d-b7da-0187b969b380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:41.681414 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1094/2228] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:16:41 2022] DELETE /identity/v3/projects/73e9bfe0bb26448eb7ee095e843875ee => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:41.685460 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ff18e-08c0-42e2-abc6-792e427699ef service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:41.695091 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ff18e-08c0-42e2-abc6-792e427699ef service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:41.714930 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:41.761718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a89d9-8c6a-4348-a1fa-57ae5a7437b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:41.762344 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a89d9-8c6a-4348-a1fa-57ae5a7437b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:41.762619 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a89d9-8c6a-4348-a1fa-57ae5a7437b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:41.762886 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a89d9-8c6a-4348-a1fa-57ae5a7437b7 admin admin] PATH_INFO: `/v3/users/43987a818aa647258b72b14f1768eb16` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:41.764009 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a89d9-8c6a-4348-a1fa-57ae5a7437b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43987a818aa647258b72b14f1768eb16)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:41.765893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a89d9-8c6a-4348-a1fa-57ae5a7437b7 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:41.812989 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-fa3a89d9-8c6a-4348-a1fa-57ae5a7437b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43987a818aa647258b72b14f1768eb16'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:41.813642 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-fa3a89d9-8c6a-4348-a1fa-57ae5a7437b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43987a818aa647258b72b14f1768eb16'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:41.820858 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-fa3a89d9-8c6a-4348-a1fa-57ae5a7437b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43987a818aa647258b72b14f1768eb16'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:41.827843 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-fa3a89d9-8c6a-4348-a1fa-57ae5a7437b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43987a818aa647258b72b14f1768eb16'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:41.828456 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-fa3a89d9-8c6a-4348-a1fa-57ae5a7437b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43987a818aa647258b72b14f1768eb16'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:41.846397 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1135/2229] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:16:41 2022] DELETE /identity/v3/users/43987a818aa647258b72b14f1768eb16 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:42.122003 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e80015-cbaa-458d-b7da-0187b969b380 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:42.123511 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-44e80015-cbaa-458d-b7da-0187b969b380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:42.136440 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e80015-cbaa-458d-b7da-0187b969b380 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:42.195633 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdd193-3d45-4c66-a6dd-649d19913a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:42.196429 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdd193-3d45-4c66-a6dd-649d19913a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:42.196619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdd193-3d45-4c66-a6dd-649d19913a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:42.197281 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdd193-3d45-4c66-a6dd-649d19913a9c admin admin] PATH_INFO: `/v3/projects/305a607d00154d69a337b6be23920539` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:42.198038 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babdd193-3d45-4c66-a6dd-649d19913a9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=305a607d00154d69a337b6be23920539)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:42.200227 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babdd193-3d45-4c66-a6dd-649d19913a9c admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:42.231861 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:42.253135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-babdd193-3d45-4c66-a6dd-649d19913a9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '305a607d00154d69a337b6be23920539', 'request_id': 'req-babdd193-3d45-4c66-a6dd-649d19913a9c'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:42.259487 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-babdd193-3d45-4c66-a6dd-649d19913a9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '305a607d00154d69a337b6be23920539', 'request_id': 'req-babdd193-3d45-4c66-a6dd-649d19913a9c'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:42.268067 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-babdd193-3d45-4c66-a6dd-649d19913a9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '305a607d00154d69a337b6be23920539', 'request_id': 'req-babdd193-3d45-4c66-a6dd-649d19913a9c'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:42.280387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-babdd193-3d45-4c66-a6dd-649d19913a9c admin admin] The token cache is being invalidate because project 305a607d00154d69a337b6be23920539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:16:42.280676 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-babdd193-3d45-4c66-a6dd-649d19913a9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:42.281317 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-babdd193-3d45-4c66-a6dd-649d19913a9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:42.282812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1095/2230] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:16:42 2022] DELETE /identity/v3/projects/305a607d00154d69a337b6be23920539 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:42.287685 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bccd7c-e90d-4af4-b483-7acdd906ed89 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:42.288194 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bccd7c-e90d-4af4-b483-7acdd906ed89 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:42.288377 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bccd7c-e90d-4af4-b483-7acdd906ed89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:42.313871 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-75bccd7c-e90d-4af4-b483-7acdd906ed89 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:42.315078 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-75bccd7c-e90d-4af4-b483-7acdd906ed89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:42.374772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1136/2231] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:16:42.382555 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c0244-b27a-4410-9369-e8d0e3afcdc0 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:42.382841 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c0244-b27a-4410-9369-e8d0e3afcdc0 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:42.383119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c0244-b27a-4410-9369-e8d0e3afcdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:42.403991 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-757c0244-b27a-4410-9369-e8d0e3afcdc0 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:42.405299 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-757c0244-b27a-4410-9369-e8d0e3afcdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:42.414187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1096/2232] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:42.418546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bccd7c-e90d-4af4-b483-7acdd906ed89 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:42.428966 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bccd7c-e90d-4af4-b483-7acdd906ed89 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:42.436978 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0908ab-704c-4342-9241-576186cba5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:42.437593 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0908ab-704c-4342-9241-576186cba5ea admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:42.437868 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0908ab-704c-4342-9241-576186cba5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:42.438247 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0908ab-704c-4342-9241-576186cba5ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:42.438855 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0908ab-704c-4342-9241-576186cba5ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:16:42.439210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0908ab-704c-4342-9241-576186cba5ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:42.440817 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0908ab-704c-4342-9241-576186cba5ea admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:42.457435 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1137/2233] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:16:42.458435 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c0244-b27a-4410-9369-e8d0e3afcdc0 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:42.467753 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c0244-b27a-4410-9369-e8d0e3afcdc0 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:42.472737 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f313c-dc3a-4dd8-a6ef-0f95b5656bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:42.473332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f313c-dc3a-4dd8-a6ef-0f95b5656bcc admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:42.473612 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f313c-dc3a-4dd8-a6ef-0f95b5656bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:42.473881 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f313c-dc3a-4dd8-a6ef-0f95b5656bcc admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:42.474543 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f313c-dc3a-4dd8-a6ef-0f95b5656bcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:42.476466 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f313c-dc3a-4dd8-a6ef-0f95b5656bcc admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:42.505413 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1097/2234] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:16:42 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:16:42.509656 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0908ab-704c-4342-9241-576186cba5ea admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:42.522215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0908ab-704c-4342-9241-576186cba5ea admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:42.549741 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:42.582889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499528c-ff81-4e56-8b2b-016e44fb5981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:42.583189 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499528c-ff81-4e56-8b2b-016e44fb5981 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:42.583562 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499528c-ff81-4e56-8b2b-016e44fb5981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:42.583899 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499528c-ff81-4e56-8b2b-016e44fb5981 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:42.584616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499528c-ff81-4e56-8b2b-016e44fb5981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:42.586653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499528c-ff81-4e56-8b2b-016e44fb5981 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:42.612135 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1138/2235] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:16:42 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:16:42.617289 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f313c-dc3a-4dd8-a6ef-0f95b5656bcc admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:42.630209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f313c-dc3a-4dd8-a6ef-0f95b5656bcc admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:42.638045 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc678e2b-6646-4340-9666-87b21047bd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:42.639723 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc678e2b-6646-4340-9666-87b21047bd0f admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:42.640079 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc678e2b-6646-4340-9666-87b21047bd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:42.640289 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc678e2b-6646-4340-9666-87b21047bd0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:42.640953 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc678e2b-6646-4340-9666-87b21047bd0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:42.642721 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc678e2b-6646-4340-9666-87b21047bd0f admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:42.658145 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1098/2236] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:16:42.662090 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499528c-ff81-4e56-8b2b-016e44fb5981 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:42.672929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499528c-ff81-4e56-8b2b-016e44fb5981 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:42.677798 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cea245-0fd6-4996-93d5-df725fd1c668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:42.678571 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cea245-0fd6-4996-93d5-df725fd1c668 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:42.678848 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cea245-0fd6-4996-93d5-df725fd1c668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:42.679119 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cea245-0fd6-4996-93d5-df725fd1c668 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:42.679807 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cea245-0fd6-4996-93d5-df725fd1c668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:42.681391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cea245-0fd6-4996-93d5-df725fd1c668 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:42.692770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1139/2237] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:16:42.696941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc678e2b-6646-4340-9666-87b21047bd0f admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:42.708080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc678e2b-6646-4340-9666-87b21047bd0f admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:42.713044 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca53000-d459-4872-a7ee-9c2f49ebdc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:42.713758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca53000-d459-4872-a7ee-9c2f49ebdc63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:42.714038 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca53000-d459-4872-a7ee-9c2f49ebdc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:42.714338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca53000-d459-4872-a7ee-9c2f49ebdc63 admin admin] PATH_INFO: `/v3/projects/dc94aaa6ed9f4996beb79bdf7f779556/users/af3585059aa14527b6db64bb0e90e00b/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:42.729930 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca53000-d459-4872-a7ee-9c2f49ebdc63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc94aaa6ed9f4996beb79bdf7f779556, user_id=af3585059aa14527b6db64bb0e90e00b, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:42.732589 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca53000-d459-4872-a7ee-9c2f49ebdc63 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:42.747345 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1099/2238] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:16:42 2022] PUT /identity/v3/projects/dc94aaa6ed9f4996beb79bdf7f779556/users/af3585059aa14527b6db64bb0e90e00b/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:42.758760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb11e5-3129-4f8f-8ec3-427a574511a4 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:42.759114 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb11e5-3129-4f8f-8ec3-427a574511a4 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:42.759382 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb11e5-3129-4f8f-8ec3-427a574511a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:42.793020 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-fafb11e5-3129-4f8f-8ec3-427a574511a4 None None] MFA Rules not processed for user `af3585059aa14527b6db64bb0e90e00b`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:42.795079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-fafb11e5-3129-4f8f-8ec3-427a574511a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:42.878558 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1140/2239] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:42.883084 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca53000-d459-4872-a7ee-9c2f49ebdc63 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:42.947478 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca53000-d459-4872-a7ee-9c2f49ebdc63 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:42.952857 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572b150-43a2-4d5e-b37c-e14f5a1fecb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:42.953461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572b150-43a2-4d5e-b37c-e14f5a1fecb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:42.953738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572b150-43a2-4d5e-b37c-e14f5a1fecb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:42.954005 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572b150-43a2-4d5e-b37c-e14f5a1fecb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:42.954711 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572b150-43a2-4d5e-b37c-e14f5a1fecb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:42.956548 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572b150-43a2-4d5e-b37c-e14f5a1fecb7 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:42.984855 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1100/2240] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:16:42 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:16:42.989101 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb11e5-3129-4f8f-8ec3-427a574511a4 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:43.001092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb11e5-3129-4f8f-8ec3-427a574511a4 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:43.068646 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8fb10-f1b7-4324-96b9-1803d69adb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:43.069256 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8fb10-f1b7-4324-96b9-1803d69adb11 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:43.069535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8fb10-f1b7-4324-96b9-1803d69adb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:43.069807 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8fb10-f1b7-4324-96b9-1803d69adb11 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:43.070458 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8fb10-f1b7-4324-96b9-1803d69adb11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:43.072396 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8fb10-f1b7-4324-96b9-1803d69adb11 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:43.093510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1141/2241] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:16:42 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:16:43.097574 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572b150-43a2-4d5e-b37c-e14f5a1fecb7 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:43.108058 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572b150-43a2-4d5e-b37c-e14f5a1fecb7 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:43.112595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab5fff-0859-45b8-9304-441ed777c38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:43.113192 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab5fff-0859-45b8-9304-441ed777c38f admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:43.113473 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab5fff-0859-45b8-9304-441ed777c38f admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:43.113746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab5fff-0859-45b8-9304-441ed777c38f admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:43.114387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab5fff-0859-45b8-9304-441ed777c38f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:43.116062 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab5fff-0859-45b8-9304-441ed777c38f admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:43.127191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1101/2242] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:16:43.131138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8fb10-f1b7-4324-96b9-1803d69adb11 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:43.141438 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8fb10-f1b7-4324-96b9-1803d69adb11 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:43.145972 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71719e5-e7f5-4a2e-9de8-7249783444f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:43.146610 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71719e5-e7f5-4a2e-9de8-7249783444f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:43.146888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71719e5-e7f5-4a2e-9de8-7249783444f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:43.147158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71719e5-e7f5-4a2e-9de8-7249783444f4 admin admin] PATH_INFO: `/v3/projects/f0b744315dc643c9b05707bea3fed6b6/users/7f924486d1a04664940bb9d4549593ec/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:43.161614 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71719e5-e7f5-4a2e-9de8-7249783444f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b744315dc643c9b05707bea3fed6b6, user_id=7f924486d1a04664940bb9d4549593ec, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:43.164289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71719e5-e7f5-4a2e-9de8-7249783444f4 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:43.177081 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1142/2243] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:16:43 2022] PUT /identity/v3/projects/f0b744315dc643c9b05707bea3fed6b6/users/7f924486d1a04664940bb9d4549593ec/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:43.180895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab5fff-0859-45b8-9304-441ed777c38f admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:43.191123 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab5fff-0859-45b8-9304-441ed777c38f admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:43.211654 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:43.250010 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0e499-be24-4310-a249-dca8b7affbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:43.250548 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0e499-be24-4310-a249-dca8b7affbca admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:43.250827 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0e499-be24-4310-a249-dca8b7affbca admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:43.251098 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0e499-be24-4310-a249-dca8b7affbca admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:43.251764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0e499-be24-4310-a249-dca8b7affbca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:43.253371 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0e499-be24-4310-a249-dca8b7affbca admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:43.263340 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1102/2244] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:16:43.267581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71719e5-e7f5-4a2e-9de8-7249783444f4 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:43.272951 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:43.279601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71719e5-e7f5-4a2e-9de8-7249783444f4 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:43.284471 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5d602-ccb9-4728-9476-4cb7a3add85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:43.285116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5d602-ccb9-4728-9476-4cb7a3add85f admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:43.285395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5d602-ccb9-4728-9476-4cb7a3add85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:43.285669 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5d602-ccb9-4728-9476-4cb7a3add85f admin admin] PATH_INFO: `/v3/projects/f0b744315dc643c9b05707bea3fed6b6/users/7f924486d1a04664940bb9d4549593ec/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:43.287593 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5d602-ccb9-4728-9476-4cb7a3add85f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b744315dc643c9b05707bea3fed6b6, user_id=7f924486d1a04664940bb9d4549593ec, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:43.290194 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5d602-ccb9-4728-9476-4cb7a3add85f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:43.300316 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1143/2245] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:16:43 2022] PUT /identity/v3/projects/f0b744315dc643c9b05707bea3fed6b6/users/7f924486d1a04664940bb9d4549593ec/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:43.311812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6f2b2-4c2e-4303-9b38-f7ae05f7a4f8 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:43.312103 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6f2b2-4c2e-4303-9b38-f7ae05f7a4f8 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:43.312378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6f2b2-4c2e-4303-9b38-f7ae05f7a4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:43.340887 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-d0e6f2b2-4c2e-4303-9b38-f7ae05f7a4f8 None None] MFA Rules not processed for user `7f924486d1a04664940bb9d4549593ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:43.342103 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-d0e6f2b2-4c2e-4303-9b38-f7ae05f7a4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:43.410144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1103/2246] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:43.422160 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5d602-ccb9-4728-9476-4cb7a3add85f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:43.424037 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-23d5d602-ccb9-4728-9476-4cb7a3add85f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:43.481700 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5d602-ccb9-4728-9476-4cb7a3add85f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:43.485319 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a1eee-de6a-4432-ae04-cded002f8f62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:43.485914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a1eee-de6a-4432-ae04-cded002f8f62 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:43.486188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a1eee-de6a-4432-ae04-cded002f8f62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:43.486457 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a1eee-de6a-4432-ae04-cded002f8f62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:43.495553 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a1eee-de6a-4432-ae04-cded002f8f62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:43.496965 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a1eee-de6a-4432-ae04-cded002f8f62 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:43.506297 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1144/2247] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:43.579378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6f2b2-4c2e-4303-9b38-f7ae05f7a4f8 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:43.588874 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6f2b2-4c2e-4303-9b38-f7ae05f7a4f8 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:43.592552 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f20f0-a8e3-4498-b345-f8d42760cc7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:43.593148 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f20f0-a8e3-4498-b345-f8d42760cc7a service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:43.593428 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f20f0-a8e3-4498-b345-f8d42760cc7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:43.593698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f20f0-a8e3-4498-b345-f8d42760cc7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:43.650277 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f20f0-a8e3-4498-b345-f8d42760cc7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:43.651772 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f20f0-a8e3-4498-b345-f8d42760cc7a service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:43.660537 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1104/2248] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:46.966367 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edf138-24d1-4149-8e41-6e18930d3f4c None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:46.966843 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edf138-24d1-4149-8e41-6e18930d3f4c None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:46.966936 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edf138-24d1-4149-8e41-6e18930d3f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:46.986515 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-65edf138-24d1-4149-8e41-6e18930d3f4c None None] MFA Rules not processed for user `c0e57ea982d349c1a86b544e9a6e7758`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:46.987761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-65edf138-24d1-4149-8e41-6e18930d3f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:47.042793 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1145/2249] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 28 12:16:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:47.054813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f20f0-a8e3-4498-b345-f8d42760cc7a service cinder] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:47.056494 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b88f20f0-a8e3-4498-b345-f8d42760cc7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:47.103621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:47.128498 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f20f0-a8e3-4498-b345-f8d42760cc7a service cinder] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:47.134410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090238f-b214-47f5-80cc-02fd07b8eced service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '822e394e80fd41adb54d330adaf65a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:47.135037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090238f-b214-47f5-80cc-02fd07b8eced service swift] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:47.136199 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090238f-b214-47f5-80cc-02fd07b8eced service swift] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:47.136199 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090238f-b214-47f5-80cc-02fd07b8eced service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:47.144677 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090238f-b214-47f5-80cc-02fd07b8eced service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:47.146279 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090238f-b214-47f5-80cc-02fd07b8eced service swift] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:47.155153 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1105/2250] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 28 12:16:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 12:16:50.875329 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65edf138-24d1-4149-8e41-6e18930d3f4c None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:50.950675 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65edf138-24d1-4149-8e41-6e18930d3f4c None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:50.955384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c35c6-2c3d-4295-8945-27fdf4f786e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:50.956094 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c35c6-2c3d-4295-8945-27fdf4f786e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:50.956336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c35c6-2c3d-4295-8945-27fdf4f786e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:50.956708 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c35c6-2c3d-4295-8945-27fdf4f786e1 admin admin] PATH_INFO: `/v3/users/af3585059aa14527b6db64bb0e90e00b` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:50.958032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c35c6-2c3d-4295-8945-27fdf4f786e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af3585059aa14527b6db64bb0e90e00b)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:50.960826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c35c6-2c3d-4295-8945-27fdf4f786e1 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:51.010897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:51.018649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-263c35c6-2c3d-4295-8945-27fdf4f786e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af3585059aa14527b6db64bb0e90e00b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:51.019496 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-263c35c6-2c3d-4295-8945-27fdf4f786e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af3585059aa14527b6db64bb0e90e00b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:51.032094 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-263c35c6-2c3d-4295-8945-27fdf4f786e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af3585059aa14527b6db64bb0e90e00b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:51.040683 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-263c35c6-2c3d-4295-8945-27fdf4f786e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af3585059aa14527b6db64bb0e90e00b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:51.041340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-263c35c6-2c3d-4295-8945-27fdf4f786e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af3585059aa14527b6db64bb0e90e00b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:51.062052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1146/2251] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:16:50 2022] DELETE /identity/v3/users/af3585059aa14527b6db64bb0e90e00b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:51.067569 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167997a-f9d8-4cf4-883a-9b0292cad1a5 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:51.068113 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167997a-f9d8-4cf4-883a-9b0292cad1a5 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:51.068113 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167997a-f9d8-4cf4-883a-9b0292cad1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:51.089366 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-6167997a-f9d8-4cf4-883a-9b0292cad1a5 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:51.090761 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-6167997a-f9d8-4cf4-883a-9b0292cad1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:51.162359 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1106/2252] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:51.172453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c35c6-2c3d-4295-8945-27fdf4f786e1 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:51.174008 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-263c35c6-2c3d-4295-8945-27fdf4f786e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:51.265427 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c35c6-2c3d-4295-8945-27fdf4f786e1 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:51.270180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68acdea-1674-4724-a949-303474ac3298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:51.270604 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68acdea-1674-4724-a949-303474ac3298 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:51.271013 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68acdea-1674-4724-a949-303474ac3298 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:51.271586 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68acdea-1674-4724-a949-303474ac3298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:51.283926 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68acdea-1674-4724-a949-303474ac3298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:51.285528 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68acdea-1674-4724-a949-303474ac3298 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:51.296802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1147/2253] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:16:51.807940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167997a-f9d8-4cf4-883a-9b0292cad1a5 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:51.807940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-6167997a-f9d8-4cf4-883a-9b0292cad1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:51.856837 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167997a-f9d8-4cf4-883a-9b0292cad1a5 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:51.880872 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cf4b9-3ef7-4acd-a7c0-8a525df672e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:51.881683 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cf4b9-3ef7-4acd-a7c0-8a525df672e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:51.882059 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cf4b9-3ef7-4acd-a7c0-8a525df672e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:51.882456 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cf4b9-3ef7-4acd-a7c0-8a525df672e9 admin admin] PATH_INFO: `/v3/projects/dc94aaa6ed9f4996beb79bdf7f779556` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:51.883779 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cf4b9-3ef7-4acd-a7c0-8a525df672e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc94aaa6ed9f4996beb79bdf7f779556)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:51.885856 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cf4b9-3ef7-4acd-a7c0-8a525df672e9 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:51.980985 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c19cf4b9-3ef7-4acd-a7c0-8a525df672e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc94aaa6ed9f4996beb79bdf7f779556', 'request_id': 'req-c19cf4b9-3ef7-4acd-a7c0-8a525df672e9'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:51.990048 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c19cf4b9-3ef7-4acd-a7c0-8a525df672e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc94aaa6ed9f4996beb79bdf7f779556', 'request_id': 'req-c19cf4b9-3ef7-4acd-a7c0-8a525df672e9'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:52.015165 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c19cf4b9-3ef7-4acd-a7c0-8a525df672e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc94aaa6ed9f4996beb79bdf7f779556', 'request_id': 'req-c19cf4b9-3ef7-4acd-a7c0-8a525df672e9'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:52.034155 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c19cf4b9-3ef7-4acd-a7c0-8a525df672e9 admin admin] The token cache is being invalidate because project dc94aaa6ed9f4996beb79bdf7f779556 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:16:52.035890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c19cf4b9-3ef7-4acd-a7c0-8a525df672e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:52.036598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c19cf4b9-3ef7-4acd-a7c0-8a525df672e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:52.038593 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1107/2254] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:16:51 2022] DELETE /identity/v3/projects/dc94aaa6ed9f4996beb79bdf7f779556 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:52.044039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68acdea-1674-4724-a949-303474ac3298 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:52.055305 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68acdea-1674-4724-a949-303474ac3298 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:52.142983 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6dca21-d9fa-4126-b818-d1f0bbdfb4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:52.144015 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dca21-d9fa-4126-b818-d1f0bbdfb4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:52.144480 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dca21-d9fa-4126-b818-d1f0bbdfb4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:52.144927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dca21-d9fa-4126-b818-d1f0bbdfb4a0 admin admin] PATH_INFO: `/v3/users/7f924486d1a04664940bb9d4549593ec` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:52.147402 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6dca21-d9fa-4126-b818-d1f0bbdfb4a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f924486d1a04664940bb9d4549593ec)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:52.150462 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6dca21-d9fa-4126-b818-d1f0bbdfb4a0 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:52.207638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-4c6dca21-d9fa-4126-b818-d1f0bbdfb4a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f924486d1a04664940bb9d4549593ec'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:52.208619 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-4c6dca21-d9fa-4126-b818-d1f0bbdfb4a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f924486d1a04664940bb9d4549593ec'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:52.216724 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-4c6dca21-d9fa-4126-b818-d1f0bbdfb4a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f924486d1a04664940bb9d4549593ec'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:52.220937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:52.231262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-4c6dca21-d9fa-4126-b818-d1f0bbdfb4a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f924486d1a04664940bb9d4549593ec'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:52.232716 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-4c6dca21-d9fa-4126-b818-d1f0bbdfb4a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f924486d1a04664940bb9d4549593ec'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:52.258798 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1148/2255] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:16:52 2022] DELETE /identity/v3/users/7f924486d1a04664940bb9d4549593ec => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:52.590531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cf4b9-3ef7-4acd-a7c0-8a525df672e9 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:52.592992 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-c19cf4b9-3ef7-4acd-a7c0-8a525df672e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:52.630664 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cf4b9-3ef7-4acd-a7c0-8a525df672e9 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:52.691940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:52.703885 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05e7b0-f6e0-46b2-98ad-c5ab16aefd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:52.708439 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05e7b0-f6e0-46b2-98ad-c5ab16aefd63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:52.708857 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05e7b0-f6e0-46b2-98ad-c5ab16aefd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:52.709183 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05e7b0-f6e0-46b2-98ad-c5ab16aefd63 admin admin] PATH_INFO: `/v3/projects/f0b744315dc643c9b05707bea3fed6b6` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:52.710693 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05e7b0-f6e0-46b2-98ad-c5ab16aefd63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0b744315dc643c9b05707bea3fed6b6)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:52.712948 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05e7b0-f6e0-46b2-98ad-c5ab16aefd63 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:52.775229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-5d05e7b0-f6e0-46b2-98ad-c5ab16aefd63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0b744315dc643c9b05707bea3fed6b6', 'request_id': 'req-5d05e7b0-f6e0-46b2-98ad-c5ab16aefd63'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:52.783398 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-5d05e7b0-f6e0-46b2-98ad-c5ab16aefd63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0b744315dc643c9b05707bea3fed6b6', 'request_id': 'req-5d05e7b0-f6e0-46b2-98ad-c5ab16aefd63'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:52.792676 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-5d05e7b0-f6e0-46b2-98ad-c5ab16aefd63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0b744315dc643c9b05707bea3fed6b6', 'request_id': 'req-5d05e7b0-f6e0-46b2-98ad-c5ab16aefd63'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:52.833458 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-5d05e7b0-f6e0-46b2-98ad-c5ab16aefd63 admin admin] The token cache is being invalidate because project f0b744315dc643c9b05707bea3fed6b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:16:52.833752 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-5d05e7b0-f6e0-46b2-98ad-c5ab16aefd63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:52.837854 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-5d05e7b0-f6e0-46b2-98ad-c5ab16aefd63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:52.840300 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1108/2256] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:16:52 2022] DELETE /identity/v3/projects/f0b744315dc643c9b05707bea3fed6b6 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:52.846383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1833d9-f09b-420b-bb52-64852ddf8019 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:52.846900 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1833d9-f09b-420b-bb52-64852ddf8019 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:52.847283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1833d9-f09b-420b-bb52-64852ddf8019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:52.869661 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-1d1833d9-f09b-420b-bb52-64852ddf8019 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:52.871145 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-1d1833d9-f09b-420b-bb52-64852ddf8019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:52.978668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1149/2257] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:52.986881 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bdeda-3cc2-46fc-a2c4-8e9c00872ba0 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:52.986997 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bdeda-3cc2-46fc-a2c4-8e9c00872ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:52.987225 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bdeda-3cc2-46fc-a2c4-8e9c00872ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:53.007587 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-bd7bdeda-3cc2-46fc-a2c4-8e9c00872ba0 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:53.008807 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-bd7bdeda-3cc2-46fc-a2c4-8e9c00872ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:53.021833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1109/2258] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:53.028257 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1833d9-f09b-420b-bb52-64852ddf8019 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:53.043829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1833d9-f09b-420b-bb52-64852ddf8019 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:53.050201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08468006-2284-45ea-ab72-2a8659af4dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:53.050845 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08468006-2284-45ea-ab72-2a8659af4dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:53.051094 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08468006-2284-45ea-ab72-2a8659af4dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:53.051719 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08468006-2284-45ea-ab72-2a8659af4dc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:53.052558 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08468006-2284-45ea-ab72-2a8659af4dc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:16:53.053032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08468006-2284-45ea-ab72-2a8659af4dc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:53.054809 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08468006-2284-45ea-ab72-2a8659af4dc7 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:53.080353 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bdeda-3cc2-46fc-a2c4-8e9c00872ba0 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:53.101096 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1150/2259] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:16:53.107664 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bdeda-3cc2-46fc-a2c4-8e9c00872ba0 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:53.112875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3c2d7-ea9e-4bbd-b98b-1ccf5671536d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:53.113703 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3c2d7-ea9e-4bbd-b98b-1ccf5671536d admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:53.114147 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3c2d7-ea9e-4bbd-b98b-1ccf5671536d admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:53.114584 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3c2d7-ea9e-4bbd-b98b-1ccf5671536d admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:53.115373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3c2d7-ea9e-4bbd-b98b-1ccf5671536d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:53.117758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3c2d7-ea9e-4bbd-b98b-1ccf5671536d admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:53.165375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1110/2260] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:16:53 2022] POST /identity/v3/projects => generated 367 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:16:53.165981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08468006-2284-45ea-ab72-2a8659af4dc7 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:53.178900 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08468006-2284-45ea-ab72-2a8659af4dc7 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:53.260922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074e658-3059-4fc6-a27c-73a4b36077cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:53.261718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074e658-3059-4fc6-a27c-73a4b36077cd admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:53.262067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074e658-3059-4fc6-a27c-73a4b36077cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:53.262416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074e658-3059-4fc6-a27c-73a4b36077cd admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:53.263211 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8074e658-3059-4fc6-a27c-73a4b36077cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:53.265278 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8074e658-3059-4fc6-a27c-73a4b36077cd admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:53.299625 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1151/2261] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:16:53 2022] POST /identity/v3/users => generated 284 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:16:53.305598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3c2d7-ea9e-4bbd-b98b-1ccf5671536d admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:53.316610 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3c2d7-ea9e-4bbd-b98b-1ccf5671536d admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:53.327118 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042c1fe-4556-462e-9b53-f3743f422e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:53.327785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042c1fe-4556-462e-9b53-f3743f422e74 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:53.328069 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042c1fe-4556-462e-9b53-f3743f422e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:53.328369 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042c1fe-4556-462e-9b53-f3743f422e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:53.329029 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042c1fe-4556-462e-9b53-f3743f422e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:53.330659 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042c1fe-4556-462e-9b53-f3743f422e74 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:53.341934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1111/2262] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:16:53.346145 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074e658-3059-4fc6-a27c-73a4b36077cd admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:53.357579 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074e658-3059-4fc6-a27c-73a4b36077cd admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:53.373916 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55848865-4bc6-4a22-a94d-1ff4f061cc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:53.375334 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55848865-4bc6-4a22-a94d-1ff4f061cc1c admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:53.375334 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55848865-4bc6-4a22-a94d-1ff4f061cc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:53.375334 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55848865-4bc6-4a22-a94d-1ff4f061cc1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:53.379559 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55848865-4bc6-4a22-a94d-1ff4f061cc1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:53.381790 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55848865-4bc6-4a22-a94d-1ff4f061cc1c admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:53.399547 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1152/2263] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:16:53.399757 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042c1fe-4556-462e-9b53-f3743f422e74 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:53.437180 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042c1fe-4556-462e-9b53-f3743f422e74 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:53.442272 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b66677-4024-487b-b430-45f6ed6cdfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:53.452291 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b66677-4024-487b-b430-45f6ed6cdfe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:53.452691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b66677-4024-487b-b430-45f6ed6cdfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:53.452822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b66677-4024-487b-b430-45f6ed6cdfe9 admin admin] PATH_INFO: `/v3/projects/e2a6c7c1c5fa4e328cbf89fbe13c5cb9/users/793ff4cb04c24f81b61056bb2dcb4959/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:53.486366 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b66677-4024-487b-b430-45f6ed6cdfe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2a6c7c1c5fa4e328cbf89fbe13c5cb9, user_id=793ff4cb04c24f81b61056bb2dcb4959, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:53.489417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b66677-4024-487b-b430-45f6ed6cdfe9 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:53.517754 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1112/2264] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:16:53 2022] PUT /identity/v3/projects/e2a6c7c1c5fa4e328cbf89fbe13c5cb9/users/793ff4cb04c24f81b61056bb2dcb4959/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:53.536605 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3cc4a-deea-4bc4-bd15-57802f0187d3 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:53.536605 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3cc4a-deea-4bc4-bd15-57802f0187d3 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:53.536605 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3cc4a-deea-4bc4-bd15-57802f0187d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:53.582484 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-4cf3cc4a-deea-4bc4-bd15-57802f0187d3 None None] MFA Rules not processed for user `793ff4cb04c24f81b61056bb2dcb4959`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:53.582484 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-4cf3cc4a-deea-4bc4-bd15-57802f0187d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:53.622956 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:53.666690 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b66677-4024-487b-b430-45f6ed6cdfe9 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:53.671990 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1153/2265] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:53.778616 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b66677-4024-487b-b430-45f6ed6cdfe9 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:53.783820 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb08ae9-e4c3-4d25-9b3e-7815f4310e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:53.784637 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb08ae9-e4c3-4d25-9b3e-7815f4310e62 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:53.784764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb08ae9-e4c3-4d25-9b3e-7815f4310e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:53.784971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb08ae9-e4c3-4d25-9b3e-7815f4310e62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:53.785605 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb08ae9-e4c3-4d25-9b3e-7815f4310e62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:53.787992 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb08ae9-e4c3-4d25-9b3e-7815f4310e62 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:53.843619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1113/2266] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:16:53 2022] POST /identity/v3/projects => generated 369 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:16:53.848003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3cc4a-deea-4bc4-bd15-57802f0187d3 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:53.887905 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3cc4a-deea-4bc4-bd15-57802f0187d3 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:54.009931 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3ab5e-5e8e-4bf4-bd4d-94aea70afdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:54.010585 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3ab5e-5e8e-4bf4-bd4d-94aea70afdfe admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:54.010937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3ab5e-5e8e-4bf4-bd4d-94aea70afdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:54.011209 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3ab5e-5e8e-4bf4-bd4d-94aea70afdfe admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:54.011888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3ab5e-5e8e-4bf4-bd4d-94aea70afdfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:54.013967 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3ab5e-5e8e-4bf4-bd4d-94aea70afdfe admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:54.048385 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1154/2267] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:16:53 2022] POST /identity/v3/users => generated 291 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:16:54.049948 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb08ae9-e4c3-4d25-9b3e-7815f4310e62 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:54.063306 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb08ae9-e4c3-4d25-9b3e-7815f4310e62 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:54.074875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713f221-3687-4896-9183-f6d61e854349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:54.075784 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713f221-3687-4896-9183-f6d61e854349 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:54.076239 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713f221-3687-4896-9183-f6d61e854349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:54.076783 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713f221-3687-4896-9183-f6d61e854349 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:54.077618 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713f221-3687-4896-9183-f6d61e854349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:54.079539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713f221-3687-4896-9183-f6d61e854349 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:54.082117 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:54.097266 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1114/2268] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:16:54.099945 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3ab5e-5e8e-4bf4-bd4d-94aea70afdfe admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:54.118321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3ab5e-5e8e-4bf4-bd4d-94aea70afdfe admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:54.126624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252b315-8517-4ba6-af7a-7ede5f335733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:54.127634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252b315-8517-4ba6-af7a-7ede5f335733 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:54.128046 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252b315-8517-4ba6-af7a-7ede5f335733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:54.128325 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252b315-8517-4ba6-af7a-7ede5f335733 admin admin] PATH_INFO: `/v3/projects/520fcbc1ba8b46da83861bae00c82cb8/users/caf9f0e966064c7e99e98f5cc63f631b/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:54.156544 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252b315-8517-4ba6-af7a-7ede5f335733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=520fcbc1ba8b46da83861bae00c82cb8, user_id=caf9f0e966064c7e99e98f5cc63f631b, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:54.163654 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252b315-8517-4ba6-af7a-7ede5f335733 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:54.188895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713f221-3687-4896-9183-f6d61e854349 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:54.195300 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1155/2269] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:16:54 2022] PUT /identity/v3/projects/520fcbc1ba8b46da83861bae00c82cb8/users/caf9f0e966064c7e99e98f5cc63f631b/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:54.208540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713f221-3687-4896-9183-f6d61e854349 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:54.333893 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56245623-0d43-44cf-b6ac-1190ebab967e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:54.335320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56245623-0d43-44cf-b6ac-1190ebab967e admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:54.335320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56245623-0d43-44cf-b6ac-1190ebab967e admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:54.335320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56245623-0d43-44cf-b6ac-1190ebab967e admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:54.336246 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56245623-0d43-44cf-b6ac-1190ebab967e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:54.338053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56245623-0d43-44cf-b6ac-1190ebab967e admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:54.363145 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252b315-8517-4ba6-af7a-7ede5f335733 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:54.363889 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1115/2270] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:16:54.377066 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252b315-8517-4ba6-af7a-7ede5f335733 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:54.388308 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51c97a-ffa7-40c3-b39e-dc6e2ea612d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:54.388674 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51c97a-ffa7-40c3-b39e-dc6e2ea612d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:54.388765 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51c97a-ffa7-40c3-b39e-dc6e2ea612d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:54.389016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51c97a-ffa7-40c3-b39e-dc6e2ea612d3 admin admin] PATH_INFO: `/v3/projects/520fcbc1ba8b46da83861bae00c82cb8/users/caf9f0e966064c7e99e98f5cc63f631b/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:54.393513 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51c97a-ffa7-40c3-b39e-dc6e2ea612d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=520fcbc1ba8b46da83861bae00c82cb8, user_id=caf9f0e966064c7e99e98f5cc63f631b, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:54.396316 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51c97a-ffa7-40c3-b39e-dc6e2ea612d3 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:54.417828 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1156/2271] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:16:54 2022] PUT /identity/v3/projects/520fcbc1ba8b46da83861bae00c82cb8/users/caf9f0e966064c7e99e98f5cc63f631b/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:54.427421 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b8a22-e0b0-4eee-a46e-d8b10283aa67 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:54.427829 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b8a22-e0b0-4eee-a46e-d8b10283aa67 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:54.428175 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b8a22-e0b0-4eee-a46e-d8b10283aa67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:54.481262 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-043b8a22-e0b0-4eee-a46e-d8b10283aa67 None None] MFA Rules not processed for user `caf9f0e966064c7e99e98f5cc63f631b`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:54.482587 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-043b8a22-e0b0-4eee-a46e-d8b10283aa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:54.596984 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1116/2272] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:54.614516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51c97a-ffa7-40c3-b39e-dc6e2ea612d3 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:54.617070 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0e51c97a-ffa7-40c3-b39e-dc6e2ea612d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:54.737564 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51c97a-ffa7-40c3-b39e-dc6e2ea612d3 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:54.752335 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca73701d-fb3a-4a91-a15c-363a009f637e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:54.753444 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73701d-fb3a-4a91-a15c-363a009f637e service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:54.753735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73701d-fb3a-4a91-a15c-363a009f637e service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:54.754005 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73701d-fb3a-4a91-a15c-363a009f637e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:54.770373 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca73701d-fb3a-4a91-a15c-363a009f637e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:54.772470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca73701d-fb3a-4a91-a15c-363a009f637e service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:54.785720 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1157/2273] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:54 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:54.838695 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b8a22-e0b0-4eee-a46e-d8b10283aa67 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:54.840731 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-043b8a22-e0b0-4eee-a46e-d8b10283aa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:54.855023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b8a22-e0b0-4eee-a46e-d8b10283aa67 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:54.859658 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19131393-eea6-4a82-9ccc-859e8496d9bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:54.860464 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19131393-eea6-4a82-9ccc-859e8496d9bc service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:54.860890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19131393-eea6-4a82-9ccc-859e8496d9bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:54.861317 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19131393-eea6-4a82-9ccc-859e8496d9bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:55.008874 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19131393-eea6-4a82-9ccc-859e8496d9bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:55.010870 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19131393-eea6-4a82-9ccc-859e8496d9bc service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:55.021055 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1117/2274] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:58.985279 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca73701d-fb3a-4a91-a15c-363a009f637e service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:59.023376 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:59.066218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca73701d-fb3a-4a91-a15c-363a009f637e service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:59.071099 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd8147-448f-43b5-b700-05ac49e08961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:59.072734 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd8147-448f-43b5-b700-05ac49e08961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:59.073371 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd8147-448f-43b5-b700-05ac49e08961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:59.073926 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd8147-448f-43b5-b700-05ac49e08961 admin admin] PATH_INFO: `/v3/users/793ff4cb04c24f81b61056bb2dcb4959` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:59.076615 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd8147-448f-43b5-b700-05ac49e08961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=793ff4cb04c24f81b61056bb2dcb4959)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:59.079360 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd8147-448f-43b5-b700-05ac49e08961 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:59.139741 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8cdd8147-448f-43b5-b700-05ac49e08961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '793ff4cb04c24f81b61056bb2dcb4959'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:59.140419 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8cdd8147-448f-43b5-b700-05ac49e08961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '793ff4cb04c24f81b61056bb2dcb4959'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:59.147997 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8cdd8147-448f-43b5-b700-05ac49e08961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '793ff4cb04c24f81b61056bb2dcb4959'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:59.156607 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8cdd8147-448f-43b5-b700-05ac49e08961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '793ff4cb04c24f81b61056bb2dcb4959'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:59.157236 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8cdd8147-448f-43b5-b700-05ac49e08961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '793ff4cb04c24f81b61056bb2dcb4959'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:16:59.179037 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1158/2275] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:16:58 2022] DELETE /identity/v3/users/793ff4cb04c24f81b61056bb2dcb4959 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:16:59.184154 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2789add-e64f-4532-a856-c0c01440fa2c None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:59.184682 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2789add-e64f-4532-a856-c0c01440fa2c None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:59.184769 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2789add-e64f-4532-a856-c0c01440fa2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:59.209255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-e2789add-e64f-4532-a856-c0c01440fa2c None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:59.210776 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-e2789add-e64f-4532-a856-c0c01440fa2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:59.227728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:59.312092 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1118/2276] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:16:59.324500 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd8147-448f-43b5-b700-05ac49e08961 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:59.325988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8cdd8147-448f-43b5-b700-05ac49e08961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:59.413004 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd8147-448f-43b5-b700-05ac49e08961 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:59.419214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847b7b1-303c-44b4-b960-2c45f568dd56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:59.420279 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847b7b1-303c-44b4-b960-2c45f568dd56 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:59.420840 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847b7b1-303c-44b4-b960-2c45f568dd56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:59.423681 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847b7b1-303c-44b4-b960-2c45f568dd56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:59.438476 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847b7b1-303c-44b4-b960-2c45f568dd56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:59.440762 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847b7b1-303c-44b4-b960-2c45f568dd56 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:59.473529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1159/2277] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:17:00.137344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2789add-e64f-4532-a856-c0c01440fa2c None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:00.140605 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-e2789add-e64f-4532-a856-c0c01440fa2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:00.158847 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2789add-e64f-4532-a856-c0c01440fa2c None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:00.177461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cd0dd-0b26-462a-9e4c-7c282c260deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:00.178596 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cd0dd-0b26-462a-9e4c-7c282c260deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:00.178899 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cd0dd-0b26-462a-9e4c-7c282c260deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:00.179180 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cd0dd-0b26-462a-9e4c-7c282c260deb admin admin] PATH_INFO: `/v3/projects/e2a6c7c1c5fa4e328cbf89fbe13c5cb9` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:00.181372 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9cd0dd-0b26-462a-9e4c-7c282c260deb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2a6c7c1c5fa4e328cbf89fbe13c5cb9)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:00.196721 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9cd0dd-0b26-462a-9e4c-7c282c260deb admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:00.265053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-af9cd0dd-0b26-462a-9e4c-7c282c260deb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2a6c7c1c5fa4e328cbf89fbe13c5cb9', 'request_id': 'req-af9cd0dd-0b26-462a-9e4c-7c282c260deb'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:00.274446 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-af9cd0dd-0b26-462a-9e4c-7c282c260deb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2a6c7c1c5fa4e328cbf89fbe13c5cb9', 'request_id': 'req-af9cd0dd-0b26-462a-9e4c-7c282c260deb'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:00.295108 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-af9cd0dd-0b26-462a-9e4c-7c282c260deb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2a6c7c1c5fa4e328cbf89fbe13c5cb9', 'request_id': 'req-af9cd0dd-0b26-462a-9e4c-7c282c260deb'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:00.335187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-af9cd0dd-0b26-462a-9e4c-7c282c260deb admin admin] The token cache is being invalidate because project e2a6c7c1c5fa4e328cbf89fbe13c5cb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:17:00.335778 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-af9cd0dd-0b26-462a-9e4c-7c282c260deb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:00.337104 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-af9cd0dd-0b26-462a-9e4c-7c282c260deb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:00.341573 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1119/2278] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:17:00 2022] DELETE /identity/v3/projects/e2a6c7c1c5fa4e328cbf89fbe13c5cb9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:17:00.343197 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847b7b1-303c-44b4-b960-2c45f568dd56 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:00.373153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847b7b1-303c-44b4-b960-2c45f568dd56 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:00.471481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:00.487217 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f5f81-952b-4d36-9953-b0096fcd4afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:00.495510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f5f81-952b-4d36-9953-b0096fcd4afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:00.495510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f5f81-952b-4d36-9953-b0096fcd4afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:00.495510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f5f81-952b-4d36-9953-b0096fcd4afe admin admin] PATH_INFO: `/v3/users/caf9f0e966064c7e99e98f5cc63f631b` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:00.495510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f5f81-952b-4d36-9953-b0096fcd4afe admin admin] RBAC: Authorizing `identity:delete_user(user_id=caf9f0e966064c7e99e98f5cc63f631b)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:00.499334 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f5f81-952b-4d36-9953-b0096fcd4afe admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:00.579790 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-164f5f81-952b-4d36-9953-b0096fcd4afe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caf9f0e966064c7e99e98f5cc63f631b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:00.580510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-164f5f81-952b-4d36-9953-b0096fcd4afe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caf9f0e966064c7e99e98f5cc63f631b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:00.589121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-164f5f81-952b-4d36-9953-b0096fcd4afe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caf9f0e966064c7e99e98f5cc63f631b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:00.600424 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-164f5f81-952b-4d36-9953-b0096fcd4afe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caf9f0e966064c7e99e98f5cc63f631b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:00.601225 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-164f5f81-952b-4d36-9953-b0096fcd4afe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caf9f0e966064c7e99e98f5cc63f631b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:00.626193 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1160/2279] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:17:00 2022] DELETE /identity/v3/users/caf9f0e966064c7e99e98f5cc63f631b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:17:01.077703 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cd0dd-0b26-462a-9e4c-7c282c260deb admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:01.080522 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-af9cd0dd-0b26-462a-9e4c-7c282c260deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:01.106018 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cd0dd-0b26-462a-9e4c-7c282c260deb admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:01.152897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c83079-b3c2-41c5-83b0-d2b2144e3ff3 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:01.153675 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c83079-b3c2-41c5-83b0-d2b2144e3ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:01.153675 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c83079-b3c2-41c5-83b0-d2b2144e3ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:01.189073 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-97c83079-b3c2-41c5-83b0-d2b2144e3ff3 None None] MFA Rules not processed for user `90794e56c3f9486fbace8c39018233b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:01.190470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-97c83079-b3c2-41c5-83b0-d2b2144e3ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:01.223479 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a4587-c4e7-4de0-9072-35339403c503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:01.225258 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a4587-c4e7-4de0-9072-35339403c503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:01.225721 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a4587-c4e7-4de0-9072-35339403c503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:01.226350 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a4587-c4e7-4de0-9072-35339403c503 admin admin] PATH_INFO: `/v3/projects/520fcbc1ba8b46da83861bae00c82cb8` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:01.227963 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a4587-c4e7-4de0-9072-35339403c503 admin admin] RBAC: Authorizing `identity:delete_project(project_id=520fcbc1ba8b46da83861bae00c82cb8)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:01.230981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a4587-c4e7-4de0-9072-35339403c503 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:01.266950 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1161/2280] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:17:01.299721 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:01.305319 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-540a4587-c4e7-4de0-9072-35339403c503 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '520fcbc1ba8b46da83861bae00c82cb8', 'request_id': 'req-540a4587-c4e7-4de0-9072-35339403c503'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:01.319640 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-540a4587-c4e7-4de0-9072-35339403c503 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '520fcbc1ba8b46da83861bae00c82cb8', 'request_id': 'req-540a4587-c4e7-4de0-9072-35339403c503'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:01.341093 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-540a4587-c4e7-4de0-9072-35339403c503 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '520fcbc1ba8b46da83861bae00c82cb8', 'request_id': 'req-540a4587-c4e7-4de0-9072-35339403c503'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:01.370069 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-540a4587-c4e7-4de0-9072-35339403c503 admin admin] The token cache is being invalidate because project 520fcbc1ba8b46da83861bae00c82cb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:17:01.372953 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-540a4587-c4e7-4de0-9072-35339403c503 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:01.374916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-540a4587-c4e7-4de0-9072-35339403c503 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:01.381749 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1120/2281] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:17:01 2022] DELETE /identity/v3/projects/520fcbc1ba8b46da83861bae00c82cb8 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:17:01.387013 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df08c0-32fc-44af-b3a2-1f9debc7fb04 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:01.387633 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df08c0-32fc-44af-b3a2-1f9debc7fb04 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:01.388570 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df08c0-32fc-44af-b3a2-1f9debc7fb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:01.433070 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-24df08c0-32fc-44af-b3a2-1f9debc7fb04 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:01.435129 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-24df08c0-32fc-44af-b3a2-1f9debc7fb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:01.566174 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1162/2282] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:17:01.575342 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f67847-5246-4d19-bfb7-d757daf0a8b5 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:01.575342 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f67847-5246-4d19-bfb7-d757daf0a8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:01.575342 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f67847-5246-4d19-bfb7-d757daf0a8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:01.606263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-e7f67847-5246-4d19-bfb7-d757daf0a8b5 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:01.607639 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-e7f67847-5246-4d19-bfb7-d757daf0a8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:01.618131 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1121/2283] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:01.622745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df08c0-32fc-44af-b3a2-1f9debc7fb04 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:01.639283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df08c0-32fc-44af-b3a2-1f9debc7fb04 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:01.645187 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd3b54-5428-4e55-b515-ecadb972e72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:01.646031 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd3b54-5428-4e55-b515-ecadb972e72a admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:01.646409 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd3b54-5428-4e55-b515-ecadb972e72a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:01.646779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd3b54-5428-4e55-b515-ecadb972e72a admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:01.647720 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd3b54-5428-4e55-b515-ecadb972e72a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:17:01.648183 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd3b54-5428-4e55-b515-ecadb972e72a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:01.650042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd3b54-5428-4e55-b515-ecadb972e72a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:01.670668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1163/2284] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:17:01.674744 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f67847-5246-4d19-bfb7-d757daf0a8b5 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:01.685815 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f67847-5246-4d19-bfb7-d757daf0a8b5 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:01.691160 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693d3e2-ac7c-47b6-983a-b26be85475cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:01.692045 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693d3e2-ac7c-47b6-983a-b26be85475cd admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:01.692541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693d3e2-ac7c-47b6-983a-b26be85475cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:01.692797 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693d3e2-ac7c-47b6-983a-b26be85475cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:01.694162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693d3e2-ac7c-47b6-983a-b26be85475cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:01.696414 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693d3e2-ac7c-47b6-983a-b26be85475cd admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:01.772224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1122/2285] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:17:01 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:17:01.777233 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd3b54-5428-4e55-b515-ecadb972e72a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:01.786639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:01.792995 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd3b54-5428-4e55-b515-ecadb972e72a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:01.953426 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c9b8d-c2fa-4ec3-b62d-03e7c4803fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:01.954195 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c9b8d-c2fa-4ec3-b62d-03e7c4803fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:01.954530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c9b8d-c2fa-4ec3-b62d-03e7c4803fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:01.954875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c9b8d-c2fa-4ec3-b62d-03e7c4803fa7 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:01.955647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c9b8d-c2fa-4ec3-b62d-03e7c4803fa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:01.958281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c9b8d-c2fa-4ec3-b62d-03e7c4803fa7 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:02.000475 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1164/2286] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:17:01 2022] POST /identity/v3/users => generated 294 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:17:02.004211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693d3e2-ac7c-47b6-983a-b26be85475cd admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:02.015364 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693d3e2-ac7c-47b6-983a-b26be85475cd admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:02.032581 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081db32d-50d3-43b7-956f-3ea735d648e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:02.033287 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081db32d-50d3-43b7-956f-3ea735d648e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:02.033634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081db32d-50d3-43b7-956f-3ea735d648e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:02.034034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081db32d-50d3-43b7-956f-3ea735d648e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:02.034757 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081db32d-50d3-43b7-956f-3ea735d648e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:02.036565 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081db32d-50d3-43b7-956f-3ea735d648e0 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:02.062656 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1123/2287] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:17:02.066783 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c9b8d-c2fa-4ec3-b62d-03e7c4803fa7 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:02.081409 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c9b8d-c2fa-4ec3-b62d-03e7c4803fa7 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:02.091762 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af970bc-f8b6-4b36-9e70-6c2b640231f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:02.092448 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af970bc-f8b6-4b36-9e70-6c2b640231f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:02.092791 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af970bc-f8b6-4b36-9e70-6c2b640231f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:02.093174 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af970bc-f8b6-4b36-9e70-6c2b640231f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:02.093902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af970bc-f8b6-4b36-9e70-6c2b640231f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:02.105438 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af970bc-f8b6-4b36-9e70-6c2b640231f3 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:02.135995 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1165/2288] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:17:02.137317 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081db32d-50d3-43b7-956f-3ea735d648e0 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:02.159262 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081db32d-50d3-43b7-956f-3ea735d648e0 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:02.167931 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b905e6-23ec-4b46-b468-d7f0dd19525c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:02.169395 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b905e6-23ec-4b46-b468-d7f0dd19525c admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:02.170367 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b905e6-23ec-4b46-b468-d7f0dd19525c admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:02.170805 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b905e6-23ec-4b46-b468-d7f0dd19525c admin admin] PATH_INFO: `/v3/projects/ac817b7f916741b7a4ec2a9dc83a6931/users/244eba73ec7a4135b7922107c52bcb7e/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:02.227906 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b905e6-23ec-4b46-b468-d7f0dd19525c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac817b7f916741b7a4ec2a9dc83a6931, user_id=244eba73ec7a4135b7922107c52bcb7e, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:02.231216 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b905e6-23ec-4b46-b468-d7f0dd19525c admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:02.268606 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1124/2289] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:17:02 2022] PUT /identity/v3/projects/ac817b7f916741b7a4ec2a9dc83a6931/users/244eba73ec7a4135b7922107c52bcb7e/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:17:02.274795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d4f8f-04a3-4e7c-8ff9-cb8618aacaff None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:02.275079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d4f8f-04a3-4e7c-8ff9-cb8618aacaff None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:02.275360 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d4f8f-04a3-4e7c-8ff9-cb8618aacaff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:02.338564 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-962d4f8f-04a3-4e7c-8ff9-cb8618aacaff None None] MFA Rules not processed for user `244eba73ec7a4135b7922107c52bcb7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:02.340966 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-962d4f8f-04a3-4e7c-8ff9-cb8618aacaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:02.504269 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b905e6-23ec-4b46-b468-d7f0dd19525c admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:02.505612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1166/2290] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:02.511597 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49b4e6-b814-476e-ae62-b6bb1bacd7ac None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:02.514456 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49b4e6-b814-476e-ae62-b6bb1bacd7ac None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:02.515079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49b4e6-b814-476e-ae62-b6bb1bacd7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:02.565698 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-ae49b4e6-b814-476e-ae62-b6bb1bacd7ac None None] MFA Rules not processed for user `c0e57ea982d349c1a86b544e9a6e7758`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:02.567949 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ae49b4e6-b814-476e-ae62-b6bb1bacd7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:02.627334 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b905e6-23ec-4b46-b468-d7f0dd19525c admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:02.641320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ccf6a3-2f69-4b69-81c9-466384ceb4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:02.641956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccf6a3-2f69-4b69-81c9-466384ceb4d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:02.642368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccf6a3-2f69-4b69-81c9-466384ceb4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:02.642515 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccf6a3-2f69-4b69-81c9-466384ceb4d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:02.643460 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ccf6a3-2f69-4b69-81c9-466384ceb4d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:02.645167 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ccf6a3-2f69-4b69-81c9-466384ceb4d2 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:02.674639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1167/2291] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 28 12:17:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:02.692837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49b4e6-b814-476e-ae62-b6bb1bacd7ac None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:02.694864 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ae49b4e6-b814-476e-ae62-b6bb1bacd7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:02.699857 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1125/2292] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:17:02 2022] POST /identity/v3/projects => generated 387 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:17:02.702194 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ccf6a3-2f69-4b69-81c9-466384ceb4d2 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:02.739992 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:02.787701 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:02.803242 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ccf6a3-2f69-4b69-81c9-466384ceb4d2 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:02.814922 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9c422-9bba-497d-9ffd-788ba9c9d8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:02.816153 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9c422-9bba-497d-9ffd-788ba9c9d8c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:02.816739 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9c422-9bba-497d-9ffd-788ba9c9d8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:02.816927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9c422-9bba-497d-9ffd-788ba9c9d8c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:02.818660 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9c422-9bba-497d-9ffd-788ba9c9d8c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:02.821852 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9c422-9bba-497d-9ffd-788ba9c9d8c0 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:02.837736 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49b4e6-b814-476e-ae62-b6bb1bacd7ac None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:02.856289 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1126/2293] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:17:02 2022] POST /identity/v3/users => generated 300 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:17:02.862331 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9c422-9bba-497d-9ffd-788ba9c9d8c0 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:02.880612 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9c422-9bba-497d-9ffd-788ba9c9d8c0 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:02.890004 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467336b-1d91-4867-9278-e048f858a510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:02.890792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467336b-1d91-4867-9278-e048f858a510 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:02.891077 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467336b-1d91-4867-9278-e048f858a510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:02.891350 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467336b-1d91-4867-9278-e048f858a510 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:02.892037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9467336b-1d91-4867-9278-e048f858a510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:02.893651 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9467336b-1d91-4867-9278-e048f858a510 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:02.923477 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1127/2294] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:17:02.928239 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467336b-1d91-4867-9278-e048f858a510 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:02.944430 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467336b-1d91-4867-9278-e048f858a510 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:02.951024 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf97657-bd36-432f-9504-190baf733ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:02.952503 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf97657-bd36-432f-9504-190baf733ea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:02.952895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf97657-bd36-432f-9504-190baf733ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:02.953273 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf97657-bd36-432f-9504-190baf733ea7 admin admin] PATH_INFO: `/v3/projects/478fcdc74073412daeeca0d04ad07b3e/users/1dc4f4b279b74ec5b53926297ed031dc/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:02.955100 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b78cdb-5a2e-4c18-89ac-a6d2749826f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '822e394e80fd41adb54d330adaf65a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:02.956710 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b78cdb-5a2e-4c18-89ac-a6d2749826f0 service swift] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:02.956994 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b78cdb-5a2e-4c18-89ac-a6d2749826f0 service swift] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:02.957354 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b78cdb-5a2e-4c18-89ac-a6d2749826f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:02.971934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf97657-bd36-432f-9504-190baf733ea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=478fcdc74073412daeeca0d04ad07b3e, user_id=1dc4f4b279b74ec5b53926297ed031dc, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:02.975795 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf97657-bd36-432f-9504-190baf733ea7 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:02.995939 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1128/2295] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:17:02 2022] PUT /identity/v3/projects/478fcdc74073412daeeca0d04ad07b3e/users/1dc4f4b279b74ec5b53926297ed031dc/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:17:02.999924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf97657-bd36-432f-9504-190baf733ea7 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:03.036859 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b78cdb-5a2e-4c18-89ac-a6d2749826f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:03.038483 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b78cdb-5a2e-4c18-89ac-a6d2749826f0 service swift] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:03.049418 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1168/2296] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 28 12:17:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 12:17:03.112148 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf97657-bd36-432f-9504-190baf733ea7 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:03.126730 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c56eb-cb05-4b71-9030-41bcfbd7b2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:03.127362 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c56eb-cb05-4b71-9030-41bcfbd7b2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:03.127724 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c56eb-cb05-4b71-9030-41bcfbd7b2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:03.127952 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c56eb-cb05-4b71-9030-41bcfbd7b2f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:03.128709 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c56eb-cb05-4b71-9030-41bcfbd7b2f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:03.132084 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c56eb-cb05-4b71-9030-41bcfbd7b2f8 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:03.152815 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1129/2297] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:17:03.154116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b78cdb-5a2e-4c18-89ac-a6d2749826f0 service swift] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:03.168849 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b78cdb-5a2e-4c18-89ac-a6d2749826f0 service swift] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:03.174244 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05daf41-19ce-4fa9-9b7b-ce3a6bad88a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:03.175616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05daf41-19ce-4fa9-9b7b-ce3a6bad88a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:03.175891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05daf41-19ce-4fa9-9b7b-ce3a6bad88a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:03.176215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05daf41-19ce-4fa9-9b7b-ce3a6bad88a8 admin admin] PATH_INFO: `/v3/projects/478fcdc74073412daeeca0d04ad07b3e/users/1dc4f4b279b74ec5b53926297ed031dc/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:03.178731 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05daf41-19ce-4fa9-9b7b-ce3a6bad88a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=478fcdc74073412daeeca0d04ad07b3e, user_id=1dc4f4b279b74ec5b53926297ed031dc, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:03.182838 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05daf41-19ce-4fa9-9b7b-ce3a6bad88a8 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:03.220833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1169/2298] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:17:03 2022] PUT /identity/v3/projects/478fcdc74073412daeeca0d04ad07b3e/users/1dc4f4b279b74ec5b53926297ed031dc/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:17:03.226477 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479a5cf-029a-4e07-8703-d1f77c20cb56 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:03.227282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479a5cf-029a-4e07-8703-d1f77c20cb56 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:03.227617 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479a5cf-029a-4e07-8703-d1f77c20cb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:03.275518 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-c479a5cf-029a-4e07-8703-d1f77c20cb56 None None] MFA Rules not processed for user `1dc4f4b279b74ec5b53926297ed031dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:03.280208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-c479a5cf-029a-4e07-8703-d1f77c20cb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:03.457038 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1130/2299] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:03 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:03.471138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05daf41-19ce-4fa9-9b7b-ce3a6bad88a8 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:03.473113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c05daf41-19ce-4fa9-9b7b-ce3a6bad88a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:03.655425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:03.673963 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05daf41-19ce-4fa9-9b7b-ce3a6bad88a8 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:03.711156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26bb98-17a0-4ebd-84a3-861cfc4bcf10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:03.712065 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26bb98-17a0-4ebd-84a3-861cfc4bcf10 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:03.712507 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26bb98-17a0-4ebd-84a3-861cfc4bcf10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:03.713583 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26bb98-17a0-4ebd-84a3-861cfc4bcf10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:03.761777 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26bb98-17a0-4ebd-84a3-861cfc4bcf10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:03.763622 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26bb98-17a0-4ebd-84a3-861cfc4bcf10 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:03.779592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1170/2300] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:17:03 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:17:03.882488 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479a5cf-029a-4e07-8703-d1f77c20cb56 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:03.949766 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:04.210892 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479a5cf-029a-4e07-8703-d1f77c20cb56 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:04.233233 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ced81-c5e0-4eba-9e28-9b27a6bf2459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:04.241326 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ced81-c5e0-4eba-9e28-9b27a6bf2459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:04.242158 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ced81-c5e0-4eba-9e28-9b27a6bf2459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:04.242607 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ced81-c5e0-4eba-9e28-9b27a6bf2459 admin admin] PATH_INFO: `/v3/users/244eba73ec7a4135b7922107c52bcb7e` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:04.244116 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ced81-c5e0-4eba-9e28-9b27a6bf2459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=244eba73ec7a4135b7922107c52bcb7e)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:04.246262 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ced81-c5e0-4eba-9e28-9b27a6bf2459 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:04.366066 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-3c2ced81-c5e0-4eba-9e28-9b27a6bf2459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '244eba73ec7a4135b7922107c52bcb7e'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:04.381313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-3c2ced81-c5e0-4eba-9e28-9b27a6bf2459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '244eba73ec7a4135b7922107c52bcb7e'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:04.382810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-3c2ced81-c5e0-4eba-9e28-9b27a6bf2459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '244eba73ec7a4135b7922107c52bcb7e'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:04.399822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-3c2ced81-c5e0-4eba-9e28-9b27a6bf2459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '244eba73ec7a4135b7922107c52bcb7e'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:04.419024 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-3c2ced81-c5e0-4eba-9e28-9b27a6bf2459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '244eba73ec7a4135b7922107c52bcb7e'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:04.434058 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1131/2301] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:17:03 2022] DELETE /identity/v3/users/244eba73ec7a4135b7922107c52bcb7e => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:17:04.438769 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be226e4c-dee3-488d-83a9-7f80f7951bc9 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:04.439137 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be226e4c-dee3-488d-83a9-7f80f7951bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:04.439419 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be226e4c-dee3-488d-83a9-7f80f7951bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:04.461435 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-be226e4c-dee3-488d-83a9-7f80f7951bc9 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:04.464270 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-be226e4c-dee3-488d-83a9-7f80f7951bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:04.585880 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1171/2302] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:04.595744 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ced81-c5e0-4eba-9e28-9b27a6bf2459 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:04.598807 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-3c2ced81-c5e0-4eba-9e28-9b27a6bf2459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:04.795221 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ced81-c5e0-4eba-9e28-9b27a6bf2459 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:04.805297 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29368a9c-cffd-4012-b9ac-178eb3ac7a14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:04.806099 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29368a9c-cffd-4012-b9ac-178eb3ac7a14 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:04.806477 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29368a9c-cffd-4012-b9ac-178eb3ac7a14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:04.806837 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29368a9c-cffd-4012-b9ac-178eb3ac7a14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:04.827861 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29368a9c-cffd-4012-b9ac-178eb3ac7a14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:04.829311 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29368a9c-cffd-4012-b9ac-178eb3ac7a14 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:04.861581 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1132/2303] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:17:05.577977 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be226e4c-dee3-488d-83a9-7f80f7951bc9 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:05.579619 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-be226e4c-dee3-488d-83a9-7f80f7951bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:05.598475 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be226e4c-dee3-488d-83a9-7f80f7951bc9 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:05.610592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb34a27-188b-499e-9098-7704fc2ded45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:05.610964 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb34a27-188b-499e-9098-7704fc2ded45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:05.611158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb34a27-188b-499e-9098-7704fc2ded45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:05.611482 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb34a27-188b-499e-9098-7704fc2ded45 admin admin] PATH_INFO: `/v3/projects/ac817b7f916741b7a4ec2a9dc83a6931` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:05.613380 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb34a27-188b-499e-9098-7704fc2ded45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac817b7f916741b7a4ec2a9dc83a6931)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:05.615703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb34a27-188b-499e-9098-7704fc2ded45 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:05.742606 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-bfb34a27-188b-499e-9098-7704fc2ded45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac817b7f916741b7a4ec2a9dc83a6931', 'request_id': 'req-bfb34a27-188b-499e-9098-7704fc2ded45'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:05.759128 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-bfb34a27-188b-499e-9098-7704fc2ded45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac817b7f916741b7a4ec2a9dc83a6931', 'request_id': 'req-bfb34a27-188b-499e-9098-7704fc2ded45'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:05.766717 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-bfb34a27-188b-499e-9098-7704fc2ded45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac817b7f916741b7a4ec2a9dc83a6931', 'request_id': 'req-bfb34a27-188b-499e-9098-7704fc2ded45'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:05.789958 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-bfb34a27-188b-499e-9098-7704fc2ded45 admin admin] The token cache is being invalidate because project ac817b7f916741b7a4ec2a9dc83a6931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:17:05.790197 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-bfb34a27-188b-499e-9098-7704fc2ded45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:05.790974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-bfb34a27-188b-499e-9098-7704fc2ded45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:05.793992 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1172/2304] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:17:05 2022] DELETE /identity/v3/projects/ac817b7f916741b7a4ec2a9dc83a6931 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:17:05.798115 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29368a9c-cffd-4012-b9ac-178eb3ac7a14 service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:05.811789 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29368a9c-cffd-4012-b9ac-178eb3ac7a14 service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:05.963661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:05.993868 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e8f6b-836b-4109-af79-0a65d97b9f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:05.994828 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e8f6b-836b-4109-af79-0a65d97b9f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:05.995215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e8f6b-836b-4109-af79-0a65d97b9f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:05.995757 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e8f6b-836b-4109-af79-0a65d97b9f60 admin admin] PATH_INFO: `/v3/users/1dc4f4b279b74ec5b53926297ed031dc` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:06.001819 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e8f6b-836b-4109-af79-0a65d97b9f60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dc4f4b279b74ec5b53926297ed031dc)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:06.005065 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e8f6b-836b-4109-af79-0a65d97b9f60 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:06.204678 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-e67e8f6b-836b-4109-af79-0a65d97b9f60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dc4f4b279b74ec5b53926297ed031dc'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:06.241296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-e67e8f6b-836b-4109-af79-0a65d97b9f60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dc4f4b279b74ec5b53926297ed031dc'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:06.242805 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-e67e8f6b-836b-4109-af79-0a65d97b9f60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dc4f4b279b74ec5b53926297ed031dc'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:06.262330 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-e67e8f6b-836b-4109-af79-0a65d97b9f60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dc4f4b279b74ec5b53926297ed031dc'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:06.275282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-e67e8f6b-836b-4109-af79-0a65d97b9f60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dc4f4b279b74ec5b53926297ed031dc'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:06.290811 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1133/2305] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:17:05 2022] DELETE /identity/v3/users/1dc4f4b279b74ec5b53926297ed031dc => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:17:07.096852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb34a27-188b-499e-9098-7704fc2ded45 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:07.098396 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-bfb34a27-188b-499e-9098-7704fc2ded45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:07.114868 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb34a27-188b-499e-9098-7704fc2ded45 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:07.206437 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303b4a7-250f-4f14-b105-cdb92c44b216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:07.207569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303b4a7-250f-4f14-b105-cdb92c44b216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:07.208017 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303b4a7-250f-4f14-b105-cdb92c44b216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:07.208444 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303b4a7-250f-4f14-b105-cdb92c44b216 admin admin] PATH_INFO: `/v3/projects/478fcdc74073412daeeca0d04ad07b3e` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:07.211033 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303b4a7-250f-4f14-b105-cdb92c44b216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=478fcdc74073412daeeca0d04ad07b3e)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:07.214050 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303b4a7-250f-4f14-b105-cdb92c44b216 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:07.235243 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:07.282199 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e303b4a7-250f-4f14-b105-cdb92c44b216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '478fcdc74073412daeeca0d04ad07b3e', 'request_id': 'req-e303b4a7-250f-4f14-b105-cdb92c44b216'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:07.296764 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e303b4a7-250f-4f14-b105-cdb92c44b216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '478fcdc74073412daeeca0d04ad07b3e', 'request_id': 'req-e303b4a7-250f-4f14-b105-cdb92c44b216'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:07.318320 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e303b4a7-250f-4f14-b105-cdb92c44b216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '478fcdc74073412daeeca0d04ad07b3e', 'request_id': 'req-e303b4a7-250f-4f14-b105-cdb92c44b216'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:07.336217 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e303b4a7-250f-4f14-b105-cdb92c44b216 admin admin] The token cache is being invalidate because project 478fcdc74073412daeeca0d04ad07b3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:17:07.337386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e303b4a7-250f-4f14-b105-cdb92c44b216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:07.338882 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e303b4a7-250f-4f14-b105-cdb92c44b216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:07.342923 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1173/2306] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:17:07 2022] DELETE /identity/v3/projects/478fcdc74073412daeeca0d04ad07b3e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:17:07.348000 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7645a5b-4240-4fae-92bf-e22295b529e3 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:07.349009 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7645a5b-4240-4fae-92bf-e22295b529e3 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:07.349287 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7645a5b-4240-4fae-92bf-e22295b529e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:07.374492 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-e7645a5b-4240-4fae-92bf-e22295b529e3 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:07.376223 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-e7645a5b-4240-4fae-92bf-e22295b529e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:07.518550 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1134/2307] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:07.519380 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8950ce-c25d-4fd0-8341-bbae29b8b72a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:07.519699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8950ce-c25d-4fd0-8341-bbae29b8b72a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:07.519981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8950ce-c25d-4fd0-8341-bbae29b8b72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:07.544630 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-0c8950ce-c25d-4fd0-8341-bbae29b8b72a None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:07.546374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0c8950ce-c25d-4fd0-8341-bbae29b8b72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:07.561258 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1174/2308] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:07.563017 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7645a5b-4240-4fae-92bf-e22295b529e3 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:07.576511 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7645a5b-4240-4fae-92bf-e22295b529e3 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:07.582965 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc110a9-60d2-457b-9489-62539b9e7892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:07.583699 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc110a9-60d2-457b-9489-62539b9e7892 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:07.583974 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc110a9-60d2-457b-9489-62539b9e7892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:07.584241 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc110a9-60d2-457b-9489-62539b9e7892 admin admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:07.584894 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc110a9-60d2-457b-9489-62539b9e7892 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:17:07.585264 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc110a9-60d2-457b-9489-62539b9e7892 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:07.586930 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc110a9-60d2-457b-9489-62539b9e7892 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:07.603496 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1135/2309] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:17:07.606377 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8950ce-c25d-4fd0-8341-bbae29b8b72a None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:07.617517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8950ce-c25d-4fd0-8341-bbae29b8b72a None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:07.630330 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13764a-9874-4b7a-9ced-b9c62eba3963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:07.630982 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13764a-9874-4b7a-9ced-b9c62eba3963 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:07.631356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13764a-9874-4b7a-9ced-b9c62eba3963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:07.631581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13764a-9874-4b7a-9ced-b9c62eba3963 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:07.632199 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13764a-9874-4b7a-9ced-b9c62eba3963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:07.634204 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13764a-9874-4b7a-9ced-b9c62eba3963 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:07.674475 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1175/2310] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:17:07 2022] POST /identity/v3/projects => generated 387 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:17:07.678417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc110a9-60d2-457b-9489-62539b9e7892 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:07.694101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc110a9-60d2-457b-9489-62539b9e7892 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:07.779609 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:07.789871 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d8687-06ac-4a2d-99cc-5917f16583e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:07.790585 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d8687-06ac-4a2d-99cc-5917f16583e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:07.795961 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d8687-06ac-4a2d-99cc-5917f16583e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:07.796259 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d8687-06ac-4a2d-99cc-5917f16583e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:07.797605 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d8687-06ac-4a2d-99cc-5917f16583e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:07.799668 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d8687-06ac-4a2d-99cc-5917f16583e1 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:07.827738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1136/2311] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:17:07 2022] POST /identity/v3/users => generated 294 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:17:07.831573 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13764a-9874-4b7a-9ced-b9c62eba3963 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:07.844636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13764a-9874-4b7a-9ced-b9c62eba3963 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:07.849828 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0020b6-cc79-4932-bb8f-343b63737eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:07.850480 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0020b6-cc79-4932-bb8f-343b63737eff admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:07.850773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0020b6-cc79-4932-bb8f-343b63737eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:07.851097 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0020b6-cc79-4932-bb8f-343b63737eff admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:07.851782 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0020b6-cc79-4932-bb8f-343b63737eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:07.855390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0020b6-cc79-4932-bb8f-343b63737eff admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:07.870757 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1176/2312] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:17:07.874816 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d8687-06ac-4a2d-99cc-5917f16583e1 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:07.888575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d8687-06ac-4a2d-99cc-5917f16583e1 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:07.898472 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac35b8-7a29-4612-abab-29ac3b2176b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:07.899240 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac35b8-7a29-4612-abab-29ac3b2176b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:07.899636 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac35b8-7a29-4612-abab-29ac3b2176b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:07.899980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac35b8-7a29-4612-abab-29ac3b2176b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:07.900746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac35b8-7a29-4612-abab-29ac3b2176b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:07.902626 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac35b8-7a29-4612-abab-29ac3b2176b6 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:07.917097 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1137/2313] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:17:07.922536 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0020b6-cc79-4932-bb8f-343b63737eff admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:07.940411 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0020b6-cc79-4932-bb8f-343b63737eff admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:07.951552 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6213a6-c7d1-4c8a-9b7c-338eeea9da5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:07.952447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6213a6-c7d1-4c8a-9b7c-338eeea9da5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:07.952820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6213a6-c7d1-4c8a-9b7c-338eeea9da5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:07.953164 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6213a6-c7d1-4c8a-9b7c-338eeea9da5e admin admin] PATH_INFO: `/v3/projects/0c5119eb7f08419bbb58ac8f3bc59c2e/users/5fad75328f894f579ae894401c315950/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:07.975924 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6213a6-c7d1-4c8a-9b7c-338eeea9da5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c5119eb7f08419bbb58ac8f3bc59c2e, user_id=5fad75328f894f579ae894401c315950, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:07.980938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6213a6-c7d1-4c8a-9b7c-338eeea9da5e admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:08.006284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1177/2314] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:17:07 2022] PUT /identity/v3/projects/0c5119eb7f08419bbb58ac8f3bc59c2e/users/5fad75328f894f579ae894401c315950/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:17:08.016927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5310bb-a8fd-43aa-8017-787011b911f8 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:08.017217 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5310bb-a8fd-43aa-8017-787011b911f8 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:08.017493 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5310bb-a8fd-43aa-8017-787011b911f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:08.058942 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-ab5310bb-a8fd-43aa-8017-787011b911f8 None None] MFA Rules not processed for user `5fad75328f894f579ae894401c315950`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:08.060878 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-ab5310bb-a8fd-43aa-8017-787011b911f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:08.173751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1138/2315] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:08.178232 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6213a6-c7d1-4c8a-9b7c-338eeea9da5e admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:08.267262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6213a6-c7d1-4c8a-9b7c-338eeea9da5e admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:08.272114 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fa0ab-9bbc-4709-9e96-36748b1b6e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:08.272715 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fa0ab-9bbc-4709-9e96-36748b1b6e33 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:08.272995 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fa0ab-9bbc-4709-9e96-36748b1b6e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:08.273266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fa0ab-9bbc-4709-9e96-36748b1b6e33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:08.274122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fa0ab-9bbc-4709-9e96-36748b1b6e33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:08.275096 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343b284-f4bc-42d7-bd5d-98c8e8e31353 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:08.275412 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343b284-f4bc-42d7-bd5d-98c8e8e31353 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:08.275925 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343b284-f4bc-42d7-bd5d-98c8e8e31353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:08.276102 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fa0ab-9bbc-4709-9e96-36748b1b6e33 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:08.305219 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-7343b284-f4bc-42d7-bd5d-98c8e8e31353 None None] MFA Rules not processed for user `c0e57ea982d349c1a86b544e9a6e7758`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:08.306985 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-7343b284-f4bc-42d7-bd5d-98c8e8e31353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:08.314540 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1178/2316] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:17:08 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:17:08.318553 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fa0ab-9bbc-4709-9e96-36748b1b6e33 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:08.350639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:08.385617 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1139/2317] 10.222.0.16 () {58 vars in 967 bytes} [Wed Sep 28 12:17:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:08.402726 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343b284-f4bc-42d7-bd5d-98c8e8e31353 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:08.404444 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-7343b284-f4bc-42d7-bd5d-98c8e8e31353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:08.405815 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fa0ab-9bbc-4709-9e96-36748b1b6e33 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:08.412023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb8785-f807-4ae6-8fd9-8a1d80c2179b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:08.412928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb8785-f807-4ae6-8fd9-8a1d80c2179b admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:08.413213 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb8785-f807-4ae6-8fd9-8a1d80c2179b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:08.413484 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb8785-f807-4ae6-8fd9-8a1d80c2179b admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:08.414124 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb8785-f807-4ae6-8fd9-8a1d80c2179b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:08.416138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb8785-f807-4ae6-8fd9-8a1d80c2179b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:08.451586 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1179/2318] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:17:08 2022] POST /identity/v3/users => generated 299 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:17:08.458438 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb8785-f807-4ae6-8fd9-8a1d80c2179b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:08.483994 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb8785-f807-4ae6-8fd9-8a1d80c2179b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:08.498244 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8711072-f6c0-4d75-b3d7-8758199c01a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:08.498873 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8711072-f6c0-4d75-b3d7-8758199c01a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:08.500759 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8711072-f6c0-4d75-b3d7-8758199c01a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:08.500759 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8711072-f6c0-4d75-b3d7-8758199c01a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:08.501246 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8711072-f6c0-4d75-b3d7-8758199c01a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:08.502829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8711072-f6c0-4d75-b3d7-8758199c01a9 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:08.530643 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1180/2319] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:17:08.534916 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8711072-f6c0-4d75-b3d7-8758199c01a9 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:08.552261 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8711072-f6c0-4d75-b3d7-8758199c01a9 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:08.559783 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ca43f-7621-46f4-bb98-3ba9b7659491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:08.560570 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ca43f-7621-46f4-bb98-3ba9b7659491 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:08.560950 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ca43f-7621-46f4-bb98-3ba9b7659491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:08.561341 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343b284-f4bc-42d7-bd5d-98c8e8e31353 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:08.566112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ca43f-7621-46f4-bb98-3ba9b7659491 admin admin] PATH_INFO: `/v3/projects/371f8275352b449a98dfc2a33b87f0d9/users/e54545a79f37404898fafe0fa14eba32/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:08.572455 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:08.604569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ca43f-7621-46f4-bb98-3ba9b7659491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=371f8275352b449a98dfc2a33b87f0d9, user_id=e54545a79f37404898fafe0fa14eba32, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:08.609041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ca43f-7621-46f4-bb98-3ba9b7659491 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:08.631817 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1181/2320] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:17:08 2022] PUT /identity/v3/projects/371f8275352b449a98dfc2a33b87f0d9/users/e54545a79f37404898fafe0fa14eba32/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:17:08.636154 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ca43f-7621-46f4-bb98-3ba9b7659491 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:08.656312 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4778863-fa45-4559-bd4b-874ef4b2d9e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '822e394e80fd41adb54d330adaf65a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:08.657128 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4778863-fa45-4559-bd4b-874ef4b2d9e2 service swift] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:08.657539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4778863-fa45-4559-bd4b-874ef4b2d9e2 service swift] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:08.657890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4778863-fa45-4559-bd4b-874ef4b2d9e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:08.761139 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ca43f-7621-46f4-bb98-3ba9b7659491 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:08.769304 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f315514-df22-4e1b-8313-a14d1668c52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:08.770020 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f315514-df22-4e1b-8313-a14d1668c52d admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:08.770367 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f315514-df22-4e1b-8313-a14d1668c52d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:08.770708 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f315514-df22-4e1b-8313-a14d1668c52d admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:08.771474 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f315514-df22-4e1b-8313-a14d1668c52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:08.773239 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f315514-df22-4e1b-8313-a14d1668c52d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:08.780568 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4778863-fa45-4559-bd4b-874ef4b2d9e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:08.782695 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4778863-fa45-4559-bd4b-874ef4b2d9e2 service swift] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:08.787326 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1182/2321] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:17:08.791817 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f315514-df22-4e1b-8313-a14d1668c52d admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:08.797482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1140/2322] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 28 12:17:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 28 12:17:08.805145 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f315514-df22-4e1b-8313-a14d1668c52d admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:08.813016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5e08c-712c-43fc-9ec4-63491a1bdc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:08.814339 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5e08c-712c-43fc-9ec4-63491a1bdc16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:08.814339 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5e08c-712c-43fc-9ec4-63491a1bdc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:08.814898 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5e08c-712c-43fc-9ec4-63491a1bdc16 admin admin] PATH_INFO: `/v3/projects/371f8275352b449a98dfc2a33b87f0d9/users/e54545a79f37404898fafe0fa14eba32/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:08.817381 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5e08c-712c-43fc-9ec4-63491a1bdc16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=371f8275352b449a98dfc2a33b87f0d9, user_id=e54545a79f37404898fafe0fa14eba32, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:08.820449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5e08c-712c-43fc-9ec4-63491a1bdc16 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:08.855787 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1183/2323] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:17:08 2022] PUT /identity/v3/projects/371f8275352b449a98dfc2a33b87f0d9/users/e54545a79f37404898fafe0fa14eba32/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:17:08.857964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75811d4f-7360-483c-85e9-3ac57891eeca None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:08.858261 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75811d4f-7360-483c-85e9-3ac57891eeca None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:08.858550 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75811d4f-7360-483c-85e9-3ac57891eeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:08.913862 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-75811d4f-7360-483c-85e9-3ac57891eeca None None] MFA Rules not processed for user `e54545a79f37404898fafe0fa14eba32`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:08.917429 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-75811d4f-7360-483c-85e9-3ac57891eeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:09.031574 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1141/2324] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:09.041668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5e08c-712c-43fc-9ec4-63491a1bdc16 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:09.043519 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-08b5e08c-712c-43fc-9ec4-63491a1bdc16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:09.118663 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5e08c-712c-43fc-9ec4-63491a1bdc16 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:09.127019 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9676c4d-ab68-4c44-ace9-570a58d09627 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:09.127791 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9676c4d-ab68-4c44-ace9-570a58d09627 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:09.128119 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9676c4d-ab68-4c44-ace9-570a58d09627 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:09.128492 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9676c4d-ab68-4c44-ace9-570a58d09627 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:09.140081 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9676c4d-ab68-4c44-ace9-570a58d09627 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:09.141648 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9676c4d-ab68-4c44-ace9-570a58d09627 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:09.161565 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1184/2325] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:17:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:17:10.098414 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75811d4f-7360-483c-85e9-3ac57891eeca None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:10.151899 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:10.178482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75811d4f-7360-483c-85e9-3ac57891eeca None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:10.183209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a641a-d110-46bc-a7ab-158886a14de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:10.183961 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a641a-d110-46bc-a7ab-158886a14de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:10.184238 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a641a-d110-46bc-a7ab-158886a14de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:10.184506 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a641a-d110-46bc-a7ab-158886a14de1 admin admin] PATH_INFO: `/v3/users/5fad75328f894f579ae894401c315950` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:10.185639 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a641a-d110-46bc-a7ab-158886a14de1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fad75328f894f579ae894401c315950)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:10.187578 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a641a-d110-46bc-a7ab-158886a14de1 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:10.247642 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-655a641a-d110-46bc-a7ab-158886a14de1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fad75328f894f579ae894401c315950'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:10.262954 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-655a641a-d110-46bc-a7ab-158886a14de1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fad75328f894f579ae894401c315950'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:10.264139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-655a641a-d110-46bc-a7ab-158886a14de1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fad75328f894f579ae894401c315950'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:10.272615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-655a641a-d110-46bc-a7ab-158886a14de1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fad75328f894f579ae894401c315950'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:10.283059 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-655a641a-d110-46bc-a7ab-158886a14de1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fad75328f894f579ae894401c315950'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:10.290849 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1142/2326] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:17:10 2022] DELETE /identity/v3/users/5fad75328f894f579ae894401c315950 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:17:10.295849 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac3aac-9c9c-4c9a-ad3b-4fba8388c13a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:10.296373 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac3aac-9c9c-4c9a-ad3b-4fba8388c13a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:10.296752 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac3aac-9c9c-4c9a-ad3b-4fba8388c13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:10.306166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:10.319987 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-11ac3aac-9c9c-4c9a-ad3b-4fba8388c13a None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:10.321314 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-11ac3aac-9c9c-4c9a-ad3b-4fba8388c13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:10.405971 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1185/2327] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:10.412897 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a641a-d110-46bc-a7ab-158886a14de1 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:10.414609 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-655a641a-d110-46bc-a7ab-158886a14de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:10.485179 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a641a-d110-46bc-a7ab-158886a14de1 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:10.491538 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f806c5e-60ef-4247-86e9-36a0f943b7bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:10.494113 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f806c5e-60ef-4247-86e9-36a0f943b7bd service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:10.494113 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f806c5e-60ef-4247-86e9-36a0f943b7bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:10.494113 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f806c5e-60ef-4247-86e9-36a0f943b7bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:10.513278 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f806c5e-60ef-4247-86e9-36a0f943b7bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:10.515836 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f806c5e-60ef-4247-86e9-36a0f943b7bd service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:10.537464 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1143/2328] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:17:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:17:10.949327 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac3aac-9c9c-4c9a-ad3b-4fba8388c13a None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:10.953738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-11ac3aac-9c9c-4c9a-ad3b-4fba8388c13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:10.974589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac3aac-9c9c-4c9a-ad3b-4fba8388c13a None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:10.980400 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31fa77-0620-43bb-b32c-b05dc2d6c64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:10.981173 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31fa77-0620-43bb-b32c-b05dc2d6c64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:10.981843 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31fa77-0620-43bb-b32c-b05dc2d6c64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:10.982201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31fa77-0620-43bb-b32c-b05dc2d6c64c admin admin] PATH_INFO: `/v3/projects/0c5119eb7f08419bbb58ac8f3bc59c2e` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:10.984027 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31fa77-0620-43bb-b32c-b05dc2d6c64c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c5119eb7f08419bbb58ac8f3bc59c2e)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:10.986666 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31fa77-0620-43bb-b32c-b05dc2d6c64c admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:11.085897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9a31fa77-0620-43bb-b32c-b05dc2d6c64c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c5119eb7f08419bbb58ac8f3bc59c2e', 'request_id': 'req-9a31fa77-0620-43bb-b32c-b05dc2d6c64c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:11.094854 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9a31fa77-0620-43bb-b32c-b05dc2d6c64c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c5119eb7f08419bbb58ac8f3bc59c2e', 'request_id': 'req-9a31fa77-0620-43bb-b32c-b05dc2d6c64c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:11.102852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9a31fa77-0620-43bb-b32c-b05dc2d6c64c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c5119eb7f08419bbb58ac8f3bc59c2e', 'request_id': 'req-9a31fa77-0620-43bb-b32c-b05dc2d6c64c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:11.154452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9a31fa77-0620-43bb-b32c-b05dc2d6c64c admin admin] The token cache is being invalidate because project 0c5119eb7f08419bbb58ac8f3bc59c2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:17:11.155067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9a31fa77-0620-43bb-b32c-b05dc2d6c64c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:11.157136 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9a31fa77-0620-43bb-b32c-b05dc2d6c64c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:11.168092 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f806c5e-60ef-4247-86e9-36a0f943b7bd service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:11.170879 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1186/2329] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:17:10 2022] DELETE /identity/v3/projects/0c5119eb7f08419bbb58ac8f3bc59c2e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:17:11.181512 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f806c5e-60ef-4247-86e9-36a0f943b7bd service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:11.263101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65683edb-0b47-4f63-b24c-ffce6bbf9453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:11.263897 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65683edb-0b47-4f63-b24c-ffce6bbf9453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:11.264277 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65683edb-0b47-4f63-b24c-ffce6bbf9453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:11.264651 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65683edb-0b47-4f63-b24c-ffce6bbf9453 admin admin] PATH_INFO: `/v3/users/e54545a79f37404898fafe0fa14eba32` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:11.265911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65683edb-0b47-4f63-b24c-ffce6bbf9453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e54545a79f37404898fafe0fa14eba32)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:11.269501 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65683edb-0b47-4f63-b24c-ffce6bbf9453 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:11.273628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:11.362046 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-65683edb-0b47-4f63-b24c-ffce6bbf9453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e54545a79f37404898fafe0fa14eba32'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:11.379599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-65683edb-0b47-4f63-b24c-ffce6bbf9453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e54545a79f37404898fafe0fa14eba32'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:11.380818 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-65683edb-0b47-4f63-b24c-ffce6bbf9453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e54545a79f37404898fafe0fa14eba32'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:11.407341 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-65683edb-0b47-4f63-b24c-ffce6bbf9453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e54545a79f37404898fafe0fa14eba32'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:11.417684 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-65683edb-0b47-4f63-b24c-ffce6bbf9453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e54545a79f37404898fafe0fa14eba32'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:11.433601 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1144/2330] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:17:11 2022] DELETE /identity/v3/users/e54545a79f37404898fafe0fa14eba32 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:17:11.588949 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662dffc7-20d8-439e-aff6-66860708fc13 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:11.589427 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662dffc7-20d8-439e-aff6-66860708fc13 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:11.589427 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662dffc7-20d8-439e-aff6-66860708fc13 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:11.592540 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1187/2331] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 28 12:17:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:17:11.602900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b726f-8e7f-4542-ba9f-9e699dcad03d None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:11.605083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b726f-8e7f-4542-ba9f-9e699dcad03d None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:11.605584 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b726f-8e7f-4542-ba9f-9e699dcad03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:11.633199 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-f73b726f-8e7f-4542-ba9f-9e699dcad03d None None] MFA Rules not processed for user `09e495edc6fd47c892679bb908c3f5bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:11.634539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-f73b726f-8e7f-4542-ba9f-9e699dcad03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:11.663136 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662dffc7-20d8-439e-aff6-66860708fc13 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:11.664901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-662dffc7-20d8-439e-aff6-66860708fc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:11.767562 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662dffc7-20d8-439e-aff6-66860708fc13 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:11.773354 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c2154-3409-45e9-b2c7-857b55ce42ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:11.774073 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c2154-3409-45e9-b2c7-857b55ce42ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:11.774405 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c2154-3409-45e9-b2c7-857b55ce42ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:11.775060 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c2154-3409-45e9-b2c7-857b55ce42ad admin admin] PATH_INFO: `/v3/users/09c9db375bb84d3abdaa29f3af5a73e5` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:11.778116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c2154-3409-45e9-b2c7-857b55ce42ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=09c9db375bb84d3abdaa29f3af5a73e5)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:11.780514 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c2154-3409-45e9-b2c7-857b55ce42ad admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:11.787028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1145/2332] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 28 12:17:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:11.809310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b726f-8e7f-4542-ba9f-9e699dcad03d None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:11.812682 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-f73b726f-8e7f-4542-ba9f-9e699dcad03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:11.833189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b726f-8e7f-4542-ba9f-9e699dcad03d None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:11.842119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154ae30-68b8-46d8-b9a1-e8a20a62a873 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09e495edc6fd47c892679bb908c3f5bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:11.843332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154ae30-68b8-46d8-b9a1-e8a20a62a873 service placement] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:11.843881 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154ae30-68b8-46d8-b9a1-e8a20a62a873 service placement] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:11.844518 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154ae30-68b8-46d8-b9a1-e8a20a62a873 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:11.859841 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154ae30-68b8-46d8-b9a1-e8a20a62a873 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:11.862396 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154ae30-68b8-46d8-b9a1-e8a20a62a873 service placement] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:11.873292 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:11.899300 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1146/2333] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:17:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:17:11.906237 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-473c2154-3409-45e9-b2c7-857b55ce42ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09c9db375bb84d3abdaa29f3af5a73e5'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:11.907707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-473c2154-3409-45e9-b2c7-857b55ce42ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09c9db375bb84d3abdaa29f3af5a73e5'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:11.945966 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-473c2154-3409-45e9-b2c7-857b55ce42ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09c9db375bb84d3abdaa29f3af5a73e5'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:11.985938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-473c2154-3409-45e9-b2c7-857b55ce42ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09c9db375bb84d3abdaa29f3af5a73e5'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:11.987994 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-473c2154-3409-45e9-b2c7-857b55ce42ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09c9db375bb84d3abdaa29f3af5a73e5'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:12.040151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154ae30-68b8-46d8-b9a1-e8a20a62a873 service placement] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:12.042332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-3154ae30-68b8-46d8-b9a1-e8a20a62a873 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:12.047970 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1188/2334] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:17:11 2022] DELETE /identity/v3/users/09c9db375bb84d3abdaa29f3af5a73e5 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:17:12.072826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154ae30-68b8-46d8-b9a1-e8a20a62a873 service placement] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:12.170984 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538e2bb-1c52-4651-8169-741ae70e1711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:12.171689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538e2bb-1c52-4651-8169-741ae70e1711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:12.171916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538e2bb-1c52-4651-8169-741ae70e1711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:12.172326 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538e2bb-1c52-4651-8169-741ae70e1711 admin admin] PATH_INFO: `/v3/projects/371f8275352b449a98dfc2a33b87f0d9` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:12.173655 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538e2bb-1c52-4651-8169-741ae70e1711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=371f8275352b449a98dfc2a33b87f0d9)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:12.175598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538e2bb-1c52-4651-8169-741ae70e1711 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:12.186209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:12.248598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-6538e2bb-1c52-4651-8169-741ae70e1711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '371f8275352b449a98dfc2a33b87f0d9', 'request_id': 'req-6538e2bb-1c52-4651-8169-741ae70e1711'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:12.256222 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-6538e2bb-1c52-4651-8169-741ae70e1711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '371f8275352b449a98dfc2a33b87f0d9', 'request_id': 'req-6538e2bb-1c52-4651-8169-741ae70e1711'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:12.274084 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-6538e2bb-1c52-4651-8169-741ae70e1711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '371f8275352b449a98dfc2a33b87f0d9', 'request_id': 'req-6538e2bb-1c52-4651-8169-741ae70e1711'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:12.287425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-6538e2bb-1c52-4651-8169-741ae70e1711 admin admin] The token cache is being invalidate because project 371f8275352b449a98dfc2a33b87f0d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:17:12.287745 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-6538e2bb-1c52-4651-8169-741ae70e1711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:12.288400 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-6538e2bb-1c52-4651-8169-741ae70e1711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:12.290123 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1147/2335] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:17:12 2022] DELETE /identity/v3/projects/371f8275352b449a98dfc2a33b87f0d9 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:17:12.296296 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75904e-a535-47e9-a3c7-ec123b7e84cd None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:12.297087 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75904e-a535-47e9-a3c7-ec123b7e84cd None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:12.297536 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75904e-a535-47e9-a3c7-ec123b7e84cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:12.323009 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-6b75904e-a535-47e9-a3c7-ec123b7e84cd None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:12.324276 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6b75904e-a535-47e9-a3c7-ec123b7e84cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:12.403398 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538e2bb-1c52-4651-8169-741ae70e1711 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:12.404906 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-6538e2bb-1c52-4651-8169-741ae70e1711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:12.431403 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1189/2336] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:12.441851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96fde9-ed24-40c1-962f-7c1ed6e8a475 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:12.442441 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96fde9-ed24-40c1-962f-7c1ed6e8a475 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:12.443012 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96fde9-ed24-40c1-962f-7c1ed6e8a475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:12.488194 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-2a96fde9-ed24-40c1-962f-7c1ed6e8a475 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:12.489432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-2a96fde9-ed24-40c1-962f-7c1ed6e8a475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:12.500326 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1190/2337] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:12.504379 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96fde9-ed24-40c1-962f-7c1ed6e8a475 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:12.514843 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96fde9-ed24-40c1-962f-7c1ed6e8a475 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:12.520737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47abb15-d576-49a7-82db-27671dda8044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:12.521502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47abb15-d576-49a7-82db-27671dda8044 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:12.521879 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47abb15-d576-49a7-82db-27671dda8044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:12.522248 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47abb15-d576-49a7-82db-27671dda8044 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:12.523011 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47abb15-d576-49a7-82db-27671dda8044 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:17:12.523510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47abb15-d576-49a7-82db-27671dda8044 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:12.525179 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47abb15-d576-49a7-82db-27671dda8044 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:12.538693 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1191/2338] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:17:12.543585 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538e2bb-1c52-4651-8169-741ae70e1711 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:12.548235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47abb15-d576-49a7-82db-27671dda8044 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:12.549913 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398977fe-ea7e-422e-850d-2980b88d9b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:12.551486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398977fe-ea7e-422e-850d-2980b88d9b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:12.551486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398977fe-ea7e-422e-850d-2980b88d9b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:12.551486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398977fe-ea7e-422e-850d-2980b88d9b9f admin admin] PATH_INFO: `/v3/projects/1504d59b5c094a3693878e524a4bac33` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:12.552912 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398977fe-ea7e-422e-850d-2980b88d9b9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1504d59b5c094a3693878e524a4bac33)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:12.554962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398977fe-ea7e-422e-850d-2980b88d9b9f admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:12.565730 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47abb15-d576-49a7-82db-27671dda8044 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:12.575532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884a8de-22df-4633-ae37-943195dc188c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:12.577497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884a8de-22df-4633-ae37-943195dc188c admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:12.578339 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884a8de-22df-4633-ae37-943195dc188c admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:12.578629 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884a8de-22df-4633-ae37-943195dc188c admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:12.579281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884a8de-22df-4633-ae37-943195dc188c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:12.581233 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884a8de-22df-4633-ae37-943195dc188c admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:12.616585 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1192/2339] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:17:12 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:17:12.621570 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884a8de-22df-4633-ae37-943195dc188c admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:12.623487 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-398977fe-ea7e-422e-850d-2980b88d9b9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1504d59b5c094a3693878e524a4bac33', 'request_id': 'req-398977fe-ea7e-422e-850d-2980b88d9b9f'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:12.631379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-398977fe-ea7e-422e-850d-2980b88d9b9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1504d59b5c094a3693878e524a4bac33', 'request_id': 'req-398977fe-ea7e-422e-850d-2980b88d9b9f'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:12.641039 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-398977fe-ea7e-422e-850d-2980b88d9b9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1504d59b5c094a3693878e524a4bac33', 'request_id': 'req-398977fe-ea7e-422e-850d-2980b88d9b9f'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:12.656185 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-398977fe-ea7e-422e-850d-2980b88d9b9f admin admin] The token cache is being invalidate because project 1504d59b5c094a3693878e524a4bac33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:17:12.656791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-398977fe-ea7e-422e-850d-2980b88d9b9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:12.657655 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-398977fe-ea7e-422e-850d-2980b88d9b9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:12.659595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1148/2340] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:17:12 2022] DELETE /identity/v3/projects/1504d59b5c094a3693878e524a4bac33 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:17:12.664340 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0caa98-d3c7-4792-b1a1-3cd94e89b473 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:12.665030 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0caa98-d3c7-4792-b1a1-3cd94e89b473 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:12.665456 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0caa98-d3c7-4792-b1a1-3cd94e89b473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:12.690319 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-3d0caa98-d3c7-4792-b1a1-3cd94e89b473 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:12.691780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-3d0caa98-d3c7-4792-b1a1-3cd94e89b473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:12.714822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:12.748086 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884a8de-22df-4633-ae37-943195dc188c admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:12.753214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c5b25-1002-422f-ae5d-c5a04817ab3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:12.753829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c5b25-1002-422f-ae5d-c5a04817ab3f admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:12.754113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c5b25-1002-422f-ae5d-c5a04817ab3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:12.754387 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c5b25-1002-422f-ae5d-c5a04817ab3f admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:12.755105 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c5b25-1002-422f-ae5d-c5a04817ab3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:12.757467 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c5b25-1002-422f-ae5d-c5a04817ab3f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:12.779564 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1149/2341] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:17:12.779795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:12.782123 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6d211-b601-445e-9254-b0b37484b081 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:12.782560 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6d211-b601-445e-9254-b0b37484b081 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:12.784182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6d211-b601-445e-9254-b0b37484b081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:12.799974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1193/2342] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:17:12 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:17:12.803663 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c5b25-1002-422f-ae5d-c5a04817ab3f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:12.805555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-996c5b25-1002-422f-ae5d-c5a04817ab3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:12.820640 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-9dd6d211-b601-445e-9254-b0b37484b081 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:12.822058 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-9dd6d211-b601-445e-9254-b0b37484b081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:12.825553 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c5b25-1002-422f-ae5d-c5a04817ab3f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:12.834911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1150/2343] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:12.835142 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc557e-5deb-4261-bb5a-7d326c8e6bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:12.835142 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc557e-5deb-4261-bb5a-7d326c8e6bbd admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:12.835142 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc557e-5deb-4261-bb5a-7d326c8e6bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:12.835142 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc557e-5deb-4261-bb5a-7d326c8e6bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:12.836383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc557e-5deb-4261-bb5a-7d326c8e6bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:12.836770 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6d211-b601-445e-9254-b0b37484b081 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:12.837874 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc557e-5deb-4261-bb5a-7d326c8e6bbd admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:12.849531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6d211-b601-445e-9254-b0b37484b081 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:12.859359 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1194/2344] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:17:12.859937 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c1617-fbf9-4ee9-b9f3-2a9f35e135ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:12.860623 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c1617-fbf9-4ee9-b9f3-2a9f35e135ee admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:12.860936 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c1617-fbf9-4ee9-b9f3-2a9f35e135ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:12.861205 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c1617-fbf9-4ee9-b9f3-2a9f35e135ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:12.862086 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c1617-fbf9-4ee9-b9f3-2a9f35e135ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:17:12.862394 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c1617-fbf9-4ee9-b9f3-2a9f35e135ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:12.867543 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c1617-fbf9-4ee9-b9f3-2a9f35e135ee admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:12.867725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc557e-5deb-4261-bb5a-7d326c8e6bbd admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:12.879224 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc557e-5deb-4261-bb5a-7d326c8e6bbd admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:12.883677 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1151/2345] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:17:12.888723 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c1617-fbf9-4ee9-b9f3-2a9f35e135ee admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:12.891420 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18502c92-8d43-49d9-b938-e9cc9036e380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:12.892144 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18502c92-8d43-49d9-b938-e9cc9036e380 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:12.892450 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18502c92-8d43-49d9-b938-e9cc9036e380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:12.892720 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18502c92-8d43-49d9-b938-e9cc9036e380 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:12.893363 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18502c92-8d43-49d9-b938-e9cc9036e380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:12.894945 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18502c92-8d43-49d9-b938-e9cc9036e380 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:12.902051 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c1617-fbf9-4ee9-b9f3-2a9f35e135ee admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:12.906882 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1195/2346] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:17:12.909007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d539cf1-a041-48ad-9c71-8aacc7b0c348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:12.909959 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d539cf1-a041-48ad-9c71-8aacc7b0c348 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:12.910425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d539cf1-a041-48ad-9c71-8aacc7b0c348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:12.910828 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18502c92-8d43-49d9-b938-e9cc9036e380 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:12.911127 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d539cf1-a041-48ad-9c71-8aacc7b0c348 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:12.912018 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d539cf1-a041-48ad-9c71-8aacc7b0c348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:12.914331 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d539cf1-a041-48ad-9c71-8aacc7b0c348 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:12.922393 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18502c92-8d43-49d9-b938-e9cc9036e380 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:12.928513 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cdd28-d596-4a78-af70-8feff46e97cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:12.929462 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cdd28-d596-4a78-af70-8feff46e97cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:12.929745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cdd28-d596-4a78-af70-8feff46e97cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:12.930013 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cdd28-d596-4a78-af70-8feff46e97cf admin admin] PATH_INFO: `/v3/projects/6b49704b1ff143748dd87de2bc0f4300/users/e0ca8e4cc0e14fde937b0f3da2a28812/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:12.945739 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1152/2347] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:17:12 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:17:12.949248 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581cdd28-d596-4a78-af70-8feff46e97cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b49704b1ff143748dd87de2bc0f4300, user_id=e0ca8e4cc0e14fde937b0f3da2a28812, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:12.950337 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d539cf1-a041-48ad-9c71-8aacc7b0c348 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:12.951910 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581cdd28-d596-4a78-af70-8feff46e97cf admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:12.976466 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1196/2348] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:17:12 2022] PUT /identity/v3/projects/6b49704b1ff143748dd87de2bc0f4300/users/e0ca8e4cc0e14fde937b0f3da2a28812/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:17:12.982219 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4629559-47a2-41c4-8de8-913ebffccbbf None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:12.982578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4629559-47a2-41c4-8de8-913ebffccbbf None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:12.982919 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4629559-47a2-41c4-8de8-913ebffccbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:13.007320 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-e4629559-47a2-41c4-8de8-913ebffccbbf None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:13.008585 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e4629559-47a2-41c4-8de8-913ebffccbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:13.030723 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d539cf1-a041-48ad-9c71-8aacc7b0c348 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:13.092426 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1197/2349] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:13.099725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4629559-47a2-41c4-8de8-913ebffccbbf None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:13.101789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e4629559-47a2-41c4-8de8-913ebffccbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:13.110041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6fb7a-9b5f-418e-86ba-44687fc1d7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:13.110949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6fb7a-9b5f-418e-86ba-44687fc1d7d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:13.111295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6fb7a-9b5f-418e-86ba-44687fc1d7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:13.112129 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6fb7a-9b5f-418e-86ba-44687fc1d7d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:13.113477 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6fb7a-9b5f-418e-86ba-44687fc1d7d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:13.116007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6fb7a-9b5f-418e-86ba-44687fc1d7d0 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:13.146156 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1153/2350] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:17:12 2022] POST /identity/v3/users => generated 285 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:17:13.150295 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6fb7a-9b5f-418e-86ba-44687fc1d7d0 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:13.166850 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6fb7a-9b5f-418e-86ba-44687fc1d7d0 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:13.172336 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6e250-b8cc-4f8d-b506-daf47305e5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:13.172944 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6e250-b8cc-4f8d-b506-daf47305e5ff admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:13.173219 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6e250-b8cc-4f8d-b506-daf47305e5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:13.173600 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6e250-b8cc-4f8d-b506-daf47305e5ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:13.174253 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6e250-b8cc-4f8d-b506-daf47305e5ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:13.176015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6e250-b8cc-4f8d-b506-daf47305e5ff admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:13.177983 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4629559-47a2-41c4-8de8-913ebffccbbf None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:13.182873 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3652967-f264-4671-a855-3f53b328b9cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:13.184313 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3652967-f264-4671-a855-3f53b328b9cf service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:13.184824 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3652967-f264-4671-a855-3f53b328b9cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:13.185295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3652967-f264-4671-a855-3f53b328b9cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:13.192317 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1154/2351] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:17:13.195121 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6e250-b8cc-4f8d-b506-daf47305e5ff admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:13.200314 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3652967-f264-4671-a855-3f53b328b9cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:13.202270 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3652967-f264-4671-a855-3f53b328b9cf service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:13.206082 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6e250-b8cc-4f8d-b506-daf47305e5ff admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:13.211095 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654b970-b6c1-42bb-9e03-7061b8c24a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:13.211862 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654b970-b6c1-42bb-9e03-7061b8c24a91 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:13.212141 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654b970-b6c1-42bb-9e03-7061b8c24a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:13.212411 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654b970-b6c1-42bb-9e03-7061b8c24a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:13.213762 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654b970-b6c1-42bb-9e03-7061b8c24a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:13.215700 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654b970-b6c1-42bb-9e03-7061b8c24a91 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:13.216120 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1198/2352] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:17:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:17:13.222079 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:13.235609 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1155/2353] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:17:13.238715 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3652967-f264-4671-a855-3f53b328b9cf service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:13.249812 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3652967-f264-4671-a855-3f53b328b9cf service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:13.257222 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee15bf5-ad92-41b1-b512-133f3c392d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:13.258082 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee15bf5-ad92-41b1-b512-133f3c392d58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:13.258365 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee15bf5-ad92-41b1-b512-133f3c392d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:13.258642 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee15bf5-ad92-41b1-b512-133f3c392d58 admin admin] PATH_INFO: `/v3/projects/c794b84438f345cd8e5e73e73cef91e4/users/9fbae1c50d0b4756980eeecfd0407bf5/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:13.303270 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee15bf5-ad92-41b1-b512-133f3c392d58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c794b84438f345cd8e5e73e73cef91e4, user_id=9fbae1c50d0b4756980eeecfd0407bf5, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:13.306409 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee15bf5-ad92-41b1-b512-133f3c392d58 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:13.335640 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1199/2354] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:17:13 2022] PUT /identity/v3/projects/c794b84438f345cd8e5e73e73cef91e4/users/9fbae1c50d0b4756980eeecfd0407bf5/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:17:13.337728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bca19-a801-4c4c-a03d-5253a4e9d2fe None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:13.338527 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bca19-a801-4c4c-a03d-5253a4e9d2fe None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:13.338854 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bca19-a801-4c4c-a03d-5253a4e9d2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:13.371230 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-292bca19-a801-4c4c-a03d-5253a4e9d2fe None None] MFA Rules not processed for user `9fbae1c50d0b4756980eeecfd0407bf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:13.372589 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-292bca19-a801-4c4c-a03d-5253a4e9d2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:13.460717 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1156/2355] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:13.477282 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee15bf5-ad92-41b1-b512-133f3c392d58 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:13.479877 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6ee15bf5-ad92-41b1-b512-133f3c392d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:13.594369 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:13.683378 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee15bf5-ad92-41b1-b512-133f3c392d58 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:13.687885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ddab87-7242-463a-ae9e-07161613500f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9180b1616c524905b86769a9eb8f7757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:13.693175 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ddab87-7242-463a-ae9e-07161613500f service glance] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:13.693175 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ddab87-7242-463a-ae9e-07161613500f service glance] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:13.693175 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ddab87-7242-463a-ae9e-07161613500f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:13.722566 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ddab87-7242-463a-ae9e-07161613500f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:13.723933 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ddab87-7242-463a-ae9e-07161613500f service glance] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:13.746364 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1200/2356] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:17:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:17:14.243106 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887caff4-e90c-491d-85f7-28e6685a9f6f None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:14.243671 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887caff4-e90c-491d-85f7-28e6685a9f6f None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:14.243771 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887caff4-e90c-491d-85f7-28e6685a9f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:14.287611 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-887caff4-e90c-491d-85f7-28e6685a9f6f None None] MFA Rules not processed for user `e0ca8e4cc0e14fde937b0f3da2a28812`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:14.289054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-887caff4-e90c-491d-85f7-28e6685a9f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:14.431763 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ddab87-7242-463a-ae9e-07161613500f service glance] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:14.436457 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1157/2357] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:14.540875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ddab87-7242-463a-ae9e-07161613500f service glance] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:14.549313 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bbbdf-4359-44c8-b4e1-2e15be0f08f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:14.549946 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bbbdf-4359-44c8-b4e1-2e15be0f08f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:14.550229 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bbbdf-4359-44c8-b4e1-2e15be0f08f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:14.550505 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bbbdf-4359-44c8-b4e1-2e15be0f08f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:14.551152 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bbbdf-4359-44c8-b4e1-2e15be0f08f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:14.567030 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bbbdf-4359-44c8-b4e1-2e15be0f08f7 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:14.636427 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1201/2358] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:17:14 2022] POST /identity/v3/projects => generated 371 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:17:14.638414 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887caff4-e90c-491d-85f7-28e6685a9f6f None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:14.652368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887caff4-e90c-491d-85f7-28e6685a9f6f None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:14.761208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53771de4-b4fa-40f0-918a-aa649bc723f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:14.762411 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53771de4-b4fa-40f0-918a-aa649bc723f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:14.762787 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53771de4-b4fa-40f0-918a-aa649bc723f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:14.763180 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53771de4-b4fa-40f0-918a-aa649bc723f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:14.764050 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53771de4-b4fa-40f0-918a-aa649bc723f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:14.765954 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53771de4-b4fa-40f0-918a-aa649bc723f8 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:14.803510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1158/2359] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:17:14 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:17:14.809715 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bbbdf-4359-44c8-b4e1-2e15be0f08f7 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:14.837331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bbbdf-4359-44c8-b4e1-2e15be0f08f7 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:14.845767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9aa146-f8b1-4e15-b233-369073213e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:14.846390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9aa146-f8b1-4e15-b233-369073213e29 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:14.846669 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9aa146-f8b1-4e15-b233-369073213e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:14.849132 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9aa146-f8b1-4e15-b233-369073213e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:14.849835 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9aa146-f8b1-4e15-b233-369073213e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:14.851966 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9aa146-f8b1-4e15-b233-369073213e29 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:14.867811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1202/2360] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:17:14.868685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53771de4-b4fa-40f0-918a-aa649bc723f8 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:14.886522 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53771de4-b4fa-40f0-918a-aa649bc723f8 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:14.891459 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e10aa2-09c0-4a18-9c0c-ab052a5aae87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:14.892139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e10aa2-09c0-4a18-9c0c-ab052a5aae87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:14.892434 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e10aa2-09c0-4a18-9c0c-ab052a5aae87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:14.892696 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e10aa2-09c0-4a18-9c0c-ab052a5aae87 admin admin] PATH_INFO: `/v3/projects/6ae9864efb94420684eb032c80355290/users/45ad5c619e724031b43ec04ea36e0f8b/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:14.905145 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:14.948862 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e10aa2-09c0-4a18-9c0c-ab052a5aae87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae9864efb94420684eb032c80355290, user_id=45ad5c619e724031b43ec04ea36e0f8b, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:14.952463 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e10aa2-09c0-4a18-9c0c-ab052a5aae87 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:14.977564 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1159/2361] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:17:14 2022] PUT /identity/v3/projects/6ae9864efb94420684eb032c80355290/users/45ad5c619e724031b43ec04ea36e0f8b/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:17:14.978573 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9aa146-f8b1-4e15-b233-369073213e29 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:14.990104 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9aa146-f8b1-4e15-b233-369073213e29 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:15.230740 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc048130-918a-4c90-9c8d-70c546f5e783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:15.231379 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc048130-918a-4c90-9c8d-70c546f5e783 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:15.231712 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc048130-918a-4c90-9c8d-70c546f5e783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:15.231974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc048130-918a-4c90-9c8d-70c546f5e783 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:15.232816 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc048130-918a-4c90-9c8d-70c546f5e783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:15.236117 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc048130-918a-4c90-9c8d-70c546f5e783 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:15.274706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e10aa2-09c0-4a18-9c0c-ab052a5aae87 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:15.287674 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1203/2362] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:17:15.291238 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e10aa2-09c0-4a18-9c0c-ab052a5aae87 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:15.300044 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9224d4-424b-4e11-96ec-6512745b54bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:15.300727 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9224d4-424b-4e11-96ec-6512745b54bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:15.301015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9224d4-424b-4e11-96ec-6512745b54bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:15.305496 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9224d4-424b-4e11-96ec-6512745b54bf admin admin] PATH_INFO: `/v3/projects/6ae9864efb94420684eb032c80355290/users/45ad5c619e724031b43ec04ea36e0f8b/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:15.328726 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9224d4-424b-4e11-96ec-6512745b54bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae9864efb94420684eb032c80355290, user_id=45ad5c619e724031b43ec04ea36e0f8b, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:15.332825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9224d4-424b-4e11-96ec-6512745b54bf admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:15.347995 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1160/2363] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:17:15 2022] PUT /identity/v3/projects/6ae9864efb94420684eb032c80355290/users/45ad5c619e724031b43ec04ea36e0f8b/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:17:16.248542 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfe90b-a317-4d44-bab8-3e4b252e3323 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:16.249511 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfe90b-a317-4d44-bab8-3e4b252e3323 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:16.250068 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfe90b-a317-4d44-bab8-3e4b252e3323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:16.306719 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-37bfe90b-a317-4d44-bab8-3e4b252e3323 None None] MFA Rules not processed for user `45ad5c619e724031b43ec04ea36e0f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:16.312456 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-37bfe90b-a317-4d44-bab8-3e4b252e3323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:16.326279 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:16.430565 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1204/2364] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:16.441241 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce394b-ff86-4e65-80ba-ed7b40a1f81c None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:16.441813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce394b-ff86-4e65-80ba-ed7b40a1f81c None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:16.441813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce394b-ff86-4e65-80ba-ed7b40a1f81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:16.467530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-84ce394b-ff86-4e65-80ba-ed7b40a1f81c None None] MFA Rules not processed for user `e0ca8e4cc0e14fde937b0f3da2a28812`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:16.468735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-84ce394b-ff86-4e65-80ba-ed7b40a1f81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:16.560116 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1161/2365] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:16.570999 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfe90b-a317-4d44-bab8-3e4b252e3323 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:16.572566 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-37bfe90b-a317-4d44-bab8-3e4b252e3323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:16.656511 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfe90b-a317-4d44-bab8-3e4b252e3323 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:16.662454 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5a0d5-60a4-4651-bbcb-e73c59964686 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:16.663078 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5a0d5-60a4-4651-bbcb-e73c59964686 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:16.663360 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5a0d5-60a4-4651-bbcb-e73c59964686 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:16.663821 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5a0d5-60a4-4651-bbcb-e73c59964686 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:16.672994 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5a0d5-60a4-4651-bbcb-e73c59964686 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:16.675209 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5a0d5-60a4-4651-bbcb-e73c59964686 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:16.685759 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1205/2366] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:17:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:17:20.685278 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111e148-52f4-444e-885f-b1b030c485a4 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:20.686043 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111e148-52f4-444e-885f-b1b030c485a4 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:20.686319 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111e148-52f4-444e-885f-b1b030c485a4 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:20.687771 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1162/2367] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 28 12:17:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:17:20.695237 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89527e05-7e88-4225-aefe-bcdaf3643f13 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:20.695769 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89527e05-7e88-4225-aefe-bcdaf3643f13 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:20.696810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89527e05-7e88-4225-aefe-bcdaf3643f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:20.722592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-89527e05-7e88-4225-aefe-bcdaf3643f13 None None] MFA Rules not processed for user `0e81804e04514ae882a1fd93789db025`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:20.723836 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-89527e05-7e88-4225-aefe-bcdaf3643f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:20.738176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1206/2368] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 28 12:17:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:20.770244 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111e148-52f4-444e-885f-b1b030c485a4 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:20.772144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-c111e148-52f4-444e-885f-b1b030c485a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:20.871937 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111e148-52f4-444e-885f-b1b030c485a4 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:20.875650 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93924372-2979-49c7-ba04-f68c417ba693 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9180b1616c524905b86769a9eb8f7757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:20.876264 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93924372-2979-49c7-ba04-f68c417ba693 service glance] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:20.876545 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93924372-2979-49c7-ba04-f68c417ba693 service glance] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:20.876819 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93924372-2979-49c7-ba04-f68c417ba693 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:20.888373 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93924372-2979-49c7-ba04-f68c417ba693 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:20.890181 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93924372-2979-49c7-ba04-f68c417ba693 service glance] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:20.903182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1163/2369] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:17:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:17:20.975584 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e8fe0-3709-4b0c-93e3-8af60be3ef7e None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:20.975863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e8fe0-3709-4b0c-93e3-8af60be3ef7e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:20.976132 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e8fe0-3709-4b0c-93e3-8af60be3ef7e None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:20.977926 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1207/2370] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 28 12:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:17:20.988337 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91067a95-412d-4311-ad69-34331409fc38 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:20.988337 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91067a95-412d-4311-ad69-34331409fc38 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:20.988679 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91067a95-412d-4311-ad69-34331409fc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:21.009078 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-91067a95-412d-4311-ad69-34331409fc38 None None] MFA Rules not processed for user `ca51ff621664452db7dd991714462e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:21.010909 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-91067a95-412d-4311-ad69-34331409fc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:21.070165 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1164/2371] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 28 12:17:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:21.082411 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e8fe0-3709-4b0c-93e3-8af60be3ef7e None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:21.093735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e8fe0-3709-4b0c-93e3-8af60be3ef7e None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:21.097761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601316a-9402-4686-882f-61d86cb3b71f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:21.098496 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601316a-9402-4686-882f-61d86cb3b71f service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:21.098853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601316a-9402-4686-882f-61d86cb3b71f service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:21.099193 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601316a-9402-4686-882f-61d86cb3b71f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:21.108327 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601316a-9402-4686-882f-61d86cb3b71f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:21.109757 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601316a-9402-4686-882f-61d86cb3b71f service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:21.118533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1208/2372] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:17:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:17:21.526048 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb43c6-5fcc-4055-8377-9ceb3a34c59a None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:21.526593 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb43c6-5fcc-4055-8377-9ceb3a34c59a None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:21.527023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb43c6-5fcc-4055-8377-9ceb3a34c59a None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:21.531101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1165/2373] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 28 12:17:21 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:17:21.538633 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373ba4d-3859-4383-8b06-4c58744109d6 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:21.538882 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373ba4d-3859-4383-8b06-4c58744109d6 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:21.539186 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373ba4d-3859-4383-8b06-4c58744109d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:21.571885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-0373ba4d-3859-4383-8b06-4c58744109d6 None None] MFA Rules not processed for user `0e81804e04514ae882a1fd93789db025`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:21.573365 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0373ba4d-3859-4383-8b06-4c58744109d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:21.584088 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1209/2374] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 28 12:17:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:21.596051 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb43c6-5fcc-4055-8377-9ceb3a34c59a None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:21.610615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb43c6-5fcc-4055-8377-9ceb3a34c59a None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:21.614067 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34cd95-e783-4d3b-8024-8d94c0749029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:21.614673 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34cd95-e783-4d3b-8024-8d94c0749029 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:21.614959 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34cd95-e783-4d3b-8024-8d94c0749029 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:21.615227 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34cd95-e783-4d3b-8024-8d94c0749029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:21.626462 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc34cd95-e783-4d3b-8024-8d94c0749029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:21.627956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc34cd95-e783-4d3b-8024-8d94c0749029 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:21.639614 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1166/2375] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:17:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:17:25.146775 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cddeb-ebd5-442f-92f4-e0ef67db7bbe None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:25.147253 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cddeb-ebd5-442f-92f4-e0ef67db7bbe None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:25.147351 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cddeb-ebd5-442f-92f4-e0ef67db7bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:25.167816 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-136cddeb-ebd5-442f-92f4-e0ef67db7bbe None None] MFA Rules not processed for user `c0e57ea982d349c1a86b544e9a6e7758`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:25.169029 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-136cddeb-ebd5-442f-92f4-e0ef67db7bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:25.233106 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1210/2376] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 28 12:17:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:25.255261 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34cd95-e783-4d3b-8024-8d94c0749029 service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:25.256713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-cc34cd95-e783-4d3b-8024-8d94c0749029 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:25.271720 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:25.326673 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34cd95-e783-4d3b-8024-8d94c0749029 service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:25.331898 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0955cea-91c0-4061-acc8-7b9387847b37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '822e394e80fd41adb54d330adaf65a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:25.332507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0955cea-91c0-4061-acc8-7b9387847b37 service swift] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:25.332788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0955cea-91c0-4061-acc8-7b9387847b37 service swift] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:25.333063 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0955cea-91c0-4061-acc8-7b9387847b37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:25.342059 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0955cea-91c0-4061-acc8-7b9387847b37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:25.343675 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0955cea-91c0-4061-acc8-7b9387847b37 service swift] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:25.351843 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1167/2377] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 28 12:17:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 12:17:35.220098 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=95 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:35.348445 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=26 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:39.295290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cddeb-ebd5-442f-92f4-e0ef67db7bbe None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:39.357611 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cddeb-ebd5-442f-92f4-e0ef67db7bbe None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:39.362130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7787fda-e8ce-4ed6-93e3-9bea63ba2c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:39.362749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7787fda-e8ce-4ed6-93e3-9bea63ba2c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:39.363028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7787fda-e8ce-4ed6-93e3-9bea63ba2c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:39.363299 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7787fda-e8ce-4ed6-93e3-9bea63ba2c59 admin admin] PATH_INFO: `/v3/users/9fbae1c50d0b4756980eeecfd0407bf5` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:39.364433 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7787fda-e8ce-4ed6-93e3-9bea63ba2c59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fbae1c50d0b4756980eeecfd0407bf5)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:39.366342 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7787fda-e8ce-4ed6-93e3-9bea63ba2c59 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:39.413281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b7787fda-e8ce-4ed6-93e3-9bea63ba2c59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fbae1c50d0b4756980eeecfd0407bf5'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:39.413944 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b7787fda-e8ce-4ed6-93e3-9bea63ba2c59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fbae1c50d0b4756980eeecfd0407bf5'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:39.421817 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b7787fda-e8ce-4ed6-93e3-9bea63ba2c59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fbae1c50d0b4756980eeecfd0407bf5'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:39.430594 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b7787fda-e8ce-4ed6-93e3-9bea63ba2c59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fbae1c50d0b4756980eeecfd0407bf5'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:39.431347 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b7787fda-e8ce-4ed6-93e3-9bea63ba2c59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fbae1c50d0b4756980eeecfd0407bf5'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:39.452345 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1211/2378] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:17:39 2022] DELETE /identity/v3/users/9fbae1c50d0b4756980eeecfd0407bf5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:17:39.456881 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed88b25-c229-4a9c-a6ac-94072cb7f70e None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:39.457406 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed88b25-c229-4a9c-a6ac-94072cb7f70e None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:39.457496 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed88b25-c229-4a9c-a6ac-94072cb7f70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:39.477875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-eed88b25-c229-4a9c-a6ac-94072cb7f70e None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:39.479707 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-eed88b25-c229-4a9c-a6ac-94072cb7f70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:39.544236 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1168/2379] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:39.553765 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7787fda-e8ce-4ed6-93e3-9bea63ba2c59 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:39.555276 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b7787fda-e8ce-4ed6-93e3-9bea63ba2c59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:39.626381 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7787fda-e8ce-4ed6-93e3-9bea63ba2c59 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:39.630468 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7881b54-d6f6-4a52-b81c-872aa37b86a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:39.631072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7881b54-d6f6-4a52-b81c-872aa37b86a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:39.631345 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7881b54-d6f6-4a52-b81c-872aa37b86a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:39.631635 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7881b54-d6f6-4a52-b81c-872aa37b86a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:39.642807 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7881b54-d6f6-4a52-b81c-872aa37b86a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:39.644372 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7881b54-d6f6-4a52-b81c-872aa37b86a1 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:39.660303 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1212/2380] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:17:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:17:39.902577 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed88b25-c229-4a9c-a6ac-94072cb7f70e None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:39.904300 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-eed88b25-c229-4a9c-a6ac-94072cb7f70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:39.972981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed88b25-c229-4a9c-a6ac-94072cb7f70e None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:39.980136 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7881b54-d6f6-4a52-b81c-872aa37b86a1 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:39.980648 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61854ef6-40f6-48ae-b6ae-90164e65fe07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:39.981330 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61854ef6-40f6-48ae-b6ae-90164e65fe07 service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:39.981613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61854ef6-40f6-48ae-b6ae-90164e65fe07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:39.981722 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c7881b54-d6f6-4a52-b81c-872aa37b86a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:39.981881 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61854ef6-40f6-48ae-b6ae-90164e65fe07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:39.986518 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-61854ef6-40f6-48ae-b6ae-90164e65fe07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:39.995258 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7881b54-d6f6-4a52-b81c-872aa37b86a1 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:40.000046 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129187b-e53c-46ad-9653-de2688999328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:40.000685 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129187b-e53c-46ad-9653-de2688999328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:40.000968 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129187b-e53c-46ad-9653-de2688999328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:40.001657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129187b-e53c-46ad-9653-de2688999328 admin admin] PATH_INFO: `/v3/projects/c794b84438f345cd8e5e73e73cef91e4` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:40.002364 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129187b-e53c-46ad-9653-de2688999328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c794b84438f345cd8e5e73e73cef91e4)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:40.008820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129187b-e53c-46ad-9653-de2688999328 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:40.034615 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:40.071379 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8129187b-e53c-46ad-9653-de2688999328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c794b84438f345cd8e5e73e73cef91e4', 'request_id': 'req-8129187b-e53c-46ad-9653-de2688999328'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:40.074923 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61854ef6-40f6-48ae-b6ae-90164e65fe07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:40.076407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61854ef6-40f6-48ae-b6ae-90164e65fe07 service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:40.078044 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8129187b-e53c-46ad-9653-de2688999328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c794b84438f345cd8e5e73e73cef91e4', 'request_id': 'req-8129187b-e53c-46ad-9653-de2688999328'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:40.086263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1169/2381] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:17:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:17:40.089088 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8129187b-e53c-46ad-9653-de2688999328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c794b84438f345cd8e5e73e73cef91e4', 'request_id': 'req-8129187b-e53c-46ad-9653-de2688999328'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:40.105534 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8129187b-e53c-46ad-9653-de2688999328 admin admin] The token cache is being invalidate because project c794b84438f345cd8e5e73e73cef91e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:17:40.105908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8129187b-e53c-46ad-9653-de2688999328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:40.106653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8129187b-e53c-46ad-9653-de2688999328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:40.108869 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1213/2382] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:17:39 2022] DELETE /identity/v3/projects/c794b84438f345cd8e5e73e73cef91e4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:17:40.113618 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e7f51-a799-4bfe-b198-0dad89e2cbb4 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:40.113909 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e7f51-a799-4bfe-b198-0dad89e2cbb4 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:40.114185 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e7f51-a799-4bfe-b198-0dad89e2cbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:40.137762 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-710e7f51-a799-4bfe-b198-0dad89e2cbb4 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:40.139132 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-710e7f51-a799-4bfe-b198-0dad89e2cbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:40.191010 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:40.214492 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1170/2383] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:40.218156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb35ee-7abd-40a8-8811-6d5b6987995a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:40.218934 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb35ee-7abd-40a8-8811-6d5b6987995a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:40.219281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb35ee-7abd-40a8-8811-6d5b6987995a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:40.240710 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-36fb35ee-7abd-40a8-8811-6d5b6987995a None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:40.242077 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-36fb35ee-7abd-40a8-8811-6d5b6987995a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:40.252220 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1214/2384] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:40.256044 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e7f51-a799-4bfe-b198-0dad89e2cbb4 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:40.267986 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e7f51-a799-4bfe-b198-0dad89e2cbb4 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:40.272716 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cbd90-f6e9-4942-a112-94036eac6ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:40.273331 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cbd90-f6e9-4942-a112-94036eac6ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:40.273609 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cbd90-f6e9-4942-a112-94036eac6ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:40.273877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cbd90-f6e9-4942-a112-94036eac6ae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:40.274528 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cbd90-f6e9-4942-a112-94036eac6ae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:17:40.274834 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cbd90-f6e9-4942-a112-94036eac6ae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:40.277390 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cbd90-f6e9-4942-a112-94036eac6ae7 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:40.289548 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1171/2385] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:17:40.294347 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb35ee-7abd-40a8-8811-6d5b6987995a None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:40.303980 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb35ee-7abd-40a8-8811-6d5b6987995a None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:40.309350 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c482e-d3d8-42f9-a3ae-e5e5d74fef23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:40.309953 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c482e-d3d8-42f9-a3ae-e5e5d74fef23 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:40.310233 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c482e-d3d8-42f9-a3ae-e5e5d74fef23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:40.310505 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c482e-d3d8-42f9-a3ae-e5e5d74fef23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:40.311139 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c482e-d3d8-42f9-a3ae-e5e5d74fef23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:40.313181 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c482e-d3d8-42f9-a3ae-e5e5d74fef23 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:40.345311 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1215/2386] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:17:40 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:17:40.346633 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cbd90-f6e9-4942-a112-94036eac6ae7 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:40.357739 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cbd90-f6e9-4942-a112-94036eac6ae7 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:40.417408 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1eb026-3058-46db-bb73-91e0f660ac17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:40.418090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1eb026-3058-46db-bb73-91e0f660ac17 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:40.418378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1eb026-3058-46db-bb73-91e0f660ac17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:40.418655 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1eb026-3058-46db-bb73-91e0f660ac17 admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:40.419281 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1eb026-3058-46db-bb73-91e0f660ac17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:40.421252 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1eb026-3058-46db-bb73-91e0f660ac17 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:40.442879 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1172/2387] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:17:40 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:17:40.446739 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c482e-d3d8-42f9-a3ae-e5e5d74fef23 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:40.457789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c482e-d3d8-42f9-a3ae-e5e5d74fef23 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:40.462394 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bb0b6-85b6-4150-9301-9892fc259ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:40.463602 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bb0b6-85b6-4150-9301-9892fc259ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:40.463880 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bb0b6-85b6-4150-9301-9892fc259ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:40.464155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bb0b6-85b6-4150-9301-9892fc259ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:40.464789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bb0b6-85b6-4150-9301-9892fc259ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:40.466664 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bb0b6-85b6-4150-9301-9892fc259ce5 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:40.476735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1216/2388] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:17:40.480677 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1eb026-3058-46db-bb73-91e0f660ac17 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:40.490635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1eb026-3058-46db-bb73-91e0f660ac17 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:40.495708 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894a660-daf5-46db-80ba-964a66fda220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:40.496304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894a660-daf5-46db-80ba-964a66fda220 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:40.496578 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894a660-daf5-46db-80ba-964a66fda220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:40.496843 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894a660-daf5-46db-80ba-964a66fda220 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:40.497481 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894a660-daf5-46db-80ba-964a66fda220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:40.499135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894a660-daf5-46db-80ba-964a66fda220 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:40.512094 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1173/2389] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:17:40.516794 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bb0b6-85b6-4150-9301-9892fc259ce5 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:40.527656 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bb0b6-85b6-4150-9301-9892fc259ce5 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:40.532757 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790be551-25a4-4bc1-807e-fdd21b65bc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:40.533443 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790be551-25a4-4bc1-807e-fdd21b65bc91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:40.535141 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790be551-25a4-4bc1-807e-fdd21b65bc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:40.535493 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790be551-25a4-4bc1-807e-fdd21b65bc91 admin admin] PATH_INFO: `/v3/projects/7b73146c94084f1289d3a064dad7aeed/users/89aeaaad27bc4a31b6944224e02c8327/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:40.550201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790be551-25a4-4bc1-807e-fdd21b65bc91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b73146c94084f1289d3a064dad7aeed, user_id=89aeaaad27bc4a31b6944224e02c8327, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:40.552992 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790be551-25a4-4bc1-807e-fdd21b65bc91 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:40.565670 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1217/2390] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:17:40 2022] PUT /identity/v3/projects/7b73146c94084f1289d3a064dad7aeed/users/89aeaaad27bc4a31b6944224e02c8327/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:17:40.578234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa8c48-3537-47bf-ab76-d713bdb83e98 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:40.578450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa8c48-3537-47bf-ab76-d713bdb83e98 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:40.578736 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa8c48-3537-47bf-ab76-d713bdb83e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:40.608486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-c6aa8c48-3537-47bf-ab76-d713bdb83e98 None None] MFA Rules not processed for user `89aeaaad27bc4a31b6944224e02c8327`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:40.609705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-c6aa8c48-3537-47bf-ab76-d713bdb83e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:40.677404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1174/2391] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:40.689463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790be551-25a4-4bc1-807e-fdd21b65bc91 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:40.691806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-790be551-25a4-4bc1-807e-fdd21b65bc91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:40.753709 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790be551-25a4-4bc1-807e-fdd21b65bc91 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:40.757816 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdcf70-08f0-4f24-8fd4-4d14487f9a8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:40.758439 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdcf70-08f0-4f24-8fd4-4d14487f9a8f service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:40.758720 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdcf70-08f0-4f24-8fd4-4d14487f9a8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:40.759204 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdcf70-08f0-4f24-8fd4-4d14487f9a8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:40.769590 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdcf70-08f0-4f24-8fd4-4d14487f9a8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:40.772778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdcf70-08f0-4f24-8fd4-4d14487f9a8f service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:40.783244 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1218/2392] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:17:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:17:42.616833 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b8188-149c-4586-8f79-5ea0c84ff9ff None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:42.617556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b8188-149c-4586-8f79-5ea0c84ff9ff None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:42.617681 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b8188-149c-4586-8f79-5ea0c84ff9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:42.637625 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-818b8188-149c-4586-8f79-5ea0c84ff9ff None None] MFA Rules not processed for user `c0e57ea982d349c1a86b544e9a6e7758`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:42.638817 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-818b8188-149c-4586-8f79-5ea0c84ff9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:42.679453 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:42.694002 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1175/2393] 10.222.0.16 () {58 vars in 967 bytes} [Wed Sep 28 12:17:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:42.706442 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdcf70-08f0-4f24-8fd4-4d14487f9a8f service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:42.707914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-4ccdcf70-08f0-4f24-8fd4-4d14487f9a8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:42.755570 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:42.778877 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdcf70-08f0-4f24-8fd4-4d14487f9a8f service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:42.783881 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbfc450-b230-4828-a969-4f1370a2a04e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '822e394e80fd41adb54d330adaf65a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:42.784479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbfc450-b230-4828-a969-4f1370a2a04e service swift] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:42.784760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbfc450-b230-4828-a969-4f1370a2a04e service swift] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:42.785031 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbfc450-b230-4828-a969-4f1370a2a04e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:42.794251 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbfc450-b230-4828-a969-4f1370a2a04e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:42.795865 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbfc450-b230-4828-a969-4f1370a2a04e service swift] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:42.803930 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1219/2394] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 28 12:17:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 28 12:17:43.348238 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b8188-149c-4586-8f79-5ea0c84ff9ff None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:43.416375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b8188-149c-4586-8f79-5ea0c84ff9ff None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:43.420941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cb002-973d-42c9-b3ff-468af711c4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:43.422096 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cb002-973d-42c9-b3ff-468af711c4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:43.422382 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cb002-973d-42c9-b3ff-468af711c4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:43.422657 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cb002-973d-42c9-b3ff-468af711c4d4 admin admin] PATH_INFO: `/v3/users/89aeaaad27bc4a31b6944224e02c8327` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:43.423813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0cb002-973d-42c9-b3ff-468af711c4d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89aeaaad27bc4a31b6944224e02c8327)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:43.425772 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0cb002-973d-42c9-b3ff-468af711c4d4 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:43.488177 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-1b0cb002-973d-42c9-b3ff-468af711c4d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89aeaaad27bc4a31b6944224e02c8327'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:43.502553 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-1b0cb002-973d-42c9-b3ff-468af711c4d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89aeaaad27bc4a31b6944224e02c8327'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:43.503515 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-1b0cb002-973d-42c9-b3ff-468af711c4d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89aeaaad27bc4a31b6944224e02c8327'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:43.512989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-1b0cb002-973d-42c9-b3ff-468af711c4d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89aeaaad27bc4a31b6944224e02c8327'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:43.522775 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-1b0cb002-973d-42c9-b3ff-468af711c4d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89aeaaad27bc4a31b6944224e02c8327'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:43.531082 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1176/2395] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:17:43 2022] DELETE /identity/v3/users/89aeaaad27bc4a31b6944224e02c8327 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:17:43.535667 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f2d5b-5448-4bf9-8eb3-19d2607b4abb None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:43.535954 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f2d5b-5448-4bf9-8eb3-19d2607b4abb None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:43.536225 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f2d5b-5448-4bf9-8eb3-19d2607b4abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:43.557532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-8b9f2d5b-5448-4bf9-8eb3-19d2607b4abb None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:43.558808 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8b9f2d5b-5448-4bf9-8eb3-19d2607b4abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:43.623553 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1220/2396] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:17:43.635299 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cb002-973d-42c9-b3ff-468af711c4d4 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:43.637126 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-1b0cb002-973d-42c9-b3ff-468af711c4d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:43.698970 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cb002-973d-42c9-b3ff-468af711c4d4 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:43.708271 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d026d6-1248-4fb3-aaaa-9fdf0adad837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:43.708920 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d026d6-1248-4fb3-aaaa-9fdf0adad837 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:43.709199 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d026d6-1248-4fb3-aaaa-9fdf0adad837 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:43.709488 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d026d6-1248-4fb3-aaaa-9fdf0adad837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:43.722895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d026d6-1248-4fb3-aaaa-9fdf0adad837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:43.724522 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d026d6-1248-4fb3-aaaa-9fdf0adad837 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:43.737439 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1177/2397] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:17:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:17:44.024296 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f2d5b-5448-4bf9-8eb3-19d2607b4abb None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:44.025964 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8b9f2d5b-5448-4bf9-8eb3-19d2607b4abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:44.043991 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f2d5b-5448-4bf9-8eb3-19d2607b4abb None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:44.049184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b08a46-f0a5-4b9a-9891-b299a67362f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:44.049828 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b08a46-f0a5-4b9a-9891-b299a67362f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:44.050110 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b08a46-f0a5-4b9a-9891-b299a67362f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:44.050567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b08a46-f0a5-4b9a-9891-b299a67362f3 admin admin] PATH_INFO: `/v3/projects/7b73146c94084f1289d3a064dad7aeed` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:44.052187 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b08a46-f0a5-4b9a-9891-b299a67362f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b73146c94084f1289d3a064dad7aeed)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:44.054829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b08a46-f0a5-4b9a-9891-b299a67362f3 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:44.104534 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c7b08a46-f0a5-4b9a-9891-b299a67362f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b73146c94084f1289d3a064dad7aeed', 'request_id': 'req-c7b08a46-f0a5-4b9a-9891-b299a67362f3'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:44.110489 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c7b08a46-f0a5-4b9a-9891-b299a67362f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b73146c94084f1289d3a064dad7aeed', 'request_id': 'req-c7b08a46-f0a5-4b9a-9891-b299a67362f3'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:44.116834 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c7b08a46-f0a5-4b9a-9891-b299a67362f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b73146c94084f1289d3a064dad7aeed', 'request_id': 'req-c7b08a46-f0a5-4b9a-9891-b299a67362f3'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:44.130868 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c7b08a46-f0a5-4b9a-9891-b299a67362f3 admin admin] The token cache is being invalidate because project 7b73146c94084f1289d3a064dad7aeed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:17:44.130998 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c7b08a46-f0a5-4b9a-9891-b299a67362f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:44.131710 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c7b08a46-f0a5-4b9a-9891-b299a67362f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:17:44.133341 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1221/2398] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:17:44 2022] DELETE /identity/v3/projects/7b73146c94084f1289d3a064dad7aeed => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:17:44.138523 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d738784-5943-4ec2-bdf3-4b5e42d4f6fb None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:44.138807 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d738784-5943-4ec2-bdf3-4b5e42d4f6fb None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:44.139085 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d738784-5943-4ec2-bdf3-4b5e42d4f6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:44.158126 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-8d738784-5943-4ec2-bdf3-4b5e42d4f6fb None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:44.159316 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-8d738784-5943-4ec2-bdf3-4b5e42d4f6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:44.168158 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:44.224432 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1178/2399] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:44.232838 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30027a5e-f906-40f2-94ea-3ec4d4c6c45b None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:44.233123 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30027a5e-f906-40f2-94ea-3ec4d4c6c45b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:44.233399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30027a5e-f906-40f2-94ea-3ec4d4c6c45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:44.253282 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-30027a5e-f906-40f2-94ea-3ec4d4c6c45b None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:44.254488 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-30027a5e-f906-40f2-94ea-3ec4d4c6c45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:44.262887 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1222/2400] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:44.266885 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d738784-5943-4ec2-bdf3-4b5e42d4f6fb None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:44.277005 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d738784-5943-4ec2-bdf3-4b5e42d4f6fb None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:44.281646 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5441552-1f6a-4af8-add8-7ebe5de5dc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:44.282245 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5441552-1f6a-4af8-add8-7ebe5de5dc72 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:44.282548 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5441552-1f6a-4af8-add8-7ebe5de5dc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:44.282823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5441552-1f6a-4af8-add8-7ebe5de5dc72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:44.283533 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5441552-1f6a-4af8-add8-7ebe5de5dc72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:17:44.283839 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5441552-1f6a-4af8-add8-7ebe5de5dc72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:44.285437 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5441552-1f6a-4af8-add8-7ebe5de5dc72 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:44.297077 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1179/2401] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:17:44.301138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30027a5e-f906-40f2-94ea-3ec4d4c6c45b None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:44.310552 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30027a5e-f906-40f2-94ea-3ec4d4c6c45b None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:44.315387 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425445d-e0e8-47bf-84f6-ed8dcac7dd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:44.316017 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425445d-e0e8-47bf-84f6-ed8dcac7dd1a admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:44.316295 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425445d-e0e8-47bf-84f6-ed8dcac7dd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:44.316564 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425445d-e0e8-47bf-84f6-ed8dcac7dd1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:44.317205 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425445d-e0e8-47bf-84f6-ed8dcac7dd1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:44.319073 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425445d-e0e8-47bf-84f6-ed8dcac7dd1a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:44.351741 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1223/2402] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:17:44 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:17:44.352955 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5441552-1f6a-4af8-add8-7ebe5de5dc72 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:44.362876 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5441552-1f6a-4af8-add8-7ebe5de5dc72 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:44.429522 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebd457-a94a-4d08-b2ec-985d2a4ac8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:44.430124 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebd457-a94a-4d08-b2ec-985d2a4ac8fa admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:44.430398 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebd457-a94a-4d08-b2ec-985d2a4ac8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:44.430664 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebd457-a94a-4d08-b2ec-985d2a4ac8fa admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:44.431310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebd457-a94a-4d08-b2ec-985d2a4ac8fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:44.433861 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebd457-a94a-4d08-b2ec-985d2a4ac8fa admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:44.457878 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1180/2403] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:17:44 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:17:44.461686 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425445d-e0e8-47bf-84f6-ed8dcac7dd1a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:44.472961 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425445d-e0e8-47bf-84f6-ed8dcac7dd1a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:44.478041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbdd85-6d92-4160-9bc5-bedac6becfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:44.478661 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbdd85-6d92-4160-9bc5-bedac6becfb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:44.478960 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbdd85-6d92-4160-9bc5-bedac6becfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:44.479200 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbdd85-6d92-4160-9bc5-bedac6becfb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:44.479879 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbdd85-6d92-4160-9bc5-bedac6becfb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:44.481461 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbdd85-6d92-4160-9bc5-bedac6becfb1 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:44.493149 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1224/2404] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:17:44.497032 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebd457-a94a-4d08-b2ec-985d2a4ac8fa admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:44.507275 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebd457-a94a-4d08-b2ec-985d2a4ac8fa admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:44.512554 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7c321-f0f3-4d46-bd5f-947c3fd3877d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:44.513160 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7c321-f0f3-4d46-bd5f-947c3fd3877d admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:44.513441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7c321-f0f3-4d46-bd5f-947c3fd3877d admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:44.513717 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7c321-f0f3-4d46-bd5f-947c3fd3877d admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:44.514358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe7c321-f0f3-4d46-bd5f-947c3fd3877d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:44.516001 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe7c321-f0f3-4d46-bd5f-947c3fd3877d admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:44.527340 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1181/2405] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:17:44.531737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbdd85-6d92-4160-9bc5-bedac6becfb1 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:44.542939 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbdd85-6d92-4160-9bc5-bedac6becfb1 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:44.547528 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3403d6-df90-4dfb-b8b5-30b65d88d4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:44.548172 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3403d6-df90-4dfb-b8b5-30b65d88d4ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:44.548447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3403d6-df90-4dfb-b8b5-30b65d88d4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:44.548713 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3403d6-df90-4dfb-b8b5-30b65d88d4ab admin admin] PATH_INFO: `/v3/projects/9fd5d009f0464525baab8c007482a89c/users/e099900dbbe04577abc315f691c62ed2/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:44.563314 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3403d6-df90-4dfb-b8b5-30b65d88d4ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fd5d009f0464525baab8c007482a89c, user_id=e099900dbbe04577abc315f691c62ed2, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:44.565949 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3403d6-df90-4dfb-b8b5-30b65d88d4ab admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:44.568095 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:44.580698 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1225/2406] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:17:44 2022] PUT /identity/v3/projects/9fd5d009f0464525baab8c007482a89c/users/e099900dbbe04577abc315f691c62ed2/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:17:44.585647 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663c12b-4fed-481a-93fb-447abb49f96c None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:44.585935 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663c12b-4fed-481a-93fb-447abb49f96c None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:44.586242 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663c12b-4fed-481a-93fb-447abb49f96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:44.604919 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-1663c12b-4fed-481a-93fb-447abb49f96c None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:44.606057 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-1663c12b-4fed-481a-93fb-447abb49f96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:44.664525 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1182/2407] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:44.674049 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3403d6-df90-4dfb-b8b5-30b65d88d4ab admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:44.675756 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0f3403d6-df90-4dfb-b8b5-30b65d88d4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:44.737634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3403d6-df90-4dfb-b8b5-30b65d88d4ab admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:44.741584 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44afe69-4a5b-4ecc-aa8c-59ab40905ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:44.742172 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44afe69-4a5b-4ecc-aa8c-59ab40905ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:44.742705 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44afe69-4a5b-4ecc-aa8c-59ab40905ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:44.742993 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44afe69-4a5b-4ecc-aa8c-59ab40905ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:44.752723 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44afe69-4a5b-4ecc-aa8c-59ab40905ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:44.754127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44afe69-4a5b-4ecc-aa8c-59ab40905ed9 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:44.763957 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1226/2408] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:17:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:17:48.889436 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda9a37-1d1e-45ae-aa15-2ee40e64d243 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:48.892618 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda9a37-1d1e-45ae-aa15-2ee40e64d243 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:48.893181 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda9a37-1d1e-45ae-aa15-2ee40e64d243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:48.923257 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-5fda9a37-1d1e-45ae-aa15-2ee40e64d243 None None] MFA Rules not processed for user `e099900dbbe04577abc315f691c62ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:48.924631 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-5fda9a37-1d1e-45ae-aa15-2ee40e64d243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:48.933186 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:49.012040 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1183/2409] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:49.014921 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44afe69-4a5b-4ecc-aa8c-59ab40905ed9 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:49.026549 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44afe69-4a5b-4ecc-aa8c-59ab40905ed9 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:49.032090 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ff919-84b3-47ce-b1c3-66311d04f8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:49.032798 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ff919-84b3-47ce-b1c3-66311d04f8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:49.033140 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ff919-84b3-47ce-b1c3-66311d04f8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:49.033531 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ff919-84b3-47ce-b1c3-66311d04f8f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:49.034272 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ff919-84b3-47ce-b1c3-66311d04f8f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:49.036354 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ff919-84b3-47ce-b1c3-66311d04f8f6 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:49.068641 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1227/2410] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:17:49 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:17:49.072650 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda9a37-1d1e-45ae-aa15-2ee40e64d243 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:49.083588 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda9a37-1d1e-45ae-aa15-2ee40e64d243 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:49.143819 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c8c32-ee29-45c6-901a-f92308a6c441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:49.144437 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c8c32-ee29-45c6-901a-f92308a6c441 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:49.144714 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c8c32-ee29-45c6-901a-f92308a6c441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:49.144986 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c8c32-ee29-45c6-901a-f92308a6c441 admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:49.145628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c8c32-ee29-45c6-901a-f92308a6c441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:49.147926 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c8c32-ee29-45c6-901a-f92308a6c441 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:49.183883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1184/2411] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:17:49 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:17:49.187862 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ff919-84b3-47ce-b1c3-66311d04f8f6 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:49.198191 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ff919-84b3-47ce-b1c3-66311d04f8f6 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:49.202851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df14592-27ae-48b8-80f0-aabaa35f6ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:49.203390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df14592-27ae-48b8-80f0-aabaa35f6ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:49.203704 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df14592-27ae-48b8-80f0-aabaa35f6ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:49.205055 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df14592-27ae-48b8-80f0-aabaa35f6ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:49.205962 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df14592-27ae-48b8-80f0-aabaa35f6ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:49.209955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df14592-27ae-48b8-80f0-aabaa35f6ea9 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:49.229863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1228/2412] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:17:49.233934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c8c32-ee29-45c6-901a-f92308a6c441 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:49.246326 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c8c32-ee29-45c6-901a-f92308a6c441 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:49.251475 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c223e-c8ec-490e-a012-7c3439838bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:49.252055 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c223e-c8ec-490e-a012-7c3439838bf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:49.252339 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c223e-c8ec-490e-a012-7c3439838bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:49.252618 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c223e-c8ec-490e-a012-7c3439838bf5 admin admin] PATH_INFO: `/v3/projects/39148f444333403981bfd8a5ca2be468/users/1c398b67172048d6b9a53aa13db8b200/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:49.270021 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c223e-c8ec-490e-a012-7c3439838bf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39148f444333403981bfd8a5ca2be468, user_id=1c398b67172048d6b9a53aa13db8b200, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:49.273745 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c223e-c8ec-490e-a012-7c3439838bf5 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:49.295484 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1185/2413] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:17:49 2022] PUT /identity/v3/projects/39148f444333403981bfd8a5ca2be468/users/1c398b67172048d6b9a53aa13db8b200/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:17:49.298502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df14592-27ae-48b8-80f0-aabaa35f6ea9 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:49.309159 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df14592-27ae-48b8-80f0-aabaa35f6ea9 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:49.396691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf2fc3-39ce-4516-b119-d7b7e02673ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:49.397410 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf2fc3-39ce-4516-b119-d7b7e02673ba admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:49.397770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf2fc3-39ce-4516-b119-d7b7e02673ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:49.398240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf2fc3-39ce-4516-b119-d7b7e02673ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:49.398985 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf2fc3-39ce-4516-b119-d7b7e02673ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:49.401335 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf2fc3-39ce-4516-b119-d7b7e02673ba admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:49.412944 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1229/2414] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:17:49.416956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c223e-c8ec-490e-a012-7c3439838bf5 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:49.429335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c223e-c8ec-490e-a012-7c3439838bf5 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:49.447317 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd8e5f-faf7-4b04-a90b-af26c1c2680f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:49.448223 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd8e5f-faf7-4b04-a90b-af26c1c2680f admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:49.448514 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd8e5f-faf7-4b04-a90b-af26c1c2680f admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:49.448899 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd8e5f-faf7-4b04-a90b-af26c1c2680f admin admin] PATH_INFO: `/v3/projects/39148f444333403981bfd8a5ca2be468/users/1c398b67172048d6b9a53aa13db8b200/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:49.450973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd8e5f-faf7-4b04-a90b-af26c1c2680f admin admin] RBAC: Authorizing `identity:create_grant(project_id=39148f444333403981bfd8a5ca2be468, user_id=1c398b67172048d6b9a53aa13db8b200, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:49.453568 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd8e5f-faf7-4b04-a90b-af26c1c2680f admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:49.470852 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1186/2415] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:17:49 2022] PUT /identity/v3/projects/39148f444333403981bfd8a5ca2be468/users/1c398b67172048d6b9a53aa13db8b200/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:17:54.590895 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dca8a3-add3-42a7-8934-1ca51c472d15 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:54.591787 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dca8a3-add3-42a7-8934-1ca51c472d15 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:54.592075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dca8a3-add3-42a7-8934-1ca51c472d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:54.624131 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-82dca8a3-add3-42a7-8934-1ca51c472d15 None None] MFA Rules not processed for user `1c398b67172048d6b9a53aa13db8b200`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:54.625477 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-82dca8a3-add3-42a7-8934-1ca51c472d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:54.676337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:54.700618 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1230/2416] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:54.714661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd8e5f-faf7-4b04-a90b-af26c1c2680f admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:54.716463 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-0bfd8e5f-faf7-4b04-a90b-af26c1c2680f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:54.804084 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:54.824831 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd8e5f-faf7-4b04-a90b-af26c1c2680f admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:54.832416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79716004-7d3e-4db5-b668-d2dcf0a5a755 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:54.833311 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79716004-7d3e-4db5-b668-d2dcf0a5a755 service nova] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:54.833740 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79716004-7d3e-4db5-b668-d2dcf0a5a755 service nova] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:54.834203 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79716004-7d3e-4db5-b668-d2dcf0a5a755 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:54.897237 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79716004-7d3e-4db5-b668-d2dcf0a5a755 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:54.898922 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79716004-7d3e-4db5-b668-d2dcf0a5a755 service nova] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:54.909348 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1187/2417] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:17:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:17:56.145638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfea680-7efa-4fd4-814f-5e7eb3efaa56 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:56.146919 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfea680-7efa-4fd4-814f-5e7eb3efaa56 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:56.147408 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfea680-7efa-4fd4-814f-5e7eb3efaa56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:56.183016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-ddfea680-7efa-4fd4-814f-5e7eb3efaa56 None None] MFA Rules not processed for user `e099900dbbe04577abc315f691c62ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:56.185064 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ddfea680-7efa-4fd4-814f-5e7eb3efaa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:56.201827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1231/2418] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:17:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:57.162729 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79716004-7d3e-4db5-b668-d2dcf0a5a755 service nova] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:57.164477 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-79716004-7d3e-4db5-b668-d2dcf0a5a755 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:57.248949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79716004-7d3e-4db5-b668-d2dcf0a5a755 service nova] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:57.254392 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d7102-28eb-417d-b7d8-a65758156bc5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09e495edc6fd47c892679bb908c3f5bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:57.255000 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d7102-28eb-417d-b7d8-a65758156bc5 service placement] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:57.255277 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d7102-28eb-417d-b7d8-a65758156bc5 service placement] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:57.255608 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d7102-28eb-417d-b7d8-a65758156bc5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:57.257580 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-cc4d7102-28eb-417d-b7d8-a65758156bc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:57.270028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d7102-28eb-417d-b7d8-a65758156bc5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:57.271742 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d7102-28eb-417d-b7d8-a65758156bc5 service placement] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:57.284478 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1188/2419] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:17:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:18:01.975200 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfea680-7efa-4fd4-814f-5e7eb3efaa56 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:01.978135 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ddfea680-7efa-4fd4-814f-5e7eb3efaa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:02.064173 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfea680-7efa-4fd4-814f-5e7eb3efaa56 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:02.069210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ea9b6-2a45-4d74-871a-d0fb51e2bf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:02.070029 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ea9b6-2a45-4d74-871a-d0fb51e2bf99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:02.070310 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ea9b6-2a45-4d74-871a-d0fb51e2bf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:02.070584 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ea9b6-2a45-4d74-871a-d0fb51e2bf99 admin admin] PATH_INFO: `/v3/users/e0ca8e4cc0e14fde937b0f3da2a28812` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:02.072495 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ea9b6-2a45-4d74-871a-d0fb51e2bf99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0ca8e4cc0e14fde937b0f3da2a28812)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:02.074412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ea9b6-2a45-4d74-871a-d0fb51e2bf99 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:02.123492 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-117ea9b6-2a45-4d74-871a-d0fb51e2bf99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0ca8e4cc0e14fde937b0f3da2a28812'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:02.124296 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-117ea9b6-2a45-4d74-871a-d0fb51e2bf99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0ca8e4cc0e14fde937b0f3da2a28812'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:02.131766 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-117ea9b6-2a45-4d74-871a-d0fb51e2bf99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0ca8e4cc0e14fde937b0f3da2a28812'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:02.142336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-117ea9b6-2a45-4d74-871a-d0fb51e2bf99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0ca8e4cc0e14fde937b0f3da2a28812'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:02.142943 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-117ea9b6-2a45-4d74-871a-d0fb51e2bf99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0ca8e4cc0e14fde937b0f3da2a28812'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:02.163053 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1232/2420] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:18:01 2022] DELETE /identity/v3/users/e0ca8e4cc0e14fde937b0f3da2a28812 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:18:02.339796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d7102-28eb-417d-b7d8-a65758156bc5 service placement] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:02.360455 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d7102-28eb-417d-b7d8-a65758156bc5 service placement] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:02.421205 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27cdd3-86f5-4b4f-8ac3-c38a2ffa57cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:02.421746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27cdd3-86f5-4b4f-8ac3-c38a2ffa57cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:02.422023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27cdd3-86f5-4b4f-8ac3-c38a2ffa57cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:02.422292 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27cdd3-86f5-4b4f-8ac3-c38a2ffa57cf admin admin] PATH_INFO: `/v3/projects/6b49704b1ff143748dd87de2bc0f4300` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:02.423449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27cdd3-86f5-4b4f-8ac3-c38a2ffa57cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b49704b1ff143748dd87de2bc0f4300)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:02.425493 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27cdd3-86f5-4b4f-8ac3-c38a2ffa57cf admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:02.464610 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:18:02.487384 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-cc27cdd3-86f5-4b4f-8ac3-c38a2ffa57cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b49704b1ff143748dd87de2bc0f4300', 'request_id': 'req-cc27cdd3-86f5-4b4f-8ac3-c38a2ffa57cf'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:02.494297 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-cc27cdd3-86f5-4b4f-8ac3-c38a2ffa57cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b49704b1ff143748dd87de2bc0f4300', 'request_id': 'req-cc27cdd3-86f5-4b4f-8ac3-c38a2ffa57cf'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:02.502021 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-cc27cdd3-86f5-4b4f-8ac3-c38a2ffa57cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b49704b1ff143748dd87de2bc0f4300', 'request_id': 'req-cc27cdd3-86f5-4b4f-8ac3-c38a2ffa57cf'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:02.513854 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-cc27cdd3-86f5-4b4f-8ac3-c38a2ffa57cf admin admin] The token cache is being invalidate because project 6b49704b1ff143748dd87de2bc0f4300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:18:02.514142 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-cc27cdd3-86f5-4b4f-8ac3-c38a2ffa57cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:02.514758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-cc27cdd3-86f5-4b4f-8ac3-c38a2ffa57cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:02.516429 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1189/2421] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:18:02 2022] DELETE /identity/v3/projects/6b49704b1ff143748dd87de2bc0f4300 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:18:02.520407 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ea9b6-2a45-4d74-871a-d0fb51e2bf99 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:02.521895 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-117ea9b6-2a45-4d74-871a-d0fb51e2bf99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:02.535686 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ea9b6-2a45-4d74-871a-d0fb51e2bf99 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:02.589046 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:18:02.596217 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf354f87-7fe8-4f8a-9fc9-5edd9d72d029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:02.597332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf354f87-7fe8-4f8a-9fc9-5edd9d72d029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:02.597840 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf354f87-7fe8-4f8a-9fc9-5edd9d72d029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:02.598126 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf354f87-7fe8-4f8a-9fc9-5edd9d72d029 admin admin] PATH_INFO: `/v3/users/45ad5c619e724031b43ec04ea36e0f8b` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:02.599555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf354f87-7fe8-4f8a-9fc9-5edd9d72d029 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45ad5c619e724031b43ec04ea36e0f8b)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:02.601661 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf354f87-7fe8-4f8a-9fc9-5edd9d72d029 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:02.647357 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cf354f87-7fe8-4f8a-9fc9-5edd9d72d029 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45ad5c619e724031b43ec04ea36e0f8b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:02.648042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cf354f87-7fe8-4f8a-9fc9-5edd9d72d029 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45ad5c619e724031b43ec04ea36e0f8b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:02.655632 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cf354f87-7fe8-4f8a-9fc9-5edd9d72d029 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45ad5c619e724031b43ec04ea36e0f8b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:02.665445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cf354f87-7fe8-4f8a-9fc9-5edd9d72d029 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45ad5c619e724031b43ec04ea36e0f8b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:02.666141 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cf354f87-7fe8-4f8a-9fc9-5edd9d72d029 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45ad5c619e724031b43ec04ea36e0f8b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:02.685188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1233/2422] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:18:02 2022] DELETE /identity/v3/users/45ad5c619e724031b43ec04ea36e0f8b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:18:02.861004 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27cdd3-86f5-4b4f-8ac3-c38a2ffa57cf admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:02.862889 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-cc27cdd3-86f5-4b4f-8ac3-c38a2ffa57cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:02.878043 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27cdd3-86f5-4b4f-8ac3-c38a2ffa57cf admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:02.950463 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff0184-bfc6-424c-bb56-212f98832368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:02.951031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff0184-bfc6-424c-bb56-212f98832368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:02.951309 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff0184-bfc6-424c-bb56-212f98832368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:02.951678 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff0184-bfc6-424c-bb56-212f98832368 admin admin] PATH_INFO: `/v3/projects/6ae9864efb94420684eb032c80355290` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:02.953310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff0184-bfc6-424c-bb56-212f98832368 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ae9864efb94420684eb032c80355290)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:02.955191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff0184-bfc6-424c-bb56-212f98832368 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:03.009011 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-95ff0184-bfc6-424c-bb56-212f98832368 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ae9864efb94420684eb032c80355290', 'request_id': 'req-95ff0184-bfc6-424c-bb56-212f98832368'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:03.014779 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-95ff0184-bfc6-424c-bb56-212f98832368 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ae9864efb94420684eb032c80355290', 'request_id': 'req-95ff0184-bfc6-424c-bb56-212f98832368'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:03.025333 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-95ff0184-bfc6-424c-bb56-212f98832368 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ae9864efb94420684eb032c80355290', 'request_id': 'req-95ff0184-bfc6-424c-bb56-212f98832368'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:03.039509 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-95ff0184-bfc6-424c-bb56-212f98832368 admin admin] The token cache is being invalidate because project 6ae9864efb94420684eb032c80355290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:18:03.039875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-95ff0184-bfc6-424c-bb56-212f98832368 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:03.041262 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-95ff0184-bfc6-424c-bb56-212f98832368 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:03.043070 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1190/2423] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:18:02 2022] DELETE /identity/v3/projects/6ae9864efb94420684eb032c80355290 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:18:03.048474 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321cd54-05ec-451c-8cf0-afade751dd98 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:03.048933 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321cd54-05ec-451c-8cf0-afade751dd98 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:03.049131 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321cd54-05ec-451c-8cf0-afade751dd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:03.076422 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-f321cd54-05ec-451c-8cf0-afade751dd98 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:18:03.077698 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f321cd54-05ec-451c-8cf0-afade751dd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:03.152740 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1234/2424] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:18:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:18:03.221284 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be27c66-ec77-4b99-a3b8-f85caf05ad8d None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:03.221475 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be27c66-ec77-4b99-a3b8-f85caf05ad8d None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:03.221732 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be27c66-ec77-4b99-a3b8-f85caf05ad8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:03.243138 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-9be27c66-ec77-4b99-a3b8-f85caf05ad8d None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:18:03.244957 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-9be27c66-ec77-4b99-a3b8-f85caf05ad8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:03.257033 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1191/2425] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:18:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:18:03.259616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321cd54-05ec-451c-8cf0-afade751dd98 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:03.269487 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321cd54-05ec-451c-8cf0-afade751dd98 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:03.274211 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fa28c-d975-41fe-b5e0-7b344e12feda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:03.275328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fa28c-d975-41fe-b5e0-7b344e12feda admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:03.276066 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fa28c-d975-41fe-b5e0-7b344e12feda admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:03.276066 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fa28c-d975-41fe-b5e0-7b344e12feda admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:03.276532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fa28c-d975-41fe-b5e0-7b344e12feda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:18:03.276835 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fa28c-d975-41fe-b5e0-7b344e12feda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:03.278431 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fa28c-d975-41fe-b5e0-7b344e12feda admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:03.290943 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1235/2426] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:18:03.295248 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be27c66-ec77-4b99-a3b8-f85caf05ad8d None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:03.304451 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be27c66-ec77-4b99-a3b8-f85caf05ad8d None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:03.309323 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76506eae-660d-43a0-9b4d-0c69ea335c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:03.309936 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76506eae-660d-43a0-9b4d-0c69ea335c24 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:03.310783 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76506eae-660d-43a0-9b4d-0c69ea335c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:03.310783 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76506eae-660d-43a0-9b4d-0c69ea335c24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:03.311118 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76506eae-660d-43a0-9b4d-0c69ea335c24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:03.313175 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76506eae-660d-43a0-9b4d-0c69ea335c24 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:03.344675 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1192/2427] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:18:03 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:18:03.354940 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fa28c-d975-41fe-b5e0-7b344e12feda admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:03.365437 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fa28c-d975-41fe-b5e0-7b344e12feda admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:03.424751 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750621bf-4ab4-4dd8-b808-0c7fdd264597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:03.425357 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750621bf-4ab4-4dd8-b808-0c7fdd264597 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:03.425636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750621bf-4ab4-4dd8-b808-0c7fdd264597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:03.425908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750621bf-4ab4-4dd8-b808-0c7fdd264597 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:03.426537 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750621bf-4ab4-4dd8-b808-0c7fdd264597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:03.428503 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750621bf-4ab4-4dd8-b808-0c7fdd264597 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:03.438291 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:18:03.452385 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1236/2428] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:18:03 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:18:03.456589 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76506eae-660d-43a0-9b4d-0c69ea335c24 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:03.468213 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76506eae-660d-43a0-9b4d-0c69ea335c24 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:03.473432 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f0d91-9ccf-4b19-b774-80c3c2118729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:03.473977 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f0d91-9ccf-4b19-b774-80c3c2118729 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:03.474259 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f0d91-9ccf-4b19-b774-80c3c2118729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:03.474534 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f0d91-9ccf-4b19-b774-80c3c2118729 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:03.475182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f0d91-9ccf-4b19-b774-80c3c2118729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:03.476809 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f0d91-9ccf-4b19-b774-80c3c2118729 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:03.487294 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1193/2429] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:18:03.491327 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750621bf-4ab4-4dd8-b808-0c7fdd264597 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:03.501724 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750621bf-4ab4-4dd8-b808-0c7fdd264597 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:03.506283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df302dd-ae87-4b5c-801f-b24773cf2009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:03.506875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df302dd-ae87-4b5c-801f-b24773cf2009 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:03.507154 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df302dd-ae87-4b5c-801f-b24773cf2009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:03.507425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df302dd-ae87-4b5c-801f-b24773cf2009 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:03.508091 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df302dd-ae87-4b5c-801f-b24773cf2009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:03.509661 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df302dd-ae87-4b5c-801f-b24773cf2009 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:03.520283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1237/2430] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:18:03.525631 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f0d91-9ccf-4b19-b774-80c3c2118729 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:03.538385 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f0d91-9ccf-4b19-b774-80c3c2118729 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:03.543659 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d984a8-bc04-473e-a120-1add4e14c86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:03.544313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d984a8-bc04-473e-a120-1add4e14c86b admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:03.544595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d984a8-bc04-473e-a120-1add4e14c86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:03.544869 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d984a8-bc04-473e-a120-1add4e14c86b admin admin] PATH_INFO: `/v3/projects/08ce6a06785949cc9376d26807661897/users/f79799e9ef1a47a6b8c7a879ac6e96ab/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:03.548088 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:18:03.561480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d984a8-bc04-473e-a120-1add4e14c86b admin admin] RBAC: Authorizing `identity:create_grant(project_id=08ce6a06785949cc9376d26807661897, user_id=f79799e9ef1a47a6b8c7a879ac6e96ab, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:03.564189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d984a8-bc04-473e-a120-1add4e14c86b admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:03.576989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1194/2431] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:18:03 2022] PUT /identity/v3/projects/08ce6a06785949cc9376d26807661897/users/f79799e9ef1a47a6b8c7a879ac6e96ab/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:18:03.587912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ea54d-7379-4676-94c0-7a68210f955a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:03.588205 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ea54d-7379-4676-94c0-7a68210f955a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:03.588483 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ea54d-7379-4676-94c0-7a68210f955a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:03.619410 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-4c2ea54d-7379-4676-94c0-7a68210f955a None None] MFA Rules not processed for user `f79799e9ef1a47a6b8c7a879ac6e96ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:18:03.620667 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-4c2ea54d-7379-4676-94c0-7a68210f955a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:03.687798 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1238/2432] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:18:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:18:03.692534 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d984a8-bc04-473e-a120-1add4e14c86b admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:03.773058 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d984a8-bc04-473e-a120-1add4e14c86b admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:03.778450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fe4a1-8bd4-42bf-9d04-857647b4a9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:03.779047 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fe4a1-8bd4-42bf-9d04-857647b4a9d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:03.779323 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fe4a1-8bd4-42bf-9d04-857647b4a9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:03.779620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fe4a1-8bd4-42bf-9d04-857647b4a9d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:03.780242 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934fe4a1-8bd4-42bf-9d04-857647b4a9d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:03.782121 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934fe4a1-8bd4-42bf-9d04-857647b4a9d6 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:03.808859 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1195/2433] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:18:03 2022] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:18:03.813108 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ea54d-7379-4676-94c0-7a68210f955a None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:03.824470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ea54d-7379-4676-94c0-7a68210f955a None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:03.882961 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1a184-75c0-49c0-818c-8090f6309274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:03.883614 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1a184-75c0-49c0-818c-8090f6309274 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:03.884431 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1a184-75c0-49c0-818c-8090f6309274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:03.884734 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1a184-75c0-49c0-818c-8090f6309274 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:03.885381 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1a184-75c0-49c0-818c-8090f6309274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:03.887302 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1a184-75c0-49c0-818c-8090f6309274 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:03.908220 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1239/2434] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:18:03 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:18:03.912395 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fe4a1-8bd4-42bf-9d04-857647b4a9d6 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:03.922683 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fe4a1-8bd4-42bf-9d04-857647b4a9d6 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:03.927935 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe2f5f-68be-47ac-8b6e-ed70a1697ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:03.928587 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe2f5f-68be-47ac-8b6e-ed70a1697ffe admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:03.928875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe2f5f-68be-47ac-8b6e-ed70a1697ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:03.929130 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe2f5f-68be-47ac-8b6e-ed70a1697ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:03.929815 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe2f5f-68be-47ac-8b6e-ed70a1697ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:03.931812 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe2f5f-68be-47ac-8b6e-ed70a1697ffe admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:03.942918 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1196/2435] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:18:03.947833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1a184-75c0-49c0-818c-8090f6309274 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:03.957640 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1a184-75c0-49c0-818c-8090f6309274 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:03.962889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69857d78-f732-46b1-b307-5e1e7984712b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:03.963567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69857d78-f732-46b1-b307-5e1e7984712b admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:03.963844 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69857d78-f732-46b1-b307-5e1e7984712b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:03.964115 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69857d78-f732-46b1-b307-5e1e7984712b admin admin] PATH_INFO: `/v3/projects/2a2b464bb13546a0822581ce7bf5e924/users/b95ad309580746439262c15a94201d18/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:03.978590 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69857d78-f732-46b1-b307-5e1e7984712b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a2b464bb13546a0822581ce7bf5e924, user_id=b95ad309580746439262c15a94201d18, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:03.981333 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69857d78-f732-46b1-b307-5e1e7984712b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:03.995651 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1240/2436] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:18:03 2022] PUT /identity/v3/projects/2a2b464bb13546a0822581ce7bf5e924/users/b95ad309580746439262c15a94201d18/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:18:03.999870 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe2f5f-68be-47ac-8b6e-ed70a1697ffe admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:04.010396 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe2f5f-68be-47ac-8b6e-ed70a1697ffe admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:04.067610 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40269db9-ddc5-44f9-8c84-6e31fcbbeb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:04.068139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40269db9-ddc5-44f9-8c84-6e31fcbbeb68 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:04.068418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40269db9-ddc5-44f9-8c84-6e31fcbbeb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:04.068689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40269db9-ddc5-44f9-8c84-6e31fcbbeb68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:04.069337 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40269db9-ddc5-44f9-8c84-6e31fcbbeb68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:04.070931 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40269db9-ddc5-44f9-8c84-6e31fcbbeb68 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:04.081761 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1197/2437] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:18:04.085829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69857d78-f732-46b1-b307-5e1e7984712b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:04.096291 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69857d78-f732-46b1-b307-5e1e7984712b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:04.100959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aeb92c-f779-4fc5-8d4f-2ac3fc6c33e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:04.101640 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeb92c-f779-4fc5-8d4f-2ac3fc6c33e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:04.101920 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeb92c-f779-4fc5-8d4f-2ac3fc6c33e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:04.102189 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeb92c-f779-4fc5-8d4f-2ac3fc6c33e9 admin admin] PATH_INFO: `/v3/projects/2a2b464bb13546a0822581ce7bf5e924/users/b95ad309580746439262c15a94201d18/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:04.104192 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aeb92c-f779-4fc5-8d4f-2ac3fc6c33e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a2b464bb13546a0822581ce7bf5e924, user_id=b95ad309580746439262c15a94201d18, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:04.106793 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aeb92c-f779-4fc5-8d4f-2ac3fc6c33e9 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:04.117934 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1241/2438] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:18:04 2022] PUT /identity/v3/projects/2a2b464bb13546a0822581ce7bf5e924/users/b95ad309580746439262c15a94201d18/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:18:04.130667 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66f5f1-78f7-4d48-94a8-bf575699bb21 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:04.130956 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66f5f1-78f7-4d48-94a8-bf575699bb21 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:04.131229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66f5f1-78f7-4d48-94a8-bf575699bb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:04.159033 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-2b66f5f1-78f7-4d48-94a8-bf575699bb21 None None] MFA Rules not processed for user `b95ad309580746439262c15a94201d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:18:04.160379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-2b66f5f1-78f7-4d48-94a8-bf575699bb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:04.206379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:18:04.233014 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1198/2439] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:18:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:18:04.244452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aeb92c-f779-4fc5-8d4f-2ac3fc6c33e9 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:04.246156 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-26aeb92c-f779-4fc5-8d4f-2ac3fc6c33e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:04.274323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:18:04.306462 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aeb92c-f779-4fc5-8d4f-2ac3fc6c33e9 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:04.310122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85246876-cb6e-4cd9-8743-fd99526fd5e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:04.310729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85246876-cb6e-4cd9-8743-fd99526fd5e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:04.311009 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85246876-cb6e-4cd9-8743-fd99526fd5e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:04.311284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85246876-cb6e-4cd9-8743-fd99526fd5e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:04.372034 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85246876-cb6e-4cd9-8743-fd99526fd5e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:04.373459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85246876-cb6e-4cd9-8743-fd99526fd5e6 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:04.382824 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1242/2440] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:18:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:18:08.722150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66f5f1-78f7-4d48-94a8-bf575699bb21 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:08.723568 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-2b66f5f1-78f7-4d48-94a8-bf575699bb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:08.736090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66f5f1-78f7-4d48-94a8-bf575699bb21 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:08.739772 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf02967-8ef5-4392-8c07-e77f8931e870 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:08.740376 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf02967-8ef5-4392-8c07-e77f8931e870 service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:08.740651 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf02967-8ef5-4392-8c07-e77f8931e870 service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:08.740920 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf02967-8ef5-4392-8c07-e77f8931e870 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:08.750542 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf02967-8ef5-4392-8c07-e77f8931e870 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:08.751986 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf02967-8ef5-4392-8c07-e77f8931e870 service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:08.761600 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1199/2441] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:18:08 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:18:13.823203 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85246876-cb6e-4cd9-8743-fd99526fd5e6 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:13.905031 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85246876-cb6e-4cd9-8743-fd99526fd5e6 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:13.910740 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751b2d9-1728-4069-adeb-e50ea9803124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:13.911414 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751b2d9-1728-4069-adeb-e50ea9803124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:13.911725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751b2d9-1728-4069-adeb-e50ea9803124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:13.911998 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751b2d9-1728-4069-adeb-e50ea9803124 admin admin] PATH_INFO: `/v3/users/f79799e9ef1a47a6b8c7a879ac6e96ab` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:13.913188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751b2d9-1728-4069-adeb-e50ea9803124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f79799e9ef1a47a6b8c7a879ac6e96ab)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:13.916004 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751b2d9-1728-4069-adeb-e50ea9803124 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:13.976515 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5751b2d9-1728-4069-adeb-e50ea9803124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f79799e9ef1a47a6b8c7a879ac6e96ab'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:13.977269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5751b2d9-1728-4069-adeb-e50ea9803124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f79799e9ef1a47a6b8c7a879ac6e96ab'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:13.987384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5751b2d9-1728-4069-adeb-e50ea9803124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f79799e9ef1a47a6b8c7a879ac6e96ab'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:13.997481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5751b2d9-1728-4069-adeb-e50ea9803124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f79799e9ef1a47a6b8c7a879ac6e96ab'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:13.998146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5751b2d9-1728-4069-adeb-e50ea9803124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f79799e9ef1a47a6b8c7a879ac6e96ab'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:14.016827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:18:14.029092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1243/2442] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:18:13 2022] DELETE /identity/v3/users/f79799e9ef1a47a6b8c7a879ac6e96ab => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:18:14.030930 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f63ff-20f8-4b3f-8c5e-2b399afd37ee None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:14.031405 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f63ff-20f8-4b3f-8c5e-2b399afd37ee None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:14.031874 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f63ff-20f8-4b3f-8c5e-2b399afd37ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:14.054452 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-e23f63ff-20f8-4b3f-8c5e-2b399afd37ee None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:18:14.055799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-e23f63ff-20f8-4b3f-8c5e-2b399afd37ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:14.124232 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1200/2443] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:18:14.134902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751b2d9-1728-4069-adeb-e50ea9803124 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:14.136359 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5751b2d9-1728-4069-adeb-e50ea9803124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:14.197135 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751b2d9-1728-4069-adeb-e50ea9803124 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:14.201010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2362522-c3d8-4064-a380-01a8d6206c86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:14.201640 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2362522-c3d8-4064-a380-01a8d6206c86 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:14.202543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2362522-c3d8-4064-a380-01a8d6206c86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:14.202827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2362522-c3d8-4064-a380-01a8d6206c86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:14.213501 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2362522-c3d8-4064-a380-01a8d6206c86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:14.214928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2362522-c3d8-4064-a380-01a8d6206c86 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:14.225029 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1244/2444] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:18:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:18:14.520544 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f63ff-20f8-4b3f-8c5e-2b399afd37ee None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:14.522617 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-e23f63ff-20f8-4b3f-8c5e-2b399afd37ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:14.542145 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f63ff-20f8-4b3f-8c5e-2b399afd37ee None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:14.548754 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6650729-1385-42ae-8eb3-9658c0ff291a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:14.549569 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6650729-1385-42ae-8eb3-9658c0ff291a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:14.549933 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6650729-1385-42ae-8eb3-9658c0ff291a admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:14.550963 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6650729-1385-42ae-8eb3-9658c0ff291a admin admin] PATH_INFO: `/v3/projects/08ce6a06785949cc9376d26807661897` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:14.552298 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6650729-1385-42ae-8eb3-9658c0ff291a admin admin] RBAC: Authorizing `identity:delete_project(project_id=08ce6a06785949cc9376d26807661897)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:14.554605 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6650729-1385-42ae-8eb3-9658c0ff291a admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:14.622826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-b6650729-1385-42ae-8eb3-9658c0ff291a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08ce6a06785949cc9376d26807661897', 'request_id': 'req-b6650729-1385-42ae-8eb3-9658c0ff291a'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:14.628736 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-b6650729-1385-42ae-8eb3-9658c0ff291a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08ce6a06785949cc9376d26807661897', 'request_id': 'req-b6650729-1385-42ae-8eb3-9658c0ff291a'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:14.640619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-b6650729-1385-42ae-8eb3-9658c0ff291a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08ce6a06785949cc9376d26807661897', 'request_id': 'req-b6650729-1385-42ae-8eb3-9658c0ff291a'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:14.659455 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-b6650729-1385-42ae-8eb3-9658c0ff291a admin admin] The token cache is being invalidate because project 08ce6a06785949cc9376d26807661897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:18:14.659838 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-b6650729-1385-42ae-8eb3-9658c0ff291a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:14.660588 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-b6650729-1385-42ae-8eb3-9658c0ff291a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:14.662598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1201/2445] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:18:14 2022] DELETE /identity/v3/projects/08ce6a06785949cc9376d26807661897 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:18:14.667023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2362522-c3d8-4064-a380-01a8d6206c86 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:14.682079 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2362522-c3d8-4064-a380-01a8d6206c86 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:14.775876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a695723-6cdf-49dd-8a71-2026eb6af768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:14.776557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a695723-6cdf-49dd-8a71-2026eb6af768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:14.776944 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a695723-6cdf-49dd-8a71-2026eb6af768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:14.777216 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a695723-6cdf-49dd-8a71-2026eb6af768 admin admin] PATH_INFO: `/v3/users/b95ad309580746439262c15a94201d18` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:14.778388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a695723-6cdf-49dd-8a71-2026eb6af768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b95ad309580746439262c15a94201d18)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:14.780398 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a695723-6cdf-49dd-8a71-2026eb6af768 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:14.845424 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2a695723-6cdf-49dd-8a71-2026eb6af768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b95ad309580746439262c15a94201d18'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:14.846236 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2a695723-6cdf-49dd-8a71-2026eb6af768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b95ad309580746439262c15a94201d18'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:14.861397 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2a695723-6cdf-49dd-8a71-2026eb6af768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b95ad309580746439262c15a94201d18'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:14.872773 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2a695723-6cdf-49dd-8a71-2026eb6af768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b95ad309580746439262c15a94201d18'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:14.873592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2a695723-6cdf-49dd-8a71-2026eb6af768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b95ad309580746439262c15a94201d18'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:14.892981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1245/2446] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:18:14 2022] DELETE /identity/v3/users/b95ad309580746439262c15a94201d18 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:18:15.292170 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6650729-1385-42ae-8eb3-9658c0ff291a admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:15.294368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b6650729-1385-42ae-8eb3-9658c0ff291a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:15.311024 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6650729-1385-42ae-8eb3-9658c0ff291a admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:15.365818 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:18:15.377575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6d4ad-a43c-416e-a193-f22514bc279a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:15.378515 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6d4ad-a43c-416e-a193-f22514bc279a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:15.378842 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6d4ad-a43c-416e-a193-f22514bc279a admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:15.379407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6d4ad-a43c-416e-a193-f22514bc279a admin admin] PATH_INFO: `/v3/projects/2a2b464bb13546a0822581ce7bf5e924` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:15.380842 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6d4ad-a43c-416e-a193-f22514bc279a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a2b464bb13546a0822581ce7bf5e924)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:15.382912 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6d4ad-a43c-416e-a193-f22514bc279a admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:15.430770 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-6fa6d4ad-a43c-416e-a193-f22514bc279a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a2b464bb13546a0822581ce7bf5e924', 'request_id': 'req-6fa6d4ad-a43c-416e-a193-f22514bc279a'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:15.437339 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-6fa6d4ad-a43c-416e-a193-f22514bc279a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a2b464bb13546a0822581ce7bf5e924', 'request_id': 'req-6fa6d4ad-a43c-416e-a193-f22514bc279a'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:15.447312 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-6fa6d4ad-a43c-416e-a193-f22514bc279a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a2b464bb13546a0822581ce7bf5e924', 'request_id': 'req-6fa6d4ad-a43c-416e-a193-f22514bc279a'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:15.471208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-6fa6d4ad-a43c-416e-a193-f22514bc279a admin admin] The token cache is being invalidate because project 2a2b464bb13546a0822581ce7bf5e924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:18:15.471532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-6fa6d4ad-a43c-416e-a193-f22514bc279a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:15.472202 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-6fa6d4ad-a43c-416e-a193-f22514bc279a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:18:15.473736 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1202/2447] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:18:15 2022] DELETE /identity/v3/projects/2a2b464bb13546a0822581ce7bf5e924 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:18:15.481037 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f0e50-04c6-443b-ac0f-c2a3b8a96312 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:15.481322 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f0e50-04c6-443b-ac0f-c2a3b8a96312 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:15.481617 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f0e50-04c6-443b-ac0f-c2a3b8a96312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:15.502569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-014f0e50-04c6-443b-ac0f-c2a3b8a96312 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:18:15.503847 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-014f0e50-04c6-443b-ac0f-c2a3b8a96312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:15.518354 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:18:15.571592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1246/2448] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:18:15.579752 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9e976-9ba7-4022-9fb1-2571b9b6b2ab None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:15.580045 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9e976-9ba7-4022-9fb1-2571b9b6b2ab None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:15.580326 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9e976-9ba7-4022-9fb1-2571b9b6b2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:15.602596 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-6ef9e976-9ba7-4022-9fb1-2571b9b6b2ab None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:18:15.604354 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-6ef9e976-9ba7-4022-9fb1-2571b9b6b2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:15.615392 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1203/2449] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:18:15.617301 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f0e50-04c6-443b-ac0f-c2a3b8a96312 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:15.628435 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f0e50-04c6-443b-ac0f-c2a3b8a96312 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:15.633174 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb1d81-2519-4533-8fc9-d1343ec504f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:15.634309 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb1d81-2519-4533-8fc9-d1343ec504f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:15.634592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb1d81-2519-4533-8fc9-d1343ec504f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:15.634863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb1d81-2519-4533-8fc9-d1343ec504f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:15.635555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb1d81-2519-4533-8fc9-d1343ec504f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:18:15.635863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb1d81-2519-4533-8fc9-d1343ec504f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:15.637463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb1d81-2519-4533-8fc9-d1343ec504f2 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:15.651466 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1247/2450] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:18:15.656037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9e976-9ba7-4022-9fb1-2571b9b6b2ab None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:15.665503 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9e976-9ba7-4022-9fb1-2571b9b6b2ab None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:15.670178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a434e-7b72-49b4-9a42-15914cebf339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:15.670778 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a434e-7b72-49b4-9a42-15914cebf339 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:15.671054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a434e-7b72-49b4-9a42-15914cebf339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:15.671321 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a434e-7b72-49b4-9a42-15914cebf339 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:15.671985 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a434e-7b72-49b4-9a42-15914cebf339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:15.673878 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a434e-7b72-49b4-9a42-15914cebf339 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:15.702298 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1204/2451] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:18:15 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:18:15.706300 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb1d81-2519-4533-8fc9-d1343ec504f2 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:15.717088 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb1d81-2519-4533-8fc9-d1343ec504f2 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:15.784720 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2cc88b-f46a-4576-8e60-7e3ee23ea158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:15.785333 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2cc88b-f46a-4576-8e60-7e3ee23ea158 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:15.785950 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2cc88b-f46a-4576-8e60-7e3ee23ea158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:15.785950 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2cc88b-f46a-4576-8e60-7e3ee23ea158 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:15.786510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2cc88b-f46a-4576-8e60-7e3ee23ea158 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:15.788865 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2cc88b-f46a-4576-8e60-7e3ee23ea158 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:15.815565 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1248/2452] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:18:15 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:18:15.816797 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a434e-7b72-49b4-9a42-15914cebf339 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:15.830907 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a434e-7b72-49b4-9a42-15914cebf339 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:15.840934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46535d-efd5-4e57-9497-828a89083568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:15.842225 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46535d-efd5-4e57-9497-828a89083568 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:15.842520 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46535d-efd5-4e57-9497-828a89083568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:15.842798 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46535d-efd5-4e57-9497-828a89083568 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:15.843475 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46535d-efd5-4e57-9497-828a89083568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:15.845099 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46535d-efd5-4e57-9497-828a89083568 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:15.856456 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1205/2453] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:18:15.860661 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2cc88b-f46a-4576-8e60-7e3ee23ea158 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:15.872309 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2cc88b-f46a-4576-8e60-7e3ee23ea158 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:15.878937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a874a-18e9-4d8d-8caf-a4ddc8faf5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:15.879900 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a874a-18e9-4d8d-8caf-a4ddc8faf5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:15.879900 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a874a-18e9-4d8d-8caf-a4ddc8faf5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:15.880120 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a874a-18e9-4d8d-8caf-a4ddc8faf5d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:15.880929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a874a-18e9-4d8d-8caf-a4ddc8faf5d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:15.882600 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a874a-18e9-4d8d-8caf-a4ddc8faf5d3 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:15.896478 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1249/2454] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:18:15.900893 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46535d-efd5-4e57-9497-828a89083568 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:15.925334 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46535d-efd5-4e57-9497-828a89083568 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:15.932600 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04e0cb-b7e4-4cb5-ac24-43b7c9a45957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:15.933441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04e0cb-b7e4-4cb5-ac24-43b7c9a45957 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:15.933618 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04e0cb-b7e4-4cb5-ac24-43b7c9a45957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:15.933878 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04e0cb-b7e4-4cb5-ac24-43b7c9a45957 admin admin] PATH_INFO: `/v3/projects/c3b0138849914c3fabf839486742de26/users/64ceca6763bd404a817a618201b692fb/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:15.960163 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04e0cb-b7e4-4cb5-ac24-43b7c9a45957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b0138849914c3fabf839486742de26, user_id=64ceca6763bd404a817a618201b692fb, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:15.960163 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04e0cb-b7e4-4cb5-ac24-43b7c9a45957 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:15.972280 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1206/2455] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:18:15 2022] PUT /identity/v3/projects/c3b0138849914c3fabf839486742de26/users/64ceca6763bd404a817a618201b692fb/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:18:15.977999 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b07e7-029c-4a4f-83e6-68a9fb4df3d7 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:15.978509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b07e7-029c-4a4f-83e6-68a9fb4df3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:15.978883 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b07e7-029c-4a4f-83e6-68a9fb4df3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:15.999709 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-218b07e7-029c-4a4f-83e6-68a9fb4df3d7 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:18:16.001075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-218b07e7-029c-4a4f-83e6-68a9fb4df3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:16.065307 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1250/2456] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:18:16.074979 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04e0cb-b7e4-4cb5-ac24-43b7c9a45957 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:16.076826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-fd04e0cb-b7e4-4cb5-ac24-43b7c9a45957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:16.139108 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04e0cb-b7e4-4cb5-ac24-43b7c9a45957 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:16.142765 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8569973-ac22-4e46-a6ee-2a5a08bf6e80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:16.143374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8569973-ac22-4e46-a6ee-2a5a08bf6e80 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:16.143689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8569973-ac22-4e46-a6ee-2a5a08bf6e80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:16.143962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8569973-ac22-4e46-a6ee-2a5a08bf6e80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:16.153274 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8569973-ac22-4e46-a6ee-2a5a08bf6e80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:16.154691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8569973-ac22-4e46-a6ee-2a5a08bf6e80 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:16.163975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1207/2457] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:18:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:18:16.764113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3486cb-6114-4fdc-bb45-0d099918367f None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:16.764429 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3486cb-6114-4fdc-bb45-0d099918367f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:16.764701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3486cb-6114-4fdc-bb45-0d099918367f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:16.793825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-6c3486cb-6114-4fdc-bb45-0d099918367f None None] MFA Rules not processed for user `64ceca6763bd404a817a618201b692fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:18:16.795017 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6c3486cb-6114-4fdc-bb45-0d099918367f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:16.809911 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:18:16.865560 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1251/2458] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:18:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:18:16.877698 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8569973-ac22-4e46-a6ee-2a5a08bf6e80 service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:16.879176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-a8569973-ac22-4e46-a6ee-2a5a08bf6e80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:16.901521 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:18:16.940922 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8569973-ac22-4e46-a6ee-2a5a08bf6e80 service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:16.944633 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360761e-e754-497c-9366-1fcac68f8645 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:16.946398 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360761e-e754-497c-9366-1fcac68f8645 service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:16.946398 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360761e-e754-497c-9366-1fcac68f8645 service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:16.946398 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360761e-e754-497c-9366-1fcac68f8645 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:16.955164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360761e-e754-497c-9366-1fcac68f8645 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:16.956858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360761e-e754-497c-9366-1fcac68f8645 service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:16.967496 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1208/2459] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:18:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:18:18.395016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fc11f-e99d-4d16-8a24-223cc0bd28a4 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:18.395615 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fc11f-e99d-4d16-8a24-223cc0bd28a4 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:18.395615 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fc11f-e99d-4d16-8a24-223cc0bd28a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:18.415955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-a44fc11f-e99d-4d16-8a24-223cc0bd28a4 None None] MFA Rules not processed for user `64ceca6763bd404a817a618201b692fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:18:18.417111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a44fc11f-e99d-4d16-8a24-223cc0bd28a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:18.424304 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1252/2460] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:18:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:18:22.322720 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bc955-208e-4cd6-bccd-0010296957d3 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:22.323224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bc955-208e-4cd6-bccd-0010296957d3 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:22.323348 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bc955-208e-4cd6-bccd-0010296957d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:22.344825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-534bc955-208e-4cd6-bccd-0010296957d3 None None] MFA Rules not processed for user `90794e56c3f9486fbace8c39018233b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:18:22.346102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-534bc955-208e-4cd6-bccd-0010296957d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:22.413228 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1209/2461] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:18:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:18:24.451893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fc11f-e99d-4d16-8a24-223cc0bd28a4 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:24.453341 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a44fc11f-e99d-4d16-8a24-223cc0bd28a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:24.466508 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fc11f-e99d-4d16-8a24-223cc0bd28a4 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:24.470443 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1422088-f044-4601-82fb-51e770c6199f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:24.471271 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1422088-f044-4601-82fb-51e770c6199f service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:24.471582 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1422088-f044-4601-82fb-51e770c6199f service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:24.471855 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1422088-f044-4601-82fb-51e770c6199f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:24.473592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e1422088-f044-4601-82fb-51e770c6199f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:24.670908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1422088-f044-4601-82fb-51e770c6199f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:24.672416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1422088-f044-4601-82fb-51e770c6199f service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:24.682591 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1253/2462] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:18:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:18:32.406107 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=42 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:18:34.677936 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=53 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:18:35.797230 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be059cb2-a779-439e-b85a-ae1b5532fdf9 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:35.797733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be059cb2-a779-439e-b85a-ae1b5532fdf9 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:35.797838 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be059cb2-a779-439e-b85a-ae1b5532fdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:35.818101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-be059cb2-a779-439e-b85a-ae1b5532fdf9 None None] MFA Rules not processed for user `bb71e0c02b4647b28ed6a6194d270d35`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:18:35.819322 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-be059cb2-a779-439e-b85a-ae1b5532fdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:35.874482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1210/2463] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:18:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:18:45.867407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=25 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:18:51.529394 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6826e-bfc4-4163-9e94-94c26357800d None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:51.529950 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6826e-bfc4-4163-9e94-94c26357800d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:51.529950 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6826e-bfc4-4163-9e94-94c26357800d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:51.548925 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-a0e6826e-bfc4-4163-9e94-94c26357800d None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:18:51.550121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a0e6826e-bfc4-4163-9e94-94c26357800d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:51.558300 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1254/2464] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Sep 28 12:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:18:51.578969 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be059cb2-a779-439e-b85a-ae1b5532fdf9 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:51.580348 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-be059cb2-a779-439e-b85a-ae1b5532fdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:51.661720 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be059cb2-a779-439e-b85a-ae1b5532fdf9 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:51.670218 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e615d-b06a-4985-916d-b090fad1460c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:51.670878 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e615d-b06a-4985-916d-b090fad1460c service nova] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:51.671141 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e615d-b06a-4985-916d-b090fad1460c service nova] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:51.671414 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e615d-b06a-4985-916d-b090fad1460c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:51.682153 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e615d-b06a-4985-916d-b090fad1460c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:51.684512 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e615d-b06a-4985-916d-b090fad1460c service nova] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:51.695183 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1211/2465] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:18:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:18:53.504183 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b14fdc-4956-4bac-bd6e-ceb7b67e6d04 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:53.504656 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b14fdc-4956-4bac-bd6e-ceb7b67e6d04 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:53.504786 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b14fdc-4956-4bac-bd6e-ceb7b67e6d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:53.523345 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-a1b14fdc-4956-4bac-bd6e-ceb7b67e6d04 None None] MFA Rules not processed for user `d533e3caa6ec4c7c9343a8cefd3af8d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:18:53.525067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a1b14fdc-4956-4bac-bd6e-ceb7b67e6d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:53.579792 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1255/2466] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:18:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:18:54.583584 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df2d20-5df2-43ec-9406-9ad873fa5b05 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:54.584057 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df2d20-5df2-43ec-9406-9ad873fa5b05 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:54.584148 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df2d20-5df2-43ec-9406-9ad873fa5b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:54.604347 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-b9df2d20-5df2-43ec-9406-9ad873fa5b05 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:18:54.605564 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b9df2d20-5df2-43ec-9406-9ad873fa5b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:54.613399 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1212/2467] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Sep 28 12:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:18:54.627563 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b14fdc-4956-4bac-bd6e-ceb7b67e6d04 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:54.641236 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b14fdc-4956-4bac-bd6e-ceb7b67e6d04 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:54.647340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b96416-88d4-491a-acf8-0fec9b7df232 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:54.648078 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b96416-88d4-491a-acf8-0fec9b7df232 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:54.648429 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b96416-88d4-491a-acf8-0fec9b7df232 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:54.648774 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b96416-88d4-491a-acf8-0fec9b7df232 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:54.657285 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b96416-88d4-491a-acf8-0fec9b7df232 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:54.659058 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b96416-88d4-491a-acf8-0fec9b7df232 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:54.669461 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1256/2468] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:18:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:18:57.949434 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec3e90-a8b2-4532-9d18-b68485b6bea4 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:57.949936 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec3e90-a8b2-4532-9d18-b68485b6bea4 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:57.950039 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec3e90-a8b2-4532-9d18-b68485b6bea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:57.985539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-d6ec3e90-a8b2-4532-9d18-b68485b6bea4 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:18:57.986774 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-d6ec3e90-a8b2-4532-9d18-b68485b6bea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:18:57.996251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1213/2469] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Sep 28 12:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:18:58.016530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b96416-88d4-491a-acf8-0fec9b7df232 service nova] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:18:58.031706 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b96416-88d4-491a-acf8-0fec9b7df232 service nova] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:18:58.038557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e63ac3-c081-4a40-9e96-91ee33d2742e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:18:58.039299 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e63ac3-c081-4a40-9e96-91ee33d2742e service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:18:58.039735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e63ac3-c081-4a40-9e96-91ee33d2742e service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:18:58.040123 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e63ac3-c081-4a40-9e96-91ee33d2742e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:18:58.051697 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e63ac3-c081-4a40-9e96-91ee33d2742e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:18:58.053686 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e63ac3-c081-4a40-9e96-91ee33d2742e service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:18:58.068975 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1257/2470] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:18:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:19:01.004823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b66ce-1545-4556-acb9-b5a223d5a316 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:01.005308 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b66ce-1545-4556-acb9-b5a223d5a316 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:01.005404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b66ce-1545-4556-acb9-b5a223d5a316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:01.025621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-4f2b66ce-1545-4556-acb9-b5a223d5a316 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:01.026814 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-4f2b66ce-1545-4556-acb9-b5a223d5a316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:01.034797 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1214/2471] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Sep 28 12:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:19:01.053029 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e63ac3-c081-4a40-9e96-91ee33d2742e service nova] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:01.064505 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e63ac3-c081-4a40-9e96-91ee33d2742e service nova] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:01.070120 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f834bac-b667-49b8-9b79-635ac38cc5d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:01.070711 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f834bac-b667-49b8-9b79-635ac38cc5d4 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:01.071617 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f834bac-b667-49b8-9b79-635ac38cc5d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:01.071887 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f834bac-b667-49b8-9b79-635ac38cc5d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:01.080043 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f834bac-b667-49b8-9b79-635ac38cc5d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:01.081581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f834bac-b667-49b8-9b79-635ac38cc5d4 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:01.090588 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1258/2472] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:19:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:19:05.195083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae112abe-1a43-404e-bb71-7b8de5839c05 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:05.195591 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae112abe-1a43-404e-bb71-7b8de5839c05 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:05.196235 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae112abe-1a43-404e-bb71-7b8de5839c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:05.216106 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-ae112abe-1a43-404e-bb71-7b8de5839c05 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:05.217313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-ae112abe-1a43-404e-bb71-7b8de5839c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:05.225121 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1215/2473] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Sep 28 12:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:19:05.246314 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f834bac-b667-49b8-9b79-635ac38cc5d4 service nova] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:05.247981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8f834bac-b667-49b8-9b79-635ac38cc5d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:05.263803 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f834bac-b667-49b8-9b79-635ac38cc5d4 service nova] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:05.269561 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362f97e-0118-44a1-8bb5-7ca4377d977c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:05.270294 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362f97e-0118-44a1-8bb5-7ca4377d977c service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:05.270683 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362f97e-0118-44a1-8bb5-7ca4377d977c service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:05.271051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362f97e-0118-44a1-8bb5-7ca4377d977c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:05.280126 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362f97e-0118-44a1-8bb5-7ca4377d977c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:05.281672 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362f97e-0118-44a1-8bb5-7ca4377d977c service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:05.291569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1259/2474] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:19:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:19:08.359996 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc942ae2-1eb7-4cec-94b5-7a5c1b8ad234 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:08.360490 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc942ae2-1eb7-4cec-94b5-7a5c1b8ad234 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:08.360582 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc942ae2-1eb7-4cec-94b5-7a5c1b8ad234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:08.379781 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-cc942ae2-1eb7-4cec-94b5-7a5c1b8ad234 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:08.380958 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-cc942ae2-1eb7-4cec-94b5-7a5c1b8ad234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:08.389194 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1216/2475] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Sep 28 12:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:19:08.405482 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362f97e-0118-44a1-8bb5-7ca4377d977c service nova] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:08.416627 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362f97e-0118-44a1-8bb5-7ca4377d977c service nova] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:08.421993 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71e8f1-c281-4e1c-b7e9-0b9807886528 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:08.422575 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71e8f1-c281-4e1c-b7e9-0b9807886528 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:08.422848 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71e8f1-c281-4e1c-b7e9-0b9807886528 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:08.423114 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71e8f1-c281-4e1c-b7e9-0b9807886528 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:08.431284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df71e8f1-c281-4e1c-b7e9-0b9807886528 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:08.432850 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df71e8f1-c281-4e1c-b7e9-0b9807886528 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:08.446228 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1260/2476] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:19:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:19:18.374572 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=49 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:18.438267 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=58 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:28.818894 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfe45d-cc73-4f02-8aa3-6d6d820391de None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:28.819372 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfe45d-cc73-4f02-8aa3-6d6d820391de None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:28.819521 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfe45d-cc73-4f02-8aa3-6d6d820391de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:28.838394 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-dbdfe45d-cc73-4f02-8aa3-6d6d820391de None None] MFA Rules not processed for user `64ceca6763bd404a817a618201b692fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:28.839644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-dbdfe45d-cc73-4f02-8aa3-6d6d820391de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:28.846364 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1217/2477] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:19:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:19:38.832839 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:41.410699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71e8f1-c281-4e1c-b7e9-0b9807886528 service nova] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:41.412276 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-df71e8f1-c281-4e1c-b7e9-0b9807886528 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:41.425851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71e8f1-c281-4e1c-b7e9-0b9807886528 service nova] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:41.430675 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06654df9-48ac-4954-ad98-c6b1dabb2f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:41.431606 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06654df9-48ac-4954-ad98-c6b1dabb2f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:41.431949 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06654df9-48ac-4954-ad98-c6b1dabb2f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:41.432300 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06654df9-48ac-4954-ad98-c6b1dabb2f3b admin admin] PATH_INFO: `/v3/users/90794e56c3f9486fbace8c39018233b2` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:41.433555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06654df9-48ac-4954-ad98-c6b1dabb2f3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=90794e56c3f9486fbace8c39018233b2)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:41.435573 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06654df9-48ac-4954-ad98-c6b1dabb2f3b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:41.484289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-06654df9-48ac-4954-ad98-c6b1dabb2f3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90794e56c3f9486fbace8c39018233b2'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:41.484943 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-06654df9-48ac-4954-ad98-c6b1dabb2f3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90794e56c3f9486fbace8c39018233b2'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:41.494864 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-06654df9-48ac-4954-ad98-c6b1dabb2f3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90794e56c3f9486fbace8c39018233b2'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:41.510593 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-06654df9-48ac-4954-ad98-c6b1dabb2f3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90794e56c3f9486fbace8c39018233b2'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:41.511239 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-06654df9-48ac-4954-ad98-c6b1dabb2f3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90794e56c3f9486fbace8c39018233b2'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:41.530559 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1261/2478] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:19:41 2022] DELETE /identity/v3/users/90794e56c3f9486fbace8c39018233b2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:19:41.708893 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfe45d-cc73-4f02-8aa3-6d6d820391de None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:41.720980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfe45d-cc73-4f02-8aa3-6d6d820391de None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:41.779987 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732bcd8-54ee-444c-a5cc-09e38b52c6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:41.780625 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732bcd8-54ee-444c-a5cc-09e38b52c6db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:41.780902 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732bcd8-54ee-444c-a5cc-09e38b52c6db admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:41.781197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732bcd8-54ee-444c-a5cc-09e38b52c6db admin admin] PATH_INFO: `/v3/projects/a33d8c6816ca4713a0657f0c65d2a1c4` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:41.782312 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732bcd8-54ee-444c-a5cc-09e38b52c6db admin admin] RBAC: Authorizing `identity:delete_project(project_id=a33d8c6816ca4713a0657f0c65d2a1c4)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:41.784335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732bcd8-54ee-444c-a5cc-09e38b52c6db admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:41.830599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4732bcd8-54ee-444c-a5cc-09e38b52c6db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a33d8c6816ca4713a0657f0c65d2a1c4', 'request_id': 'req-4732bcd8-54ee-444c-a5cc-09e38b52c6db'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:41.836085 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4732bcd8-54ee-444c-a5cc-09e38b52c6db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a33d8c6816ca4713a0657f0c65d2a1c4', 'request_id': 'req-4732bcd8-54ee-444c-a5cc-09e38b52c6db'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:41.843033 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4732bcd8-54ee-444c-a5cc-09e38b52c6db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a33d8c6816ca4713a0657f0c65d2a1c4', 'request_id': 'req-4732bcd8-54ee-444c-a5cc-09e38b52c6db'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:41.853928 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4732bcd8-54ee-444c-a5cc-09e38b52c6db admin admin] The token cache is being invalidate because project a33d8c6816ca4713a0657f0c65d2a1c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:19:41.854211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4732bcd8-54ee-444c-a5cc-09e38b52c6db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:41.854829 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4732bcd8-54ee-444c-a5cc-09e38b52c6db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:41.856322 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1218/2479] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:19:41 2022] DELETE /identity/v3/projects/a33d8c6816ca4713a0657f0c65d2a1c4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:19:41.861248 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012b684-37b4-456b-8ee6-7fac72503d88 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:41.861528 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012b684-37b4-456b-8ee6-7fac72503d88 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:41.861798 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012b684-37b4-456b-8ee6-7fac72503d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:41.881450 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-9012b684-37b4-456b-8ee6-7fac72503d88 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:41.883281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9012b684-37b4-456b-8ee6-7fac72503d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:41.944215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1262/2480] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:19:41.951753 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420df4a4-fed8-44c8-bea5-5d96018d40aa None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:41.952043 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420df4a4-fed8-44c8-bea5-5d96018d40aa None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:41.952320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420df4a4-fed8-44c8-bea5-5d96018d40aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:41.972635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-420df4a4-fed8-44c8-bea5-5d96018d40aa None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:41.973836 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-420df4a4-fed8-44c8-bea5-5d96018d40aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:41.982218 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1219/2481] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:19:41.986524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012b684-37b4-456b-8ee6-7fac72503d88 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:41.997135 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012b684-37b4-456b-8ee6-7fac72503d88 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:42.001794 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497a4ae-24ea-4560-8a0d-d7b181563597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:42.002390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497a4ae-24ea-4560-8a0d-d7b181563597 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:42.002668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497a4ae-24ea-4560-8a0d-d7b181563597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:42.002934 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497a4ae-24ea-4560-8a0d-d7b181563597 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:42.003849 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497a4ae-24ea-4560-8a0d-d7b181563597 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:19:42.004151 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497a4ae-24ea-4560-8a0d-d7b181563597 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:42.005715 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497a4ae-24ea-4560-8a0d-d7b181563597 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:42.017768 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1263/2482] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:19:42.022557 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420df4a4-fed8-44c8-bea5-5d96018d40aa None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:42.031970 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420df4a4-fed8-44c8-bea5-5d96018d40aa None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:42.036655 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb98127-bfd9-4faf-a722-78d0ea9f9db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:42.037233 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb98127-bfd9-4faf-a722-78d0ea9f9db3 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:42.037512 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb98127-bfd9-4faf-a722-78d0ea9f9db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:42.037784 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb98127-bfd9-4faf-a722-78d0ea9f9db3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:42.038407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb98127-bfd9-4faf-a722-78d0ea9f9db3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:42.040997 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb98127-bfd9-4faf-a722-78d0ea9f9db3 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:42.068588 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1220/2483] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:19:42 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:19:42.072949 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497a4ae-24ea-4560-8a0d-d7b181563597 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:42.083108 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497a4ae-24ea-4560-8a0d-d7b181563597 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:42.142097 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c5085-ea34-405b-951c-98cc16858b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:42.142613 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c5085-ea34-405b-951c-98cc16858b7e admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:42.142891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c5085-ea34-405b-951c-98cc16858b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:42.143162 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c5085-ea34-405b-951c-98cc16858b7e admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:42.143865 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c5085-ea34-405b-951c-98cc16858b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:42.145753 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c5085-ea34-405b-951c-98cc16858b7e admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:42.153916 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:42.169805 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1264/2484] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:19:42 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:19:42.173993 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb98127-bfd9-4faf-a722-78d0ea9f9db3 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:42.184299 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb98127-bfd9-4faf-a722-78d0ea9f9db3 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:42.188955 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bf780-d3e2-4ff2-ac8d-ce47f1380ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:42.189547 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bf780-d3e2-4ff2-ac8d-ce47f1380ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:42.189825 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bf780-d3e2-4ff2-ac8d-ce47f1380ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:42.190094 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bf780-d3e2-4ff2-ac8d-ce47f1380ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:42.190730 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bf780-d3e2-4ff2-ac8d-ce47f1380ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:42.192346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bf780-d3e2-4ff2-ac8d-ce47f1380ec5 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:42.202793 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1221/2485] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:19:42.206942 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c5085-ea34-405b-951c-98cc16858b7e admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:42.217945 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c5085-ea34-405b-951c-98cc16858b7e admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:42.222680 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c69b3-5775-4fb4-b55d-4fe33adf1e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:42.223278 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c69b3-5775-4fb4-b55d-4fe33adf1e15 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:42.223585 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c69b3-5775-4fb4-b55d-4fe33adf1e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:42.223857 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c69b3-5775-4fb4-b55d-4fe33adf1e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:42.224496 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c69b3-5775-4fb4-b55d-4fe33adf1e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:42.226067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c69b3-5775-4fb4-b55d-4fe33adf1e15 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:42.236414 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1265/2486] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:19:42.240580 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bf780-d3e2-4ff2-ac8d-ce47f1380ec5 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:42.250935 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bf780-d3e2-4ff2-ac8d-ce47f1380ec5 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:42.256044 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292767ae-1169-4343-abd5-034e3a5fc497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:42.256229 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292767ae-1169-4343-abd5-034e3a5fc497 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:42.256497 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292767ae-1169-4343-abd5-034e3a5fc497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:42.256773 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292767ae-1169-4343-abd5-034e3a5fc497 admin admin] PATH_INFO: `/v3/projects/f23186a09a704ad5bf0260a7027d3209/users/737e77e1a0ff4944a3d8adcb2e5e2e22/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:42.272176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292767ae-1169-4343-abd5-034e3a5fc497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f23186a09a704ad5bf0260a7027d3209, user_id=737e77e1a0ff4944a3d8adcb2e5e2e22, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:42.275457 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292767ae-1169-4343-abd5-034e3a5fc497 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:42.290280 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1222/2487] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:19:42 2022] PUT /identity/v3/projects/f23186a09a704ad5bf0260a7027d3209/users/737e77e1a0ff4944a3d8adcb2e5e2e22/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:19:42.300316 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bc205-d56a-4e2f-ba3e-3a8e6a16b3cb None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:42.300603 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bc205-d56a-4e2f-ba3e-3a8e6a16b3cb None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:42.300874 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bc205-d56a-4e2f-ba3e-3a8e6a16b3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:42.330151 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-eb0bc205-d56a-4e2f-ba3e-3a8e6a16b3cb None None] MFA Rules not processed for user `737e77e1a0ff4944a3d8adcb2e5e2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:42.331538 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-eb0bc205-d56a-4e2f-ba3e-3a8e6a16b3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:42.400110 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1266/2488] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:19:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:19:42.410905 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292767ae-1169-4343-abd5-034e3a5fc497 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:42.412671 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-292767ae-1169-4343-abd5-034e3a5fc497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:42.445860 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:42.491103 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292767ae-1169-4343-abd5-034e3a5fc497 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:42.497963 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6228b6b-aa2a-484e-adbb-a13a58307518 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:42.498571 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6228b6b-aa2a-484e-adbb-a13a58307518 service nova] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:42.498852 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6228b6b-aa2a-484e-adbb-a13a58307518 service nova] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:42.499124 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6228b6b-aa2a-484e-adbb-a13a58307518 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:42.508355 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6228b6b-aa2a-484e-adbb-a13a58307518 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:42.509980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6228b6b-aa2a-484e-adbb-a13a58307518 service nova] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:42.519144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1223/2489] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:19:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:19:45.086509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85e7dd-7c9f-44b3-a467-b5e58f620e1b None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:45.087072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85e7dd-7c9f-44b3-a467-b5e58f620e1b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:45.087072 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85e7dd-7c9f-44b3-a467-b5e58f620e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:45.107035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-dc85e7dd-7c9f-44b3-a467-b5e58f620e1b None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:45.108262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-dc85e7dd-7c9f-44b3-a467-b5e58f620e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:45.168841 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1267/2490] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Sep 28 12:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:19:45.196872 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6228b6b-aa2a-484e-adbb-a13a58307518 service nova] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:45.207940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6228b6b-aa2a-484e-adbb-a13a58307518 service nova] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:45.214138 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053cf59-d883-4ef1-9a2f-25022bf70ff2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:45.214664 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053cf59-d883-4ef1-9a2f-25022bf70ff2 service nova] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:45.214943 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053cf59-d883-4ef1-9a2f-25022bf70ff2 service nova] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:45.215216 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053cf59-d883-4ef1-9a2f-25022bf70ff2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:45.223305 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053cf59-d883-4ef1-9a2f-25022bf70ff2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:45.224892 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053cf59-d883-4ef1-9a2f-25022bf70ff2 service nova] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:45.234486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1224/2491] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:19:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:19:45.269541 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85e7dd-7c9f-44b3-a467-b5e58f620e1b None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:45.281876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85e7dd-7c9f-44b3-a467-b5e58f620e1b None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:45.286556 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46645210-50de-4572-9bc2-422edca65576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:45.287184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46645210-50de-4572-9bc2-422edca65576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:45.287504 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46645210-50de-4572-9bc2-422edca65576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:45.287762 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46645210-50de-4572-9bc2-422edca65576 admin admin] PATH_INFO: `/v3/users/737e77e1a0ff4944a3d8adcb2e5e2e22` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:45.288901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46645210-50de-4572-9bc2-422edca65576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=737e77e1a0ff4944a3d8adcb2e5e2e22)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:45.290801 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46645210-50de-4572-9bc2-422edca65576 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:45.338752 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-46645210-50de-4572-9bc2-422edca65576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '737e77e1a0ff4944a3d8adcb2e5e2e22'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:45.339449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-46645210-50de-4572-9bc2-422edca65576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '737e77e1a0ff4944a3d8adcb2e5e2e22'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:45.346439 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-46645210-50de-4572-9bc2-422edca65576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '737e77e1a0ff4944a3d8adcb2e5e2e22'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:45.353240 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-46645210-50de-4572-9bc2-422edca65576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '737e77e1a0ff4944a3d8adcb2e5e2e22'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:45.354042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-46645210-50de-4572-9bc2-422edca65576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '737e77e1a0ff4944a3d8adcb2e5e2e22'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:45.355283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:INSERT=4,keystone:SELECT=88,keystone:DELETE=8 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:45.375268 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1268/2492] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:19:45 2022] DELETE /identity/v3/users/737e77e1a0ff4944a3d8adcb2e5e2e22 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:19:45.379787 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf78dc-7a7a-4a42-8897-0f5376238642 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:45.380072 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf78dc-7a7a-4a42-8897-0f5376238642 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:45.380343 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf78dc-7a7a-4a42-8897-0f5376238642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:45.399965 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-c4cf78dc-7a7a-4a42-8897-0f5376238642 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:45.401156 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-c4cf78dc-7a7a-4a42-8897-0f5376238642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:45.459604 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1225/2493] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:19:45.469230 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46645210-50de-4572-9bc2-422edca65576 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:45.470556 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-46645210-50de-4572-9bc2-422edca65576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:45.527523 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46645210-50de-4572-9bc2-422edca65576 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:45.531094 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecb8a8-477b-4836-b6c2-65cd665883e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:45.531726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecb8a8-477b-4836-b6c2-65cd665883e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:45.532005 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecb8a8-477b-4836-b6c2-65cd665883e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:45.532277 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecb8a8-477b-4836-b6c2-65cd665883e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:45.541128 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ecb8a8-477b-4836-b6c2-65cd665883e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:45.542533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ecb8a8-477b-4836-b6c2-65cd665883e6 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:45.551915 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1269/2494] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:19:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:19:45.828367 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf78dc-7a7a-4a42-8897-0f5376238642 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:45.829869 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-c4cf78dc-7a7a-4a42-8897-0f5376238642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:45.847114 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf78dc-7a7a-4a42-8897-0f5376238642 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:45.852686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c9e9b-a09f-405d-9d34-14a8b3573154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:45.853519 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c9e9b-a09f-405d-9d34-14a8b3573154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:45.853992 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c9e9b-a09f-405d-9d34-14a8b3573154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:45.854321 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c9e9b-a09f-405d-9d34-14a8b3573154 admin admin] PATH_INFO: `/v3/projects/f23186a09a704ad5bf0260a7027d3209` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:45.855778 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c9e9b-a09f-405d-9d34-14a8b3573154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f23186a09a704ad5bf0260a7027d3209)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:45.857794 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c9e9b-a09f-405d-9d34-14a8b3573154 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:45.904426 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-736c9e9b-a09f-405d-9d34-14a8b3573154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f23186a09a704ad5bf0260a7027d3209', 'request_id': 'req-736c9e9b-a09f-405d-9d34-14a8b3573154'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:45.909962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-736c9e9b-a09f-405d-9d34-14a8b3573154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f23186a09a704ad5bf0260a7027d3209', 'request_id': 'req-736c9e9b-a09f-405d-9d34-14a8b3573154'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:45.917778 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-736c9e9b-a09f-405d-9d34-14a8b3573154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f23186a09a704ad5bf0260a7027d3209', 'request_id': 'req-736c9e9b-a09f-405d-9d34-14a8b3573154'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:45.928953 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-736c9e9b-a09f-405d-9d34-14a8b3573154 admin admin] The token cache is being invalidate because project f23186a09a704ad5bf0260a7027d3209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:19:45.929242 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-736c9e9b-a09f-405d-9d34-14a8b3573154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:45.930507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-736c9e9b-a09f-405d-9d34-14a8b3573154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:45.932017 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1226/2495] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:19:45 2022] DELETE /identity/v3/projects/f23186a09a704ad5bf0260a7027d3209 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:19:45.936744 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd84f11-6c43-4061-8b4c-27982985d7f1 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:45.937033 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd84f11-6c43-4061-8b4c-27982985d7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:45.937324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd84f11-6c43-4061-8b4c-27982985d7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:45.956351 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-edd84f11-6c43-4061-8b4c-27982985d7f1 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:45.957550 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-edd84f11-6c43-4061-8b4c-27982985d7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:46.018633 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1270/2496] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:19:46.028068 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315ae22-794a-4b34-bb75-37853d9c77ab None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:46.028354 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315ae22-794a-4b34-bb75-37853d9c77ab None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:46.028626 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315ae22-794a-4b34-bb75-37853d9c77ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:46.048731 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-4315ae22-794a-4b34-bb75-37853d9c77ab None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:46.049924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-4315ae22-794a-4b34-bb75-37853d9c77ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:46.057707 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1227/2497] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:19:46.061815 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd84f11-6c43-4061-8b4c-27982985d7f1 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:46.071264 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd84f11-6c43-4061-8b4c-27982985d7f1 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:46.075796 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39605c-0fd4-4548-b180-c38d13c0a600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:46.076384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39605c-0fd4-4548-b180-c38d13c0a600 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:46.076657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39605c-0fd4-4548-b180-c38d13c0a600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:46.076922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39605c-0fd4-4548-b180-c38d13c0a600 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:46.077558 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39605c-0fd4-4548-b180-c38d13c0a600 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:19:46.077854 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39605c-0fd4-4548-b180-c38d13c0a600 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:46.079418 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39605c-0fd4-4548-b180-c38d13c0a600 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:46.091740 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1271/2498] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:19:46.095694 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315ae22-794a-4b34-bb75-37853d9c77ab None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:46.105585 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315ae22-794a-4b34-bb75-37853d9c77ab None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:46.110308 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa9a1d-78f3-4450-b432-fc2b7e7a61df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:46.110901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa9a1d-78f3-4450-b432-fc2b7e7a61df admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:46.111177 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa9a1d-78f3-4450-b432-fc2b7e7a61df admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:46.111481 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa9a1d-78f3-4450-b432-fc2b7e7a61df admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:46.112311 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa9a1d-78f3-4450-b432-fc2b7e7a61df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:46.114201 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa9a1d-78f3-4450-b432-fc2b7e7a61df admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:46.131203 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:46.146254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1228/2499] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:19:46 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:19:46.151029 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39605c-0fd4-4548-b180-c38d13c0a600 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:46.161323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39605c-0fd4-4548-b180-c38d13c0a600 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:46.218145 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f7559-9078-4dfe-9b97-93717974231a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:46.218745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f7559-9078-4dfe-9b97-93717974231a admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:46.219021 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f7559-9078-4dfe-9b97-93717974231a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:46.219290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f7559-9078-4dfe-9b97-93717974231a admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:46.220073 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f7559-9078-4dfe-9b97-93717974231a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:46.222068 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f7559-9078-4dfe-9b97-93717974231a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:46.240160 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:46.246542 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1272/2500] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:19:46 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:19:46.250137 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa9a1d-78f3-4450-b432-fc2b7e7a61df admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:46.261070 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa9a1d-78f3-4450-b432-fc2b7e7a61df admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:46.271176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1f0b4-069b-4b18-82df-dc87eb2ebafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:46.271927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1f0b4-069b-4b18-82df-dc87eb2ebafb admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:46.272266 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1f0b4-069b-4b18-82df-dc87eb2ebafb admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:46.272602 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1f0b4-069b-4b18-82df-dc87eb2ebafb admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:46.273832 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1f0b4-069b-4b18-82df-dc87eb2ebafb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:46.275588 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1f0b4-069b-4b18-82df-dc87eb2ebafb admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:46.286558 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1229/2501] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:19:46.290985 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f7559-9078-4dfe-9b97-93717974231a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:46.302316 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f7559-9078-4dfe-9b97-93717974231a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:46.307735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786071b-df3e-4b2a-b67d-b04e644c1906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:46.308347 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786071b-df3e-4b2a-b67d-b04e644c1906 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:46.308624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786071b-df3e-4b2a-b67d-b04e644c1906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:46.308893 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786071b-df3e-4b2a-b67d-b04e644c1906 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:46.309533 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786071b-df3e-4b2a-b67d-b04e644c1906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:46.311116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786071b-df3e-4b2a-b67d-b04e644c1906 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:46.322396 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1273/2502] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:19:46.326797 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1f0b4-069b-4b18-82df-dc87eb2ebafb admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:46.337481 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1f0b4-069b-4b18-82df-dc87eb2ebafb admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:46.342091 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57648073-1324-4713-a169-4fac3e564e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:46.342739 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57648073-1324-4713-a169-4fac3e564e6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:46.343022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57648073-1324-4713-a169-4fac3e564e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:46.343297 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57648073-1324-4713-a169-4fac3e564e6c admin admin] PATH_INFO: `/v3/projects/76ca0bf006ac4c32b96f266566044c50/users/80069eabca0c49c8a47a6f6df180ab52/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:46.359197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57648073-1324-4713-a169-4fac3e564e6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ca0bf006ac4c32b96f266566044c50, user_id=80069eabca0c49c8a47a6f6df180ab52, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:46.361897 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57648073-1324-4713-a169-4fac3e564e6c admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:46.376498 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1230/2503] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:19:46 2022] PUT /identity/v3/projects/76ca0bf006ac4c32b96f266566044c50/users/80069eabca0c49c8a47a6f6df180ab52/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:19:46.388482 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88924ac5-7562-4e1e-8a5c-2cb039b9809d None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:46.389044 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88924ac5-7562-4e1e-8a5c-2cb039b9809d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:46.389323 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88924ac5-7562-4e1e-8a5c-2cb039b9809d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:46.417616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-88924ac5-7562-4e1e-8a5c-2cb039b9809d None None] MFA Rules not processed for user `80069eabca0c49c8a47a6f6df180ab52`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:46.418824 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-88924ac5-7562-4e1e-8a5c-2cb039b9809d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:46.482896 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1274/2504] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:19:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:19:46.487376 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57648073-1324-4713-a169-4fac3e564e6c admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:46.548449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57648073-1324-4713-a169-4fac3e564e6c admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:46.553063 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff7300-25c7-4ba3-8aa8-9072d2566390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:46.553660 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff7300-25c7-4ba3-8aa8-9072d2566390 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:46.553941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff7300-25c7-4ba3-8aa8-9072d2566390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:46.554214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff7300-25c7-4ba3-8aa8-9072d2566390 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:46.554838 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff7300-25c7-4ba3-8aa8-9072d2566390 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:46.556770 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff7300-25c7-4ba3-8aa8-9072d2566390 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:46.582458 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1231/2505] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:19:46 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:19:46.587245 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88924ac5-7562-4e1e-8a5c-2cb039b9809d None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:46.598335 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88924ac5-7562-4e1e-8a5c-2cb039b9809d None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:46.657269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56afb96-0f27-481e-ab85-2fb0f94d8057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:46.657875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56afb96-0f27-481e-ab85-2fb0f94d8057 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:46.658198 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56afb96-0f27-481e-ab85-2fb0f94d8057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:46.658470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56afb96-0f27-481e-ab85-2fb0f94d8057 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:46.659119 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56afb96-0f27-481e-ab85-2fb0f94d8057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:46.661047 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56afb96-0f27-481e-ab85-2fb0f94d8057 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:46.681733 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1275/2506] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:19:46 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:19:46.685951 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff7300-25c7-4ba3-8aa8-9072d2566390 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:46.697141 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff7300-25c7-4ba3-8aa8-9072d2566390 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:46.701802 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118fd58-bfc6-44ac-afdc-2d19247d7894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:46.702404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118fd58-bfc6-44ac-afdc-2d19247d7894 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:46.702685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118fd58-bfc6-44ac-afdc-2d19247d7894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:46.702959 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118fd58-bfc6-44ac-afdc-2d19247d7894 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:46.703639 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118fd58-bfc6-44ac-afdc-2d19247d7894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:46.705248 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118fd58-bfc6-44ac-afdc-2d19247d7894 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:46.716681 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1232/2507] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:19:46.720834 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56afb96-0f27-481e-ab85-2fb0f94d8057 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:46.730755 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56afb96-0f27-481e-ab85-2fb0f94d8057 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:46.735505 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6892de-1156-476b-81f5-9b090e8e9e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:46.736164 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6892de-1156-476b-81f5-9b090e8e9e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:46.736442 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6892de-1156-476b-81f5-9b090e8e9e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:46.736715 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6892de-1156-476b-81f5-9b090e8e9e21 admin admin] PATH_INFO: `/v3/projects/32dafecfd3074db1a59c574c8d8a73a6/users/233c5d2722374cf69a817023434638c6/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:46.751541 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6892de-1156-476b-81f5-9b090e8e9e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32dafecfd3074db1a59c574c8d8a73a6, user_id=233c5d2722374cf69a817023434638c6, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:46.754147 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6892de-1156-476b-81f5-9b090e8e9e21 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:46.767587 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1276/2508] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:19:46 2022] PUT /identity/v3/projects/32dafecfd3074db1a59c574c8d8a73a6/users/233c5d2722374cf69a817023434638c6/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:19:46.771548 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118fd58-bfc6-44ac-afdc-2d19247d7894 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:46.781601 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118fd58-bfc6-44ac-afdc-2d19247d7894 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:46.838995 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de22264-93e7-437d-9df0-79560991a06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:46.839560 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de22264-93e7-437d-9df0-79560991a06f admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:46.839844 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de22264-93e7-437d-9df0-79560991a06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:46.840115 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de22264-93e7-437d-9df0-79560991a06f admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:46.840754 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de22264-93e7-437d-9df0-79560991a06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:46.842497 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de22264-93e7-437d-9df0-79560991a06f admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:46.854518 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1233/2509] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:19:46.858706 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6892de-1156-476b-81f5-9b090e8e9e21 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:46.869828 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6892de-1156-476b-81f5-9b090e8e9e21 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:46.874526 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b4fa3-eaf5-4dab-b702-fc80914dc2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:46.875203 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b4fa3-eaf5-4dab-b702-fc80914dc2af admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:46.875505 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b4fa3-eaf5-4dab-b702-fc80914dc2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:46.875780 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b4fa3-eaf5-4dab-b702-fc80914dc2af admin admin] PATH_INFO: `/v3/projects/32dafecfd3074db1a59c574c8d8a73a6/users/233c5d2722374cf69a817023434638c6/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:46.877680 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b4fa3-eaf5-4dab-b702-fc80914dc2af admin admin] RBAC: Authorizing `identity:create_grant(project_id=32dafecfd3074db1a59c574c8d8a73a6, user_id=233c5d2722374cf69a817023434638c6, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:46.880303 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b4fa3-eaf5-4dab-b702-fc80914dc2af admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:46.890752 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1277/2510] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:19:46 2022] PUT /identity/v3/projects/32dafecfd3074db1a59c574c8d8a73a6/users/233c5d2722374cf69a817023434638c6/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:19:46.900898 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780268c5-183f-4c5c-964d-c7084b9b4167 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:46.901184 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780268c5-183f-4c5c-964d-c7084b9b4167 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:46.901457 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780268c5-183f-4c5c-964d-c7084b9b4167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:46.929226 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-780268c5-183f-4c5c-964d-c7084b9b4167 None None] MFA Rules not processed for user `233c5d2722374cf69a817023434638c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:46.930446 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-780268c5-183f-4c5c-964d-c7084b9b4167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:46.947249 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:46.999347 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1234/2511] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:19:46 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:19:47.010618 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b4fa3-eaf5-4dab-b702-fc80914dc2af admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:47.012329 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-103b4fa3-eaf5-4dab-b702-fc80914dc2af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:47.048366 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:47.073627 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b4fa3-eaf5-4dab-b702-fc80914dc2af admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:47.077247 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ec49d-eeff-4a89-bd19-5da1c1b23008 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:47.077845 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ec49d-eeff-4a89-bd19-5da1c1b23008 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:47.078122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ec49d-eeff-4a89-bd19-5da1c1b23008 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:47.078393 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ec49d-eeff-4a89-bd19-5da1c1b23008 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:47.087190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ec49d-eeff-4a89-bd19-5da1c1b23008 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:47.088663 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ec49d-eeff-4a89-bd19-5da1c1b23008 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:47.097958 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1278/2512] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:19:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:19:47.174263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780268c5-183f-4c5c-964d-c7084b9b4167 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:47.183790 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780268c5-183f-4c5c-964d-c7084b9b4167 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:47.187314 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641efd9-2015-4736-b2e9-2e771aa64c6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:47.187932 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641efd9-2015-4736-b2e9-2e771aa64c6c service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:47.188209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641efd9-2015-4736-b2e9-2e771aa64c6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:47.188480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641efd9-2015-4736-b2e9-2e771aa64c6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:47.243675 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641efd9-2015-4736-b2e9-2e771aa64c6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:47.245378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641efd9-2015-4736-b2e9-2e771aa64c6c service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:47.253936 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1235/2513] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:19:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:19:48.367229 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11276271-2ed5-4456-b293-bec17513ebaf None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:48.367897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11276271-2ed5-4456-b293-bec17513ebaf None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:48.367897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11276271-2ed5-4456-b293-bec17513ebaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:48.387307 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-11276271-2ed5-4456-b293-bec17513ebaf None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:48.388514 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-11276271-2ed5-4456-b293-bec17513ebaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:48.447843 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1279/2514] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Sep 28 12:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:19:48.466474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641efd9-2015-4736-b2e9-2e771aa64c6c service cinder] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:48.468127 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-4641efd9-2015-4736-b2e9-2e771aa64c6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:48.549948 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641efd9-2015-4736-b2e9-2e771aa64c6c service cinder] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:48.556309 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c478d-1ede-400f-b5f5-276ca8cf43a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:48.557669 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c478d-1ede-400f-b5f5-276ca8cf43a9 service nova] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:48.558037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c478d-1ede-400f-b5f5-276ca8cf43a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:48.558513 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c478d-1ede-400f-b5f5-276ca8cf43a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:48.567461 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c478d-1ede-400f-b5f5-276ca8cf43a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:48.569191 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c478d-1ede-400f-b5f5-276ca8cf43a9 service nova] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:48.580158 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1236/2515] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:19:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:19:49.998595 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11276271-2ed5-4456-b293-bec17513ebaf None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:50.008315 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11276271-2ed5-4456-b293-bec17513ebaf None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:50.014761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046ebe5-80eb-4466-a0af-b9c850a7a9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:50.015403 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046ebe5-80eb-4466-a0af-b9c850a7a9b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:50.015705 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046ebe5-80eb-4466-a0af-b9c850a7a9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:50.015977 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046ebe5-80eb-4466-a0af-b9c850a7a9b7 admin admin] PATH_INFO: `/v3/users/80069eabca0c49c8a47a6f6df180ab52` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:50.017105 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046ebe5-80eb-4466-a0af-b9c850a7a9b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80069eabca0c49c8a47a6f6df180ab52)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:50.019003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046ebe5-80eb-4466-a0af-b9c850a7a9b7 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:50.068529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c046ebe5-80eb-4466-a0af-b9c850a7a9b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80069eabca0c49c8a47a6f6df180ab52'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:50.069180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c046ebe5-80eb-4466-a0af-b9c850a7a9b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80069eabca0c49c8a47a6f6df180ab52'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:50.076739 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c046ebe5-80eb-4466-a0af-b9c850a7a9b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80069eabca0c49c8a47a6f6df180ab52'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:50.084273 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c046ebe5-80eb-4466-a0af-b9c850a7a9b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80069eabca0c49c8a47a6f6df180ab52'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:50.084888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c046ebe5-80eb-4466-a0af-b9c850a7a9b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80069eabca0c49c8a47a6f6df180ab52'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:50.102984 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1280/2516] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:19:49 2022] DELETE /identity/v3/users/80069eabca0c49c8a47a6f6df180ab52 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:19:50.107415 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecfc44-692b-4ddf-8664-d04ce4d01157 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:50.107899 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecfc44-692b-4ddf-8664-d04ce4d01157 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:50.107994 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecfc44-692b-4ddf-8664-d04ce4d01157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:50.127255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-e7ecfc44-692b-4ddf-8664-d04ce4d01157 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:50.128501 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-e7ecfc44-692b-4ddf-8664-d04ce4d01157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:50.161164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:50.187957 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1237/2517] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:19:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:19:50.198168 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046ebe5-80eb-4466-a0af-b9c850a7a9b7 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:50.199592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c046ebe5-80eb-4466-a0af-b9c850a7a9b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:50.251757 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:50.258332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046ebe5-80eb-4466-a0af-b9c850a7a9b7 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:50.263386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b704d-ce07-4217-ae18-1735990bad78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:50.264011 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b704d-ce07-4217-ae18-1735990bad78 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:50.264293 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b704d-ce07-4217-ae18-1735990bad78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:50.264586 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b704d-ce07-4217-ae18-1735990bad78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:50.273436 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b704d-ce07-4217-ae18-1735990bad78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:50.274825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b704d-ce07-4217-ae18-1735990bad78 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:50.284406 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1281/2518] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:19:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:19:50.549661 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecfc44-692b-4ddf-8664-d04ce4d01157 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:50.551086 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-e7ecfc44-692b-4ddf-8664-d04ce4d01157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:50.562906 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecfc44-692b-4ddf-8664-d04ce4d01157 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:50.567706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a5f7c-f903-43ad-8f93-15aa41e43f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:50.568331 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a5f7c-f903-43ad-8f93-15aa41e43f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:50.568606 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a5f7c-f903-43ad-8f93-15aa41e43f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:50.568875 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a5f7c-f903-43ad-8f93-15aa41e43f35 admin admin] PATH_INFO: `/v3/projects/76ca0bf006ac4c32b96f266566044c50` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:50.570197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a5f7c-f903-43ad-8f93-15aa41e43f35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76ca0bf006ac4c32b96f266566044c50)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:50.572236 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a5f7c-f903-43ad-8f93-15aa41e43f35 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:50.618671 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-b79a5f7c-f903-43ad-8f93-15aa41e43f35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76ca0bf006ac4c32b96f266566044c50', 'request_id': 'req-b79a5f7c-f903-43ad-8f93-15aa41e43f35'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:50.624688 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-b79a5f7c-f903-43ad-8f93-15aa41e43f35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76ca0bf006ac4c32b96f266566044c50', 'request_id': 'req-b79a5f7c-f903-43ad-8f93-15aa41e43f35'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:50.632726 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-b79a5f7c-f903-43ad-8f93-15aa41e43f35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76ca0bf006ac4c32b96f266566044c50', 'request_id': 'req-b79a5f7c-f903-43ad-8f93-15aa41e43f35'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:50.644562 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-b79a5f7c-f903-43ad-8f93-15aa41e43f35 admin admin] The token cache is being invalidate because project 76ca0bf006ac4c32b96f266566044c50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:19:50.644850 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-b79a5f7c-f903-43ad-8f93-15aa41e43f35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:50.645468 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-b79a5f7c-f903-43ad-8f93-15aa41e43f35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:50.646942 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1238/2519] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:19:50 2022] DELETE /identity/v3/projects/76ca0bf006ac4c32b96f266566044c50 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:19:50.651782 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b704d-ce07-4217-ae18-1735990bad78 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:50.662885 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b704d-ce07-4217-ae18-1735990bad78 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:50.719247 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb5ced-d326-49bf-a231-cd126bf19fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:50.719914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb5ced-d326-49bf-a231-cd126bf19fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:50.720191 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb5ced-d326-49bf-a231-cd126bf19fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:50.720461 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb5ced-d326-49bf-a231-cd126bf19fbc admin admin] PATH_INFO: `/v3/users/233c5d2722374cf69a817023434638c6` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:50.721567 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb5ced-d326-49bf-a231-cd126bf19fbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=233c5d2722374cf69a817023434638c6)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:50.723494 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb5ced-d326-49bf-a231-cd126bf19fbc admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:50.770414 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-45fb5ced-d326-49bf-a231-cd126bf19fbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '233c5d2722374cf69a817023434638c6'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:50.771055 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-45fb5ced-d326-49bf-a231-cd126bf19fbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '233c5d2722374cf69a817023434638c6'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:50.778651 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-45fb5ced-d326-49bf-a231-cd126bf19fbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '233c5d2722374cf69a817023434638c6'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:50.785923 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-45fb5ced-d326-49bf-a231-cd126bf19fbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '233c5d2722374cf69a817023434638c6'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:50.786539 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-45fb5ced-d326-49bf-a231-cd126bf19fbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '233c5d2722374cf69a817023434638c6'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:50.803721 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1282/2520] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:19:50 2022] DELETE /identity/v3/users/233c5d2722374cf69a817023434638c6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:19:51.151747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a5f7c-f903-43ad-8f93-15aa41e43f35 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:51.153290 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b79a5f7c-f903-43ad-8f93-15aa41e43f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:51.166371 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a5f7c-f903-43ad-8f93-15aa41e43f35 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:51.223752 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e74daa-8439-4932-9ba3-b0d00ea61815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:51.224368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e74daa-8439-4932-9ba3-b0d00ea61815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:51.224652 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e74daa-8439-4932-9ba3-b0d00ea61815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:51.224928 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e74daa-8439-4932-9ba3-b0d00ea61815 admin admin] PATH_INFO: `/v3/projects/32dafecfd3074db1a59c574c8d8a73a6` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:51.226045 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e74daa-8439-4932-9ba3-b0d00ea61815 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32dafecfd3074db1a59c574c8d8a73a6)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:51.228006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e74daa-8439-4932-9ba3-b0d00ea61815 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:51.273802 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-58e74daa-8439-4932-9ba3-b0d00ea61815 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32dafecfd3074db1a59c574c8d8a73a6', 'request_id': 'req-58e74daa-8439-4932-9ba3-b0d00ea61815'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:51.280132 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-58e74daa-8439-4932-9ba3-b0d00ea61815 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32dafecfd3074db1a59c574c8d8a73a6', 'request_id': 'req-58e74daa-8439-4932-9ba3-b0d00ea61815'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:51.283828 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:51.288007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-58e74daa-8439-4932-9ba3-b0d00ea61815 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32dafecfd3074db1a59c574c8d8a73a6', 'request_id': 'req-58e74daa-8439-4932-9ba3-b0d00ea61815'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:51.299791 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-58e74daa-8439-4932-9ba3-b0d00ea61815 admin admin] The token cache is being invalidate because project 32dafecfd3074db1a59c574c8d8a73a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:19:51.300096 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-58e74daa-8439-4932-9ba3-b0d00ea61815 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:51.300753 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-58e74daa-8439-4932-9ba3-b0d00ea61815 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:51.302264 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1239/2521] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:19:51 2022] DELETE /identity/v3/projects/32dafecfd3074db1a59c574c8d8a73a6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:19:51.308134 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcba70-33ef-47eb-8997-cb6cbc4c9b11 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:51.308602 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcba70-33ef-47eb-8997-cb6cbc4c9b11 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:51.308717 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcba70-33ef-47eb-8997-cb6cbc4c9b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:51.332008 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-a2bcba70-33ef-47eb-8997-cb6cbc4c9b11 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:51.333169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a2bcba70-33ef-47eb-8997-cb6cbc4c9b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:51.397384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1283/2522] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:19:51.407866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81add9-92a9-47d9-91c7-6d48d3c8eb85 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:51.408192 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81add9-92a9-47d9-91c7-6d48d3c8eb85 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:51.408446 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81add9-92a9-47d9-91c7-6d48d3c8eb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:51.430091 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-7e81add9-92a9-47d9-91c7-6d48d3c8eb85 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:51.431386 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-7e81add9-92a9-47d9-91c7-6d48d3c8eb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:51.439923 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1240/2523] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:19:51.444430 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcba70-33ef-47eb-8997-cb6cbc4c9b11 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:51.455275 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcba70-33ef-47eb-8997-cb6cbc4c9b11 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:51.459894 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701c490-201e-4a3f-aa0a-e8da5e2e2637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:51.460493 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701c490-201e-4a3f-aa0a-e8da5e2e2637 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:51.460768 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701c490-201e-4a3f-aa0a-e8da5e2e2637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:51.461073 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701c490-201e-4a3f-aa0a-e8da5e2e2637 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:51.461734 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701c490-201e-4a3f-aa0a-e8da5e2e2637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:19:51.462037 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701c490-201e-4a3f-aa0a-e8da5e2e2637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:51.463679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701c490-201e-4a3f-aa0a-e8da5e2e2637 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:51.467226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:51.468114 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de604b6-2ca2-4ec2-9daf-20f612fc25d2 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:51.468400 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de604b6-2ca2-4ec2-9daf-20f612fc25d2 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:51.468849 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de604b6-2ca2-4ec2-9daf-20f612fc25d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:51.478423 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1284/2524] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:19:51.482266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701c490-201e-4a3f-aa0a-e8da5e2e2637 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:51.489841 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-5de604b6-2ca2-4ec2-9daf-20f612fc25d2 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:51.491227 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-5de604b6-2ca2-4ec2-9daf-20f612fc25d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:51.492285 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701c490-201e-4a3f-aa0a-e8da5e2e2637 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:51.497159 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f63ad-1c38-4714-9f92-25e487e27649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:51.497755 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f63ad-1c38-4714-9f92-25e487e27649 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:51.498033 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f63ad-1c38-4714-9f92-25e487e27649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:51.498329 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f63ad-1c38-4714-9f92-25e487e27649 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:51.498998 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f63ad-1c38-4714-9f92-25e487e27649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:51.499691 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1241/2525] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Sep 28 12:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:19:51.500927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f63ad-1c38-4714-9f92-25e487e27649 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:51.515247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de604b6-2ca2-4ec2-9daf-20f612fc25d2 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:51.516566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-5de604b6-2ca2-4ec2-9daf-20f612fc25d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:51.532600 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1285/2526] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:19:51 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:19:51.533536 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f63ad-1c38-4714-9f92-25e487e27649 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:51.595496 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f63ad-1c38-4714-9f92-25e487e27649 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:51.596989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de604b6-2ca2-4ec2-9daf-20f612fc25d2 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:51.600478 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07406193-ccbb-4f88-8a5c-641de274bbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:51.601220 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07406193-ccbb-4f88-8a5c-641de274bbd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:51.601500 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07406193-ccbb-4f88-8a5c-641de274bbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:51.601811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07406193-ccbb-4f88-8a5c-641de274bbd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:51.602449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07406193-ccbb-4f88-8a5c-641de274bbd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:51.604555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07406193-ccbb-4f88-8a5c-641de274bbd4 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:51.626297 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1286/2527] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:19:51 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:19:51.630277 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07406193-ccbb-4f88-8a5c-641de274bbd4 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:51.641293 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07406193-ccbb-4f88-8a5c-641de274bbd4 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:51.647772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489df10-ec05-4bfe-8168-917363154240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:51.648364 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489df10-ec05-4bfe-8168-917363154240 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:51.648644 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489df10-ec05-4bfe-8168-917363154240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:51.648915 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489df10-ec05-4bfe-8168-917363154240 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:51.649556 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489df10-ec05-4bfe-8168-917363154240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:51.651126 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489df10-ec05-4bfe-8168-917363154240 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:51.661218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1287/2528] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:19:51.664379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23367f85-8bb1-4de5-91c7-d0a23b43bf0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:51.665032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489df10-ec05-4bfe-8168-917363154240 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:51.665522 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23367f85-8bb1-4de5-91c7-d0a23b43bf0b service nova] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:51.665803 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23367f85-8bb1-4de5-91c7-d0a23b43bf0b service nova] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:51.666095 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23367f85-8bb1-4de5-91c7-d0a23b43bf0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:51.674460 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489df10-ec05-4bfe-8168-917363154240 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:51.675428 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23367f85-8bb1-4de5-91c7-d0a23b43bf0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:51.676983 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23367f85-8bb1-4de5-91c7-d0a23b43bf0b service nova] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:51.679128 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec619432-ee6d-41ab-bcaf-1551ab5b8d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:51.679752 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec619432-ee6d-41ab-bcaf-1551ab5b8d5b admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:51.680020 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec619432-ee6d-41ab-bcaf-1551ab5b8d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:51.680292 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec619432-ee6d-41ab-bcaf-1551ab5b8d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:51.680917 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec619432-ee6d-41ab-bcaf-1551ab5b8d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:51.682963 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec619432-ee6d-41ab-bcaf-1551ab5b8d5b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:51.687332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1242/2529] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:19:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:19:51.694493 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1288/2530] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:19:51.700354 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23367f85-8bb1-4de5-91c7-d0a23b43bf0b service nova] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:51.712487 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23367f85-8bb1-4de5-91c7-d0a23b43bf0b service nova] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:51.717388 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a14b26-6fdc-414e-ba8f-d7824e7742f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:51.718174 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a14b26-6fdc-414e-ba8f-d7824e7742f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:51.718459 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a14b26-6fdc-414e-ba8f-d7824e7742f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:51.718733 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a14b26-6fdc-414e-ba8f-d7824e7742f4 admin admin] PATH_INFO: `/v3/projects/6e6b6e03333e4a47a361b457104ee8f9/users/5fc61b147b894bfb9a37fe4d8f1bd5ce/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:51.736137 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a14b26-6fdc-414e-ba8f-d7824e7742f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e6b6e03333e4a47a361b457104ee8f9, user_id=5fc61b147b894bfb9a37fe4d8f1bd5ce, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:51.739136 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a14b26-6fdc-414e-ba8f-d7824e7742f4 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:51.753828 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1243/2531] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:19:51 2022] PUT /identity/v3/projects/6e6b6e03333e4a47a361b457104ee8f9/users/5fc61b147b894bfb9a37fe4d8f1bd5ce/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:19:51.764983 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15d507-35ea-4a22-8a0c-a25784148bd9 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:51.765267 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15d507-35ea-4a22-8a0c-a25784148bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:51.765538 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15d507-35ea-4a22-8a0c-a25784148bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:51.793331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-af15d507-35ea-4a22-8a0c-a25784148bd9 None None] MFA Rules not processed for user `5fc61b147b894bfb9a37fe4d8f1bd5ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:51.794554 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-af15d507-35ea-4a22-8a0c-a25784148bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:51.856423 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1289/2532] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:19:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:19:51.860801 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a14b26-6fdc-414e-ba8f-d7824e7742f4 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:51.901721 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:51.923283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a14b26-6fdc-414e-ba8f-d7824e7742f4 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:51.927935 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dfc25-aba8-485f-8066-39d6fed03b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:51.928539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dfc25-aba8-485f-8066-39d6fed03b70 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:51.928818 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dfc25-aba8-485f-8066-39d6fed03b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:51.929091 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dfc25-aba8-485f-8066-39d6fed03b70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:51.929730 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657dfc25-aba8-485f-8066-39d6fed03b70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:51.931643 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657dfc25-aba8-485f-8066-39d6fed03b70 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:51.958189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1244/2533] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:19:51 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:19:51.962475 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15d507-35ea-4a22-8a0c-a25784148bd9 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:51.973743 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15d507-35ea-4a22-8a0c-a25784148bd9 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:52.004350 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:52.032891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410eb6c-5bf6-4409-b383-f27f0bc408a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:52.033491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410eb6c-5bf6-4409-b383-f27f0bc408a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:52.033770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410eb6c-5bf6-4409-b383-f27f0bc408a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:52.034040 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410eb6c-5bf6-4409-b383-f27f0bc408a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:52.034671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410eb6c-5bf6-4409-b383-f27f0bc408a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:52.036629 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410eb6c-5bf6-4409-b383-f27f0bc408a5 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:52.059109 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1290/2534] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:19:51 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:19:52.063271 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dfc25-aba8-485f-8066-39d6fed03b70 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:52.073308 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dfc25-aba8-485f-8066-39d6fed03b70 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:52.077800 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47607ff8-f483-450f-ad32-950ff256e04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:52.078391 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47607ff8-f483-450f-ad32-950ff256e04b admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:52.078665 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47607ff8-f483-450f-ad32-950ff256e04b admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:52.078933 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47607ff8-f483-450f-ad32-950ff256e04b admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:52.079598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47607ff8-f483-450f-ad32-950ff256e04b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:52.081181 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47607ff8-f483-450f-ad32-950ff256e04b admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:52.091533 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1245/2535] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:19:52.095399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410eb6c-5bf6-4409-b383-f27f0bc408a5 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:52.106005 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410eb6c-5bf6-4409-b383-f27f0bc408a5 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:52.110754 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0f639-acf7-47e7-9ff1-d255e55bb882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:52.111310 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0f639-acf7-47e7-9ff1-d255e55bb882 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:52.111607 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0f639-acf7-47e7-9ff1-d255e55bb882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:52.111876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0f639-acf7-47e7-9ff1-d255e55bb882 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:52.112535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0f639-acf7-47e7-9ff1-d255e55bb882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:52.114258 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0f639-acf7-47e7-9ff1-d255e55bb882 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:52.125133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1291/2536] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:19:52.129019 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47607ff8-f483-450f-ad32-950ff256e04b admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:52.138704 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47607ff8-f483-450f-ad32-950ff256e04b admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:52.143583 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac8519-a990-4e21-92b1-1a8943f39d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:52.144221 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac8519-a990-4e21-92b1-1a8943f39d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:52.144499 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac8519-a990-4e21-92b1-1a8943f39d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:52.144766 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac8519-a990-4e21-92b1-1a8943f39d44 admin admin] PATH_INFO: `/v3/projects/16edcd7afbfb49dc9038e99edd9d2e8a/users/1bb9c2f939744128a41a0e20459712b4/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:52.160030 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac8519-a990-4e21-92b1-1a8943f39d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16edcd7afbfb49dc9038e99edd9d2e8a, user_id=1bb9c2f939744128a41a0e20459712b4, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:52.162639 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac8519-a990-4e21-92b1-1a8943f39d44 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:52.176629 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1246/2537] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:19:52 2022] PUT /identity/v3/projects/16edcd7afbfb49dc9038e99edd9d2e8a/users/1bb9c2f939744128a41a0e20459712b4/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:19:52.188449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36b343-4a9b-4edf-ad9b-7de9f1a444dd None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:52.188737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36b343-4a9b-4edf-ad9b-7de9f1a444dd None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:52.189011 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36b343-4a9b-4edf-ad9b-7de9f1a444dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:52.218925 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-7c36b343-4a9b-4edf-ad9b-7de9f1a444dd None None] MFA Rules not processed for user `1bb9c2f939744128a41a0e20459712b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:52.220157 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7c36b343-4a9b-4edf-ad9b-7de9f1a444dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:52.288065 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1292/2538] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:19:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:19:52.293017 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac8519-a990-4e21-92b1-1a8943f39d44 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:52.354263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac8519-a990-4e21-92b1-1a8943f39d44 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:52.359506 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4578f-e4dd-489e-833a-5779880447d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:52.360078 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4578f-e4dd-489e-833a-5779880447d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:52.360365 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4578f-e4dd-489e-833a-5779880447d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:52.360638 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4578f-e4dd-489e-833a-5779880447d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:52.361317 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4578f-e4dd-489e-833a-5779880447d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:52.363154 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4578f-e4dd-489e-833a-5779880447d8 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:52.389442 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1247/2539] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:19:52 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:19:52.393824 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36b343-4a9b-4edf-ad9b-7de9f1a444dd None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:52.404817 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36b343-4a9b-4edf-ad9b-7de9f1a444dd None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:52.462016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309705a-c5ea-4adb-b7cc-95ffceb8dd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:52.462626 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309705a-c5ea-4adb-b7cc-95ffceb8dd34 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:52.462900 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309705a-c5ea-4adb-b7cc-95ffceb8dd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:52.463169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309705a-c5ea-4adb-b7cc-95ffceb8dd34 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:52.464401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309705a-c5ea-4adb-b7cc-95ffceb8dd34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:52.466711 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309705a-c5ea-4adb-b7cc-95ffceb8dd34 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:52.488408 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1293/2540] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:19:52 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:19:52.492432 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4578f-e4dd-489e-833a-5779880447d8 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:52.502937 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4578f-e4dd-489e-833a-5779880447d8 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:52.507654 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359329e-5680-4c17-a4ba-275d899ffa6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:52.508247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359329e-5680-4c17-a4ba-275d899ffa6a admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:52.508527 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359329e-5680-4c17-a4ba-275d899ffa6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:52.508800 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359329e-5680-4c17-a4ba-275d899ffa6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:52.509464 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359329e-5680-4c17-a4ba-275d899ffa6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:52.511077 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359329e-5680-4c17-a4ba-275d899ffa6a admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:52.521517 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1248/2541] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:19:52.525414 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309705a-c5ea-4adb-b7cc-95ffceb8dd34 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:52.535832 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309705a-c5ea-4adb-b7cc-95ffceb8dd34 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:52.540348 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcd8d9-9413-4382-aba7-20a51f756130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:52.540987 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcd8d9-9413-4382-aba7-20a51f756130 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:52.541266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcd8d9-9413-4382-aba7-20a51f756130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:52.541537 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcd8d9-9413-4382-aba7-20a51f756130 admin admin] PATH_INFO: `/v3/projects/73c1d524e6934326b619d66b6d9ab28f/users/c929d7f4d94e47839697707c081940bc/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:52.556388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcd8d9-9413-4382-aba7-20a51f756130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73c1d524e6934326b619d66b6d9ab28f, user_id=c929d7f4d94e47839697707c081940bc, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:52.559018 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcd8d9-9413-4382-aba7-20a51f756130 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:52.571215 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1294/2542] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:19:52 2022] PUT /identity/v3/projects/73c1d524e6934326b619d66b6d9ab28f/users/c929d7f4d94e47839697707c081940bc/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:19:52.575097 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359329e-5680-4c17-a4ba-275d899ffa6a admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:52.584985 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359329e-5680-4c17-a4ba-275d899ffa6a admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:52.640719 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55068af0-4fdd-412c-90ae-1a8a3c147cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:52.641246 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55068af0-4fdd-412c-90ae-1a8a3c147cef admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:52.641560 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55068af0-4fdd-412c-90ae-1a8a3c147cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:52.641835 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55068af0-4fdd-412c-90ae-1a8a3c147cef admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:52.642470 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55068af0-4fdd-412c-90ae-1a8a3c147cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:52.644087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55068af0-4fdd-412c-90ae-1a8a3c147cef admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:52.646102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:52.655371 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1249/2543] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:19:52.659236 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcd8d9-9413-4382-aba7-20a51f756130 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:52.665713 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:52.670159 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcd8d9-9413-4382-aba7-20a51f756130 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:52.675782 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7de8d-0bf6-4e34-bfb1-c84695b0a40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:52.676427 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7de8d-0bf6-4e34-bfb1-c84695b0a40d admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:52.676704 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7de8d-0bf6-4e34-bfb1-c84695b0a40d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:52.676976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7de8d-0bf6-4e34-bfb1-c84695b0a40d admin admin] PATH_INFO: `/v3/projects/73c1d524e6934326b619d66b6d9ab28f/users/c929d7f4d94e47839697707c081940bc/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:52.678884 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7de8d-0bf6-4e34-bfb1-c84695b0a40d admin admin] RBAC: Authorizing `identity:create_grant(project_id=73c1d524e6934326b619d66b6d9ab28f, user_id=c929d7f4d94e47839697707c081940bc, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:52.681511 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7de8d-0bf6-4e34-bfb1-c84695b0a40d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:52.692050 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1295/2544] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:19:52 2022] PUT /identity/v3/projects/73c1d524e6934326b619d66b6d9ab28f/users/c929d7f4d94e47839697707c081940bc/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:19:52.706485 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd3556-cbd6-4e93-8199-a4cdbc9391df None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:52.707100 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd3556-cbd6-4e93-8199-a4cdbc9391df None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:52.707405 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd3556-cbd6-4e93-8199-a4cdbc9391df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:52.738753 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-62dd3556-cbd6-4e93-8199-a4cdbc9391df None None] MFA Rules not processed for user `c929d7f4d94e47839697707c081940bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:52.740030 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-62dd3556-cbd6-4e93-8199-a4cdbc9391df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:52.807835 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1250/2545] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:19:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:19:52.819283 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7de8d-0bf6-4e34-bfb1-c84695b0a40d admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:52.820987 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-66e7de8d-0bf6-4e34-bfb1-c84695b0a40d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:52.877832 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7de8d-0bf6-4e34-bfb1-c84695b0a40d admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:52.881597 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f4f6f-22b2-4150-ae3d-e7663b6d2536 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:52.882193 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f4f6f-22b2-4150-ae3d-e7663b6d2536 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:52.882470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f4f6f-22b2-4150-ae3d-e7663b6d2536 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:52.882768 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f4f6f-22b2-4150-ae3d-e7663b6d2536 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:52.937714 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f4f6f-22b2-4150-ae3d-e7663b6d2536 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:52.939059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f4f6f-22b2-4150-ae3d-e7663b6d2536 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:52.947844 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1296/2546] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:19:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:19:53.388767 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd3556-cbd6-4e93-8199-a4cdbc9391df None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:53.390232 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-62dd3556-cbd6-4e93-8199-a4cdbc9391df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:53.447453 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd3556-cbd6-4e93-8199-a4cdbc9391df None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:53.452096 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7b31c-a1a7-4a5e-802f-60dff2526398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:53.452677 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7b31c-a1a7-4a5e-802f-60dff2526398 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:53.452981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7b31c-a1a7-4a5e-802f-60dff2526398 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:53.453357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7b31c-a1a7-4a5e-802f-60dff2526398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:53.455379 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-cae7b31c-a1a7-4a5e-802f-60dff2526398 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:53.530083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7b31c-a1a7-4a5e-802f-60dff2526398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:53.531545 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7b31c-a1a7-4a5e-802f-60dff2526398 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:53.543121 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1251/2547] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:19:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:19:54.473631 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f4f6f-22b2-4150-ae3d-e7663b6d2536 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:54.475005 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-086f4f6f-22b2-4150-ae3d-e7663b6d2536 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:54.485993 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f4f6f-22b2-4150-ae3d-e7663b6d2536 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:54.489558 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172508eb-23e2-4d09-bc7b-de4acfe56a83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:54.490141 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172508eb-23e2-4d09-bc7b-de4acfe56a83 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:54.490415 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172508eb-23e2-4d09-bc7b-de4acfe56a83 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:54.490682 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172508eb-23e2-4d09-bc7b-de4acfe56a83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:54.552785 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172508eb-23e2-4d09-bc7b-de4acfe56a83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:54.554207 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172508eb-23e2-4d09-bc7b-de4acfe56a83 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:54.563771 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1297/2548] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:19:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:19:54.616599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab02d12-8f6c-4625-90df-4931b9ce2b1d None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:54.617073 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab02d12-8f6c-4625-90df-4931b9ce2b1d None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:54.617169 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab02d12-8f6c-4625-90df-4931b9ce2b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:54.637129 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-dab02d12-8f6c-4625-90df-4931b9ce2b1d None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:54.638340 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-dab02d12-8f6c-4625-90df-4931b9ce2b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:54.661462 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:54.715680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1252/2549] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Sep 28 12:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:19:54.731366 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172508eb-23e2-4d09-bc7b-de4acfe56a83 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:54.732513 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab02d12-8f6c-4625-90df-4931b9ce2b1d None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:54.745137 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172508eb-23e2-4d09-bc7b-de4acfe56a83 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:54.746127 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab02d12-8f6c-4625-90df-4931b9ce2b1d None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:54.749606 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fe924-4303-44ae-8b0c-984baf696ced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:54.750395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fe924-4303-44ae-8b0c-984baf696ced service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:54.751115 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fe924-4303-44ae-8b0c-984baf696ced service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:54.751115 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fe924-4303-44ae-8b0c-984baf696ced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:54.752543 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22b2af-bff0-4914-a753-132c453daae0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:54.753445 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22b2af-bff0-4914-a753-132c453daae0 service nova] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:54.753445 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22b2af-bff0-4914-a753-132c453daae0 service nova] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:54.753759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22b2af-bff0-4914-a753-132c453daae0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:54.753904 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-bb0fe924-4303-44ae-8b0c-984baf696ced service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:54.762170 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22b2af-bff0-4914-a753-132c453daae0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:54.763761 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22b2af-bff0-4914-a753-132c453daae0 service nova] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:54.769042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0fe924-4303-44ae-8b0c-984baf696ced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:54.770610 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0fe924-4303-44ae-8b0c-984baf696ced service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:54.774518 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1253/2550] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:19:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:19:54.798380 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1298/2551] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:19:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:19:55.137616 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22b2af-bff0-4914-a753-132c453daae0 service nova] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:55.146864 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22b2af-bff0-4914-a753-132c453daae0 service nova] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:55.150401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4db6c-8f78-40f3-a82e-9885ae547104 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:55.150980 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4db6c-8f78-40f3-a82e-9885ae547104 service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:55.151312 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4db6c-8f78-40f3-a82e-9885ae547104 service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:55.152115 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4db6c-8f78-40f3-a82e-9885ae547104 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:55.160818 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4db6c-8f78-40f3-a82e-9885ae547104 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:55.162219 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4db6c-8f78-40f3-a82e-9885ae547104 service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:55.171325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1254/2552] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:19:55 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:19:57.802201 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37bdb2-041f-416e-a5c7-84b187cb7fe0 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:57.802692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37bdb2-041f-416e-a5c7-84b187cb7fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:57.802908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37bdb2-041f-416e-a5c7-84b187cb7fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:57.826426 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-7d37bdb2-041f-416e-a5c7-84b187cb7fe0 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:57.828024 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7d37bdb2-041f-416e-a5c7-84b187cb7fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:57.836356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1299/2553] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Sep 28 12:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:19:57.862888 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4db6c-8f78-40f3-a82e-9885ae547104 service cinder] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:57.865426 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-a8a4db6c-8f78-40f3-a82e-9885ae547104 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:57.881900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4db6c-8f78-40f3-a82e-9885ae547104 service cinder] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:57.888064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80a79d-69d6-4845-8cfb-a3c1a6f11282 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:57.888663 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80a79d-69d6-4845-8cfb-a3c1a6f11282 service nova] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:57.888939 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80a79d-69d6-4845-8cfb-a3c1a6f11282 service nova] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:57.889206 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80a79d-69d6-4845-8cfb-a3c1a6f11282 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:57.898686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80a79d-69d6-4845-8cfb-a3c1a6f11282 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:57.900762 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80a79d-69d6-4845-8cfb-a3c1a6f11282 service nova] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:57.911069 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1255/2554] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:19:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:19:59.079649 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37bdb2-041f-416e-a5c7-84b187cb7fe0 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:59.089936 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37bdb2-041f-416e-a5c7-84b187cb7fe0 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:59.094511 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e2389-c67b-4239-b2d7-f10ffa6f3992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:59.095158 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e2389-c67b-4239-b2d7-f10ffa6f3992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:59.095484 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e2389-c67b-4239-b2d7-f10ffa6f3992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:59.095788 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e2389-c67b-4239-b2d7-f10ffa6f3992 admin admin] PATH_INFO: `/v3/users/5fc61b147b894bfb9a37fe4d8f1bd5ce` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:59.096891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e2389-c67b-4239-b2d7-f10ffa6f3992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fc61b147b894bfb9a37fe4d8f1bd5ce)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:59.098777 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e2389-c67b-4239-b2d7-f10ffa6f3992 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:59.119660 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:59.146010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-958e2389-c67b-4239-b2d7-f10ffa6f3992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fc61b147b894bfb9a37fe4d8f1bd5ce'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:59.146657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-958e2389-c67b-4239-b2d7-f10ffa6f3992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fc61b147b894bfb9a37fe4d8f1bd5ce'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:59.153632 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-958e2389-c67b-4239-b2d7-f10ffa6f3992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fc61b147b894bfb9a37fe4d8f1bd5ce'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:59.160753 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-958e2389-c67b-4239-b2d7-f10ffa6f3992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fc61b147b894bfb9a37fe4d8f1bd5ce'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:59.161354 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-958e2389-c67b-4239-b2d7-f10ffa6f3992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fc61b147b894bfb9a37fe4d8f1bd5ce'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:59.178175 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1300/2555] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:19:59 2022] DELETE /identity/v3/users/5fc61b147b894bfb9a37fe4d8f1bd5ce => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:19:59.183159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c951fd5-fdab-4673-a072-767137816c2f None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:59.183667 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c951fd5-fdab-4673-a072-767137816c2f None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:59.183764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c951fd5-fdab-4673-a072-767137816c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:59.202862 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-9c951fd5-fdab-4673-a072-767137816c2f None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:59.204271 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-9c951fd5-fdab-4673-a072-767137816c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:59.263479 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1256/2556] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:19:59.272799 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e2389-c67b-4239-b2d7-f10ffa6f3992 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:59.274174 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-958e2389-c67b-4239-b2d7-f10ffa6f3992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:59.329607 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e2389-c67b-4239-b2d7-f10ffa6f3992 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:59.333188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5de50-4d87-47e5-969d-94c824225010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:59.333807 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5de50-4d87-47e5-969d-94c824225010 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:59.334080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5de50-4d87-47e5-969d-94c824225010 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:59.334345 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5de50-4d87-47e5-969d-94c824225010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:59.343042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5de50-4d87-47e5-969d-94c824225010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:59.344468 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5de50-4d87-47e5-969d-94c824225010 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:59.353531 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1301/2557] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:19:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:19:59.727887 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c951fd5-fdab-4673-a072-767137816c2f None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:59.739687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-9c951fd5-fdab-4673-a072-767137816c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:59.782060 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c951fd5-fdab-4673-a072-767137816c2f None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:59.803802 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17a9f4-7b4f-43fe-a6b8-bfef26b9dcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:59.803802 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17a9f4-7b4f-43fe-a6b8-bfef26b9dcc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:59.803802 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17a9f4-7b4f-43fe-a6b8-bfef26b9dcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:59.803802 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17a9f4-7b4f-43fe-a6b8-bfef26b9dcc6 admin admin] PATH_INFO: `/v3/projects/6e6b6e03333e4a47a361b457104ee8f9` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:59.804189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17a9f4-7b4f-43fe-a6b8-bfef26b9dcc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e6b6e03333e4a47a361b457104ee8f9)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:59.804189 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17a9f4-7b4f-43fe-a6b8-bfef26b9dcc6 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:59.877900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-2f17a9f4-7b4f-43fe-a6b8-bfef26b9dcc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e6b6e03333e4a47a361b457104ee8f9', 'request_id': 'req-2f17a9f4-7b4f-43fe-a6b8-bfef26b9dcc6'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:59.884531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-2f17a9f4-7b4f-43fe-a6b8-bfef26b9dcc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e6b6e03333e4a47a361b457104ee8f9', 'request_id': 'req-2f17a9f4-7b4f-43fe-a6b8-bfef26b9dcc6'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:59.892726 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-2f17a9f4-7b4f-43fe-a6b8-bfef26b9dcc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e6b6e03333e4a47a361b457104ee8f9', 'request_id': 'req-2f17a9f4-7b4f-43fe-a6b8-bfef26b9dcc6'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:59.907248 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-2f17a9f4-7b4f-43fe-a6b8-bfef26b9dcc6 admin admin] The token cache is being invalidate because project 6e6b6e03333e4a47a361b457104ee8f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:19:59.907644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-2f17a9f4-7b4f-43fe-a6b8-bfef26b9dcc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:59.908455 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-2f17a9f4-7b4f-43fe-a6b8-bfef26b9dcc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:59.910120 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1257/2558] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:19:59 2022] DELETE /identity/v3/projects/6e6b6e03333e4a47a361b457104ee8f9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:19:59.914316 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5de50-4d87-47e5-969d-94c824225010 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:59.925057 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5de50-4d87-47e5-969d-94c824225010 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:00.004947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070596d-88eb-49f4-9b10-82a5a7598f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:00.005427 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070596d-88eb-49f4-9b10-82a5a7598f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:00.005785 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070596d-88eb-49f4-9b10-82a5a7598f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:00.005976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070596d-88eb-49f4-9b10-82a5a7598f4b admin admin] PATH_INFO: `/v3/users/1bb9c2f939744128a41a0e20459712b4` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:00.007124 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070596d-88eb-49f4-9b10-82a5a7598f4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bb9c2f939744128a41a0e20459712b4)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:00.009074 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070596d-88eb-49f4-9b10-82a5a7598f4b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:00.071257 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:00.078160 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-6070596d-88eb-49f4-9b10-82a5a7598f4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bb9c2f939744128a41a0e20459712b4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:00.079009 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-6070596d-88eb-49f4-9b10-82a5a7598f4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bb9c2f939744128a41a0e20459712b4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:00.089177 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-6070596d-88eb-49f4-9b10-82a5a7598f4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bb9c2f939744128a41a0e20459712b4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:00.098979 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-6070596d-88eb-49f4-9b10-82a5a7598f4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bb9c2f939744128a41a0e20459712b4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:00.100065 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-6070596d-88eb-49f4-9b10-82a5a7598f4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bb9c2f939744128a41a0e20459712b4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:00.121101 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1302/2559] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:19:59 2022] DELETE /identity/v3/users/1bb9c2f939744128a41a0e20459712b4 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:20:00.423958 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17a9f4-7b4f-43fe-a6b8-bfef26b9dcc6 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:00.425657 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-2f17a9f4-7b4f-43fe-a6b8-bfef26b9dcc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:00.439526 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17a9f4-7b4f-43fe-a6b8-bfef26b9dcc6 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:00.445121 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:00.513845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01658f5b-a5ea-479e-9c70-1b7437ab7baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:00.514881 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01658f5b-a5ea-479e-9c70-1b7437ab7baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:00.515374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01658f5b-a5ea-479e-9c70-1b7437ab7baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:00.515893 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01658f5b-a5ea-479e-9c70-1b7437ab7baa admin admin] PATH_INFO: `/v3/projects/16edcd7afbfb49dc9038e99edd9d2e8a` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:00.517626 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01658f5b-a5ea-479e-9c70-1b7437ab7baa admin admin] RBAC: Authorizing `identity:delete_project(project_id=16edcd7afbfb49dc9038e99edd9d2e8a)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:00.519559 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01658f5b-a5ea-479e-9c70-1b7437ab7baa admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:00.579823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-01658f5b-a5ea-479e-9c70-1b7437ab7baa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16edcd7afbfb49dc9038e99edd9d2e8a', 'request_id': 'req-01658f5b-a5ea-479e-9c70-1b7437ab7baa'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:00.585278 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-01658f5b-a5ea-479e-9c70-1b7437ab7baa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16edcd7afbfb49dc9038e99edd9d2e8a', 'request_id': 'req-01658f5b-a5ea-479e-9c70-1b7437ab7baa'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:00.595838 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-01658f5b-a5ea-479e-9c70-1b7437ab7baa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16edcd7afbfb49dc9038e99edd9d2e8a', 'request_id': 'req-01658f5b-a5ea-479e-9c70-1b7437ab7baa'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:00.608927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-01658f5b-a5ea-479e-9c70-1b7437ab7baa admin admin] The token cache is being invalidate because project 16edcd7afbfb49dc9038e99edd9d2e8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:20:00.609345 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-01658f5b-a5ea-479e-9c70-1b7437ab7baa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:00.610014 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-01658f5b-a5ea-479e-9c70-1b7437ab7baa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:00.611903 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1258/2560] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:20:00 2022] DELETE /identity/v3/projects/16edcd7afbfb49dc9038e99edd9d2e8a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:20:00.615771 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070596d-88eb-49f4-9b10-82a5a7598f4b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:00.617324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6070596d-88eb-49f4-9b10-82a5a7598f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:00.634461 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070596d-88eb-49f4-9b10-82a5a7598f4b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:00.702109 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9224e-463a-4193-aee6-4c3661eca0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:00.702799 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9224e-463a-4193-aee6-4c3661eca0e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:00.703090 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9224e-463a-4193-aee6-4c3661eca0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:00.703353 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9224e-463a-4193-aee6-4c3661eca0e1 admin admin] PATH_INFO: `/v3/users/c929d7f4d94e47839697707c081940bc` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:00.704662 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9224e-463a-4193-aee6-4c3661eca0e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c929d7f4d94e47839697707c081940bc)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:00.706630 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9224e-463a-4193-aee6-4c3661eca0e1 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:00.764465 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e6d9224e-463a-4193-aee6-4c3661eca0e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c929d7f4d94e47839697707c081940bc'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:00.765247 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e6d9224e-463a-4193-aee6-4c3661eca0e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c929d7f4d94e47839697707c081940bc'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:00.773519 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e6d9224e-463a-4193-aee6-4c3661eca0e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c929d7f4d94e47839697707c081940bc'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:00.785395 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e6d9224e-463a-4193-aee6-4c3661eca0e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c929d7f4d94e47839697707c081940bc'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:00.786033 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e6d9224e-463a-4193-aee6-4c3661eca0e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c929d7f4d94e47839697707c081940bc'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:00.812115 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1303/2561] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:20:00 2022] DELETE /identity/v3/users/c929d7f4d94e47839697707c081940bc => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:20:01.222819 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39404e-c727-4486-bb13-1d62bb8ae137 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:01.223104 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39404e-c727-4486-bb13-1d62bb8ae137 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:01.225448 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39404e-c727-4486-bb13-1d62bb8ae137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:01.247608 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9224e-463a-4193-aee6-4c3661eca0e1 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:01.250508 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e6d9224e-463a-4193-aee6-4c3661eca0e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:01.263883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-3c39404e-c727-4486-bb13-1d62bb8ae137 None None] MFA Rules not processed for user `c0e57ea982d349c1a86b544e9a6e7758`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:01.265367 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-3c39404e-c727-4486-bb13-1d62bb8ae137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:01.315716 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:01.341807 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1259/2562] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 28 12:20:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:01.344394 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9224e-463a-4193-aee6-4c3661eca0e1 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:01.350791 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529961e-f390-4464-901a-139b7c310a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:01.351410 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529961e-f390-4464-901a-139b7c310a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:01.351789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529961e-f390-4464-901a-139b7c310a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:01.352284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529961e-f390-4464-901a-139b7c310a9f admin admin] PATH_INFO: `/v3/projects/73c1d524e6934326b619d66b6d9ab28f` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:01.353696 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529961e-f390-4464-901a-139b7c310a9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=73c1d524e6934326b619d66b6d9ab28f)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:01.356668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529961e-f390-4464-901a-139b7c310a9f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:01.393488 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39404e-c727-4486-bb13-1d62bb8ae137 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:01.395137 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-3c39404e-c727-4486-bb13-1d62bb8ae137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:01.414266 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3529961e-f390-4464-901a-139b7c310a9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73c1d524e6934326b619d66b6d9ab28f', 'request_id': 'req-3529961e-f390-4464-901a-139b7c310a9f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:01.422104 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3529961e-f390-4464-901a-139b7c310a9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73c1d524e6934326b619d66b6d9ab28f', 'request_id': 'req-3529961e-f390-4464-901a-139b7c310a9f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:01.428564 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3529961e-f390-4464-901a-139b7c310a9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73c1d524e6934326b619d66b6d9ab28f', 'request_id': 'req-3529961e-f390-4464-901a-139b7c310a9f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:01.442216 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3529961e-f390-4464-901a-139b7c310a9f admin admin] The token cache is being invalidate because project 73c1d524e6934326b619d66b6d9ab28f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:20:01.442500 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3529961e-f390-4464-901a-139b7c310a9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:01.443544 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3529961e-f390-4464-901a-139b7c310a9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:01.445551 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1304/2563] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:20:01 2022] DELETE /identity/v3/projects/73c1d524e6934326b619d66b6d9ab28f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:20:01.452972 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec59f8-fa57-4661-bcec-433887a50115 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:01.453149 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec59f8-fa57-4661-bcec-433887a50115 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:01.453393 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec59f8-fa57-4661-bcec-433887a50115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:01.455763 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:01.478419 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-7fec59f8-fa57-4661-bcec-433887a50115 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:01.480249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7fec59f8-fa57-4661-bcec-433887a50115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:01.486759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39404e-c727-4486-bb13-1d62bb8ae137 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:01.558598 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1305/2564] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:20:01.563866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797ac39-5a3d-4307-9d6b-e4baea663c05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '822e394e80fd41adb54d330adaf65a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:01.564479 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797ac39-5a3d-4307-9d6b-e4baea663c05 service swift] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:01.564772 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797ac39-5a3d-4307-9d6b-e4baea663c05 service swift] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:01.565302 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797ac39-5a3d-4307-9d6b-e4baea663c05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:01.566335 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2fc9f-73a3-49ae-ba15-4ea7e107b066 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:01.566632 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2fc9f-73a3-49ae-ba15-4ea7e107b066 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:01.566906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2fc9f-73a3-49ae-ba15-4ea7e107b066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:01.567324 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-9797ac39-5a3d-4307-9d6b-e4baea663c05 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:01.587612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-7fd2fc9f-73a3-49ae-ba15-4ea7e107b066 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:01.588846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7fd2fc9f-73a3-49ae-ba15-4ea7e107b066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:01.598071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1306/2565] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:20:01.602100 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2fc9f-73a3-49ae-ba15-4ea7e107b066 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:01.614275 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2fc9f-73a3-49ae-ba15-4ea7e107b066 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:01.619182 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fb2b6-a49f-447e-ab50-312b2207d453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:01.620676 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fb2b6-a49f-447e-ab50-312b2207d453 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:01.620955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fb2b6-a49f-447e-ab50-312b2207d453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:01.621227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fb2b6-a49f-447e-ab50-312b2207d453 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:01.621871 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fb2b6-a49f-447e-ab50-312b2207d453 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:20:01.622172 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fb2b6-a49f-447e-ab50-312b2207d453 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:01.623792 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fb2b6-a49f-447e-ab50-312b2207d453 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:01.632140 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797ac39-5a3d-4307-9d6b-e4baea663c05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:01.634662 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797ac39-5a3d-4307-9d6b-e4baea663c05 service swift] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:01.636841 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1307/2566] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:20:01.640865 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fb2b6-a49f-447e-ab50-312b2207d453 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:01.645604 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1260/2567] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 28 12:20:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 28 12:20:01.652757 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fb2b6-a49f-447e-ab50-312b2207d453 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:01.657383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c956baf-8f34-4064-a859-2c08fd37bcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:01.657980 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c956baf-8f34-4064-a859-2c08fd37bcaa admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:01.658253 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c956baf-8f34-4064-a859-2c08fd37bcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:01.658568 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c956baf-8f34-4064-a859-2c08fd37bcaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:01.659268 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c956baf-8f34-4064-a859-2c08fd37bcaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:01.661401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c956baf-8f34-4064-a859-2c08fd37bcaa admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:01.705291 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1308/2568] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:20:01 2022] POST /identity/v3/projects => generated 363 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:20:01.710773 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797ac39-5a3d-4307-9d6b-e4baea663c05 service swift] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:01.724349 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797ac39-5a3d-4307-9d6b-e4baea663c05 service swift] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:01.804125 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79527452-90ab-4a50-8bb1-764da9df8aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:01.804745 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79527452-90ab-4a50-8bb1-764da9df8aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:01.805030 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79527452-90ab-4a50-8bb1-764da9df8aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:01.805309 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79527452-90ab-4a50-8bb1-764da9df8aa1 admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:01.805962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79527452-90ab-4a50-8bb1-764da9df8aa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:01.808017 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79527452-90ab-4a50-8bb1-764da9df8aa1 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:01.834853 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1261/2569] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:20:01 2022] POST /identity/v3/users => generated 282 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:20:01.839064 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c956baf-8f34-4064-a859-2c08fd37bcaa admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:01.856524 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c956baf-8f34-4064-a859-2c08fd37bcaa admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:01.861336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383f49b-d287-4631-8d68-175ad6cdcd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:01.861942 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383f49b-d287-4631-8d68-175ad6cdcd03 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:01.862217 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383f49b-d287-4631-8d68-175ad6cdcd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:01.862486 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383f49b-d287-4631-8d68-175ad6cdcd03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:01.863138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383f49b-d287-4631-8d68-175ad6cdcd03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:01.864726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383f49b-d287-4631-8d68-175ad6cdcd03 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:01.883307 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1309/2570] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:20:01.884709 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79527452-90ab-4a50-8bb1-764da9df8aa1 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:01.899187 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79527452-90ab-4a50-8bb1-764da9df8aa1 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:01.907463 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67010aa-6684-4e59-ab4a-addf699138ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:01.908095 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67010aa-6684-4e59-ab4a-addf699138ff admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:01.908669 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67010aa-6684-4e59-ab4a-addf699138ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:01.908669 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67010aa-6684-4e59-ab4a-addf699138ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:01.909732 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67010aa-6684-4e59-ab4a-addf699138ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:01.911422 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67010aa-6684-4e59-ab4a-addf699138ff admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:01.931943 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1262/2571] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:20:01.937300 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383f49b-d287-4631-8d68-175ad6cdcd03 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:01.949786 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383f49b-d287-4631-8d68-175ad6cdcd03 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:01.957200 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aff0c9-e364-43f6-8246-a32aad5567cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:01.957857 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aff0c9-e364-43f6-8246-a32aad5567cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:01.958172 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aff0c9-e364-43f6-8246-a32aad5567cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:01.958447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aff0c9-e364-43f6-8246-a32aad5567cd admin admin] PATH_INFO: `/v3/projects/ab1f03a509364ffa8078a69cae024bcc/users/01b15b772c1245f3b8155fc2cced06ca/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:01.984912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:02.008693 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aff0c9-e364-43f6-8246-a32aad5567cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab1f03a509364ffa8078a69cae024bcc, user_id=01b15b772c1245f3b8155fc2cced06ca, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:02.020305 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aff0c9-e364-43f6-8246-a32aad5567cd admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:02.052278 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1310/2572] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:20:01 2022] PUT /identity/v3/projects/ab1f03a509364ffa8078a69cae024bcc/users/01b15b772c1245f3b8155fc2cced06ca/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:20:02.066457 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a43d66-e787-4f91-b651-1e77bf612433 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:02.066757 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a43d66-e787-4f91-b651-1e77bf612433 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:02.067033 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a43d66-e787-4f91-b651-1e77bf612433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:02.085164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:02.109823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-e7a43d66-e787-4f91-b651-1e77bf612433 None None] MFA Rules not processed for user `01b15b772c1245f3b8155fc2cced06ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:02.111088 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-e7a43d66-e787-4f91-b651-1e77bf612433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:02.269252 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1263/2573] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:20:02.276732 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aff0c9-e364-43f6-8246-a32aad5567cd admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:02.287191 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-51aff0c9-e364-43f6-8246-a32aad5567cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:02.412444 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aff0c9-e364-43f6-8246-a32aad5567cd admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:02.421694 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38128926-4014-4960-a486-7c7d3b45777b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:02.422372 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38128926-4014-4960-a486-7c7d3b45777b service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:02.423056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38128926-4014-4960-a486-7c7d3b45777b service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:02.423056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38128926-4014-4960-a486-7c7d3b45777b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:02.446657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38128926-4014-4960-a486-7c7d3b45777b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:02.454083 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38128926-4014-4960-a486-7c7d3b45777b service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:02.468933 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1311/2574] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:20:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:20:02.630465 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a43d66-e787-4f91-b651-1e77bf612433 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:02.633208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-e7a43d66-e787-4f91-b651-1e77bf612433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:02.661523 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a43d66-e787-4f91-b651-1e77bf612433 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:02.678921 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48d1d6-16ae-4d87-9312-7703f13e6d75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:02.680982 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48d1d6-16ae-4d87-9312-7703f13e6d75 service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:02.682064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48d1d6-16ae-4d87-9312-7703f13e6d75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:02.683704 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48d1d6-16ae-4d87-9312-7703f13e6d75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:02.689169 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-3b48d1d6-16ae-4d87-9312-7703f13e6d75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:02.838156 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48d1d6-16ae-4d87-9312-7703f13e6d75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:02.839740 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48d1d6-16ae-4d87-9312-7703f13e6d75 service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:02.853133 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1264/2575] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:20:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:20:05.790776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38128926-4014-4960-a486-7c7d3b45777b service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:05.793591 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-38128926-4014-4960-a486-7c7d3b45777b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:05.892287 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38128926-4014-4960-a486-7c7d3b45777b service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:05.899816 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f55112-744a-4a58-94f2-fdbecb348364 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:05.900536 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f55112-744a-4a58-94f2-fdbecb348364 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:05.900887 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f55112-744a-4a58-94f2-fdbecb348364 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:05.902182 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f55112-744a-4a58-94f2-fdbecb348364 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:05.904878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c7f55112-744a-4a58-94f2-fdbecb348364 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:06.013322 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f55112-744a-4a58-94f2-fdbecb348364 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:06.015298 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f55112-744a-4a58-94f2-fdbecb348364 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:06.026867 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1312/2576] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:20:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:20:12.846109 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=57 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:16.022109 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=85,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:20.004076 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48d1d6-16ae-4d87-9312-7703f13e6d75 service cinder] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:20.005542 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-3b48d1d6-16ae-4d87-9312-7703f13e6d75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:20.077545 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48d1d6-16ae-4d87-9312-7703f13e6d75 service cinder] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:20.082682 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2afa8-e0ce-41f9-8412-a8394012ed35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09e495edc6fd47c892679bb908c3f5bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:20.083328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2afa8-e0ce-41f9-8412-a8394012ed35 service placement] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:20.083689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2afa8-e0ce-41f9-8412-a8394012ed35 service placement] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:20.084053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2afa8-e0ce-41f9-8412-a8394012ed35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:20.085643 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-07a2afa8-e0ce-41f9-8412-a8394012ed35 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:20.096976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2afa8-e0ce-41f9-8412-a8394012ed35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:20.098592 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2afa8-e0ce-41f9-8412-a8394012ed35 service placement] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:20.109021 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1265/2577] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:20:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:20:21.503178 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f55112-744a-4a58-94f2-fdbecb348364 service nova] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:21.504661 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c7f55112-744a-4a58-94f2-fdbecb348364 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:21.562569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f55112-744a-4a58-94f2-fdbecb348364 service nova] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:21.566229 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4ddad-c03d-41fb-9404-d7226f00533a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:21.566833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4ddad-c03d-41fb-9404-d7226f00533a service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:21.567114 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4ddad-c03d-41fb-9404-d7226f00533a service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:21.567389 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4ddad-c03d-41fb-9404-d7226f00533a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:21.569143 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-68e4ddad-c03d-41fb-9404-d7226f00533a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:21.578528 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4ddad-c03d-41fb-9404-d7226f00533a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:21.579920 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4ddad-c03d-41fb-9404-d7226f00533a service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:21.587914 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1313/2578] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:20:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:20:22.188808 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d73ff-1e0b-4c2f-ab59-06d7cb7052bb None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:22.189659 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d73ff-1e0b-4c2f-ab59-06d7cb7052bb None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:22.190162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d73ff-1e0b-4c2f-ab59-06d7cb7052bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:22.216873 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-ec6d73ff-1e0b-4c2f-ab59-06d7cb7052bb None None] MFA Rules not processed for user `c0e57ea982d349c1a86b544e9a6e7758`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:22.218607 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-ec6d73ff-1e0b-4c2f-ab59-06d7cb7052bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:22.317287 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1266/2579] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 28 12:20:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:22.324312 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4ddad-c03d-41fb-9404-d7226f00533a service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:22.332486 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d73ff-1e0b-4c2f-ab59-06d7cb7052bb None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:22.334607 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4ddad-c03d-41fb-9404-d7226f00533a service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:22.336169 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-ec6d73ff-1e0b-4c2f-ab59-06d7cb7052bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:22.343877 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca446da-3193-4592-a8bc-65bee7f480e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:22.344487 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca446da-3193-4592-a8bc-65bee7f480e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:22.344765 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca446da-3193-4592-a8bc-65bee7f480e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:22.345032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca446da-3193-4592-a8bc-65bee7f480e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:22.346825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0ca446da-3193-4592-a8bc-65bee7f480e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:22.429557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca446da-3193-4592-a8bc-65bee7f480e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:22.431098 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca446da-3193-4592-a8bc-65bee7f480e8 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:22.442131 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1314/2580] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:20:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:20:22.446856 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d73ff-1e0b-4c2f-ab59-06d7cb7052bb None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:22.453894 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e73ed-4c43-4199-81b5-462dc1f3c582 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '822e394e80fd41adb54d330adaf65a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:22.454702 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e73ed-4c43-4199-81b5-462dc1f3c582 service swift] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:22.455232 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e73ed-4c43-4199-81b5-462dc1f3c582 service swift] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:22.455603 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e73ed-4c43-4199-81b5-462dc1f3c582 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:22.465978 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e73ed-4c43-4199-81b5-462dc1f3c582 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:22.467636 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e73ed-4c43-4199-81b5-462dc1f3c582 service swift] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:22.476641 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1267/2581] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 28 12:20:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 12:20:26.704409 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca446da-3193-4592-a8bc-65bee7f480e8 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:26.706463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0ca446da-3193-4592-a8bc-65bee7f480e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:26.733817 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca446da-3193-4592-a8bc-65bee7f480e8 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:26.739363 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510f4a7-1c71-4b7e-a2c3-4f707dc16521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:26.740208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510f4a7-1c71-4b7e-a2c3-4f707dc16521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:26.740642 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510f4a7-1c71-4b7e-a2c3-4f707dc16521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:26.741092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510f4a7-1c71-4b7e-a2c3-4f707dc16521 admin admin] PATH_INFO: `/v3/users/d533e3caa6ec4c7c9343a8cefd3af8d4` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:26.742482 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510f4a7-1c71-4b7e-a2c3-4f707dc16521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d533e3caa6ec4c7c9343a8cefd3af8d4)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:26.746148 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510f4a7-1c71-4b7e-a2c3-4f707dc16521 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:26.798032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0510f4a7-1c71-4b7e-a2c3-4f707dc16521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd533e3caa6ec4c7c9343a8cefd3af8d4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:26.798699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0510f4a7-1c71-4b7e-a2c3-4f707dc16521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd533e3caa6ec4c7c9343a8cefd3af8d4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:26.805935 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0510f4a7-1c71-4b7e-a2c3-4f707dc16521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd533e3caa6ec4c7c9343a8cefd3af8d4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:26.814588 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0510f4a7-1c71-4b7e-a2c3-4f707dc16521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd533e3caa6ec4c7c9343a8cefd3af8d4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:26.815592 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0510f4a7-1c71-4b7e-a2c3-4f707dc16521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd533e3caa6ec4c7c9343a8cefd3af8d4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:26.850868 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1315/2582] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:20:26 2022] DELETE /identity/v3/users/d533e3caa6ec4c7c9343a8cefd3af8d4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:20:27.019225 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e73ed-4c43-4199-81b5-462dc1f3c582 service swift] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:27.030628 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e73ed-4c43-4199-81b5-462dc1f3c582 service swift] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:27.052631 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:27.101811 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba9604-bf5b-486f-89a0-cc7b57113331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:27.102767 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba9604-bf5b-486f-89a0-cc7b57113331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:27.102993 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba9604-bf5b-486f-89a0-cc7b57113331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:27.103374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba9604-bf5b-486f-89a0-cc7b57113331 admin admin] PATH_INFO: `/v3/projects/20856e65882a41848e6be9b95074361b` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:27.104836 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba9604-bf5b-486f-89a0-cc7b57113331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20856e65882a41848e6be9b95074361b)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:27.107081 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba9604-bf5b-486f-89a0-cc7b57113331 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:27.179903 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-22ba9604-bf5b-486f-89a0-cc7b57113331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20856e65882a41848e6be9b95074361b', 'request_id': 'req-22ba9604-bf5b-486f-89a0-cc7b57113331'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:27.187041 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-22ba9604-bf5b-486f-89a0-cc7b57113331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20856e65882a41848e6be9b95074361b', 'request_id': 'req-22ba9604-bf5b-486f-89a0-cc7b57113331'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:27.195849 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-22ba9604-bf5b-486f-89a0-cc7b57113331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20856e65882a41848e6be9b95074361b', 'request_id': 'req-22ba9604-bf5b-486f-89a0-cc7b57113331'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:27.208158 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-22ba9604-bf5b-486f-89a0-cc7b57113331 admin admin] The token cache is being invalidate because project 20856e65882a41848e6be9b95074361b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:20:27.208453 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-22ba9604-bf5b-486f-89a0-cc7b57113331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:27.209086 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-22ba9604-bf5b-486f-89a0-cc7b57113331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:27.210623 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1268/2583] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:20:27 2022] DELETE /identity/v3/projects/20856e65882a41848e6be9b95074361b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:20:27.215653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aab410-9c65-4d7a-8c64-44934914aaf6 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:27.215941 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aab410-9c65-4d7a-8c64-44934914aaf6 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:27.216218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aab410-9c65-4d7a-8c64-44934914aaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:27.242968 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-d7aab410-9c65-4d7a-8c64-44934914aaf6 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:27.244320 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d7aab410-9c65-4d7a-8c64-44934914aaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:27.250550 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:27.336593 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1316/2584] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:27.344869 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b729ee-dfc1-448f-bb97-04acc130bdf1 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:27.345232 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b729ee-dfc1-448f-bb97-04acc130bdf1 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:27.345917 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b729ee-dfc1-448f-bb97-04acc130bdf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:27.378404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-b1b729ee-dfc1-448f-bb97-04acc130bdf1 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:27.379975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b1b729ee-dfc1-448f-bb97-04acc130bdf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:27.394910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1269/2585] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:27.396003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aab410-9c65-4d7a-8c64-44934914aaf6 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:27.410355 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aab410-9c65-4d7a-8c64-44934914aaf6 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:27.429077 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03d61d-dd3f-49c1-92e2-5e9c0886001a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:27.429710 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03d61d-dd3f-49c1-92e2-5e9c0886001a admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:27.429993 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03d61d-dd3f-49c1-92e2-5e9c0886001a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:27.430269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03d61d-dd3f-49c1-92e2-5e9c0886001a admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:27.430939 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03d61d-dd3f-49c1-92e2-5e9c0886001a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:20:27.431248 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03d61d-dd3f-49c1-92e2-5e9c0886001a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:27.434142 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03d61d-dd3f-49c1-92e2-5e9c0886001a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:27.446675 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1317/2586] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:20:27.453316 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b729ee-dfc1-448f-bb97-04acc130bdf1 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:27.475756 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b729ee-dfc1-448f-bb97-04acc130bdf1 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:27.488385 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763e6d1-fddc-414d-b5fe-c7f15dcac5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:27.490375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763e6d1-fddc-414d-b5fe-c7f15dcac5b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:27.490917 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763e6d1-fddc-414d-b5fe-c7f15dcac5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:27.491192 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763e6d1-fddc-414d-b5fe-c7f15dcac5b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:27.491976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9763e6d1-fddc-414d-b5fe-c7f15dcac5b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:27.495534 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9763e6d1-fddc-414d-b5fe-c7f15dcac5b4 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:27.631420 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1270/2587] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:20:27 2022] POST /identity/v3/projects => generated 405 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:20:27.633399 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03d61d-dd3f-49c1-92e2-5e9c0886001a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:27.655324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03d61d-dd3f-49c1-92e2-5e9c0886001a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:27.770510 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd9b4d-b9cb-4401-9d9c-53dbe85f2df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:27.771428 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd9b4d-b9cb-4401-9d9c-53dbe85f2df9 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:27.771428 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd9b4d-b9cb-4401-9d9c-53dbe85f2df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:27.771428 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd9b4d-b9cb-4401-9d9c-53dbe85f2df9 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:27.772425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd9b4d-b9cb-4401-9d9c-53dbe85f2df9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:27.774621 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd9b4d-b9cb-4401-9d9c-53dbe85f2df9 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:27.804547 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1318/2588] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:20:27 2022] POST /identity/v3/users => generated 303 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:20:27.806575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763e6d1-fddc-414d-b5fe-c7f15dcac5b4 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:27.829984 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763e6d1-fddc-414d-b5fe-c7f15dcac5b4 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:27.839031 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a50870-9824-46d3-85b7-36819a605eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:27.839686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a50870-9824-46d3-85b7-36819a605eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:27.839965 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a50870-9824-46d3-85b7-36819a605eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:27.840231 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a50870-9824-46d3-85b7-36819a605eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:27.840877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a50870-9824-46d3-85b7-36819a605eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:27.842474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a50870-9824-46d3-85b7-36819a605eb6 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:27.886809 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1271/2589] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:20:27.900013 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd9b4d-b9cb-4401-9d9c-53dbe85f2df9 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:27.917310 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd9b4d-b9cb-4401-9d9c-53dbe85f2df9 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:27.922556 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09544367-eae5-442c-83fd-362889c881b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:27.923537 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09544367-eae5-442c-83fd-362889c881b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:27.924051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09544367-eae5-442c-83fd-362889c881b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:27.924551 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09544367-eae5-442c-83fd-362889c881b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:27.925411 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09544367-eae5-442c-83fd-362889c881b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:27.927268 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09544367-eae5-442c-83fd-362889c881b2 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:27.943645 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1319/2590] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:20:27.953257 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a50870-9824-46d3-85b7-36819a605eb6 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:27.981293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a50870-9824-46d3-85b7-36819a605eb6 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:27.986786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9754b-1867-45cf-a0ef-991de67f2adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:27.987495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9754b-1867-45cf-a0ef-991de67f2adc admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:27.987786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9754b-1867-45cf-a0ef-991de67f2adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:27.988230 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9754b-1867-45cf-a0ef-991de67f2adc admin admin] PATH_INFO: `/v3/projects/ad454cef678142ef8db3380cded913c8/users/4cafabfbf1864885b0f8c3f2407dbc72/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:28.006192 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9754b-1867-45cf-a0ef-991de67f2adc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad454cef678142ef8db3380cded913c8, user_id=4cafabfbf1864885b0f8c3f2407dbc72, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:28.009258 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9754b-1867-45cf-a0ef-991de67f2adc admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:28.025142 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1272/2591] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:20:27 2022] PUT /identity/v3/projects/ad454cef678142ef8db3380cded913c8/users/4cafabfbf1864885b0f8c3f2407dbc72/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:20:28.030343 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8d6f0-67e1-4cfc-af45-38cd9d240e9a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:28.030636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8d6f0-67e1-4cfc-af45-38cd9d240e9a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:28.030976 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8d6f0-67e1-4cfc-af45-38cd9d240e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:28.052800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-fec8d6f0-67e1-4cfc-af45-38cd9d240e9a None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:28.054026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-fec8d6f0-67e1-4cfc-af45-38cd9d240e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:28.114698 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1320/2592] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:28.124962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9754b-1867-45cf-a0ef-991de67f2adc admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:28.126665 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-f5f9754b-1867-45cf-a0ef-991de67f2adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:28.183338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9754b-1867-45cf-a0ef-991de67f2adc admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:28.186902 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec072b3-23fa-47e0-b1c6-2d545981f8f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:28.187525 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec072b3-23fa-47e0-b1c6-2d545981f8f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:28.187804 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec072b3-23fa-47e0-b1c6-2d545981f8f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:28.188069 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec072b3-23fa-47e0-b1c6-2d545981f8f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:28.193846 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:28.198882 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec072b3-23fa-47e0-b1c6-2d545981f8f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:28.200459 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec072b3-23fa-47e0-b1c6-2d545981f8f5 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:28.211205 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1273/2593] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:20:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:20:29.356799 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af894b1-2db4-4d73-a48d-a0ecf3a21c89 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:29.357321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af894b1-2db4-4d73-a48d-a0ecf3a21c89 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:29.357321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af894b1-2db4-4d73-a48d-a0ecf3a21c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:29.359873 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec072b3-23fa-47e0-b1c6-2d545981f8f5 service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:29.362764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-cec072b3-23fa-47e0-b1c6-2d545981f8f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:29.390751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec072b3-23fa-47e0-b1c6-2d545981f8f5 service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:29.396554 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6ed92-f16c-43d1-a0eb-7c2193c2f865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:29.397190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6ed92-f16c-43d1-a0eb-7c2193c2f865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:29.397472 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6ed92-f16c-43d1-a0eb-7c2193c2f865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:29.397747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6ed92-f16c-43d1-a0eb-7c2193c2f865 admin admin] PATH_INFO: `/v3/users/64ceca6763bd404a817a618201b692fb` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:29.399084 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6ed92-f16c-43d1-a0eb-7c2193c2f865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64ceca6763bd404a817a618201b692fb)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:29.401087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6ed92-f16c-43d1-a0eb-7c2193c2f865 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:29.403294 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-3af894b1-2db4-4d73-a48d-a0ecf3a21c89 None None] MFA Rules not processed for user `4cafabfbf1864885b0f8c3f2407dbc72`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:29.404630 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3af894b1-2db4-4d73-a48d-a0ecf3a21c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:29.409517 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:29.457467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-a8d6ed92-f16c-43d1-a0eb-7c2193c2f865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64ceca6763bd404a817a618201b692fb'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:29.480659 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-a8d6ed92-f16c-43d1-a0eb-7c2193c2f865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64ceca6763bd404a817a618201b692fb'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:29.482532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-a8d6ed92-f16c-43d1-a0eb-7c2193c2f865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64ceca6763bd404a817a618201b692fb'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:29.496421 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-a8d6ed92-f16c-43d1-a0eb-7c2193c2f865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64ceca6763bd404a817a618201b692fb'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:29.512087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-a8d6ed92-f16c-43d1-a0eb-7c2193c2f865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64ceca6763bd404a817a618201b692fb'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:29.524463 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1274/2594] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:20:29 2022] DELETE /identity/v3/users/64ceca6763bd404a817a618201b692fb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:20:29.534273 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1321/2595] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:29 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:29.540617 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6ed92-f16c-43d1-a0eb-7c2193c2f865 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:29.544928 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-a8d6ed92-f16c-43d1-a0eb-7c2193c2f865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:29.660075 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6ed92-f16c-43d1-a0eb-7c2193c2f865 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:29.667016 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f89974-aef6-4348-b42f-e4720f716584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:29.667757 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f89974-aef6-4348-b42f-e4720f716584 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:29.668120 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f89974-aef6-4348-b42f-e4720f716584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:29.668482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f89974-aef6-4348-b42f-e4720f716584 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:29.669558 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f89974-aef6-4348-b42f-e4720f716584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:29.671842 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f89974-aef6-4348-b42f-e4720f716584 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:29.726085 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1275/2596] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:20:29 2022] POST /identity/v3/projects => generated 405 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:20:29.730705 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af894b1-2db4-4d73-a48d-a0ecf3a21c89 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:29.751081 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af894b1-2db4-4d73-a48d-a0ecf3a21c89 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:29.805346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f89974-aef6-4348-b42f-e4720f716584 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:29.808450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-81f89974-aef6-4348-b42f-e4720f716584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:29.867162 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0f370-9267-45a6-b11c-8f8ba794670b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:29.868100 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0f370-9267-45a6-b11c-8f8ba794670b admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:29.868379 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0f370-9267-45a6-b11c-8f8ba794670b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:29.868648 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0f370-9267-45a6-b11c-8f8ba794670b admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:29.869277 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0f370-9267-45a6-b11c-8f8ba794670b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:29.871811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0f370-9267-45a6-b11c-8f8ba794670b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:29.896384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1322/2597] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:20:29 2022] POST /identity/v3/users => generated 309 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:20:29.899766 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:29.900148 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0f370-9267-45a6-b11c-8f8ba794670b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:29.911383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0f370-9267-45a6-b11c-8f8ba794670b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:29.915089 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f89974-aef6-4348-b42f-e4720f716584 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:29.917290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9e422-daee-473f-8754-d107ad2643fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:29.918010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9e422-daee-473f-8754-d107ad2643fc admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:29.918297 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9e422-daee-473f-8754-d107ad2643fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:29.918570 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9e422-daee-473f-8754-d107ad2643fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:29.919210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9e422-daee-473f-8754-d107ad2643fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:29.920594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb795f84-9ac0-4728-b4d6-f2dce840af69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:29.920834 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9e422-daee-473f-8754-d107ad2643fc admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:29.921224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb795f84-9ac0-4728-b4d6-f2dce840af69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:29.921505 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb795f84-9ac0-4728-b4d6-f2dce840af69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:29.921806 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb795f84-9ac0-4728-b4d6-f2dce840af69 admin admin] PATH_INFO: `/v3/projects/c3b0138849914c3fabf839486742de26` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:29.922932 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb795f84-9ac0-4728-b4d6-f2dce840af69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3b0138849914c3fabf839486742de26)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:29.925151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb795f84-9ac0-4728-b4d6-f2dce840af69 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:29.931529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1323/2598] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:20:29.935546 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9e422-daee-473f-8754-d107ad2643fc admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:29.945097 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9e422-daee-473f-8754-d107ad2643fc admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:29.952365 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec8242-c4b9-4d79-9bee-184771274abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:29.953810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec8242-c4b9-4d79-9bee-184771274abb admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:29.954429 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec8242-c4b9-4d79-9bee-184771274abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:29.954898 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec8242-c4b9-4d79-9bee-184771274abb admin admin] PATH_INFO: `/v3/projects/1bcc2620991b470085ff49bc2af3b369/users/2c3ade39c1ab4a8d9ba150e2e7e93890/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:29.971639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec8242-c4b9-4d79-9bee-184771274abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bcc2620991b470085ff49bc2af3b369, user_id=2c3ade39c1ab4a8d9ba150e2e7e93890, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:29.974050 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-cb795f84-9ac0-4728-b4d6-f2dce840af69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3b0138849914c3fabf839486742de26', 'request_id': 'req-cb795f84-9ac0-4728-b4d6-f2dce840af69'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:29.974261 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec8242-c4b9-4d79-9bee-184771274abb admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:29.980860 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-cb795f84-9ac0-4728-b4d6-f2dce840af69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3b0138849914c3fabf839486742de26', 'request_id': 'req-cb795f84-9ac0-4728-b4d6-f2dce840af69'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:29.988056 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-cb795f84-9ac0-4728-b4d6-f2dce840af69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3b0138849914c3fabf839486742de26', 'request_id': 'req-cb795f84-9ac0-4728-b4d6-f2dce840af69'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:29.990665 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1324/2599] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:20:29 2022] PUT /identity/v3/projects/1bcc2620991b470085ff49bc2af3b369/users/2c3ade39c1ab4a8d9ba150e2e7e93890/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:20:29.994418 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec8242-c4b9-4d79-9bee-184771274abb admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:30.001016 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-cb795f84-9ac0-4728-b4d6-f2dce840af69 admin admin] The token cache is being invalidate because project c3b0138849914c3fabf839486742de26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:20:30.001304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-cb795f84-9ac0-4728-b4d6-f2dce840af69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:30.001947 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-cb795f84-9ac0-4728-b4d6-f2dce840af69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:30.003745 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1276/2600] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:20:29 2022] DELETE /identity/v3/projects/c3b0138849914c3fabf839486742de26 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:20:30.079304 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec8242-c4b9-4d79-9bee-184771274abb admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:30.085530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72246b6d-89eb-402b-90aa-c7128f1e7087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:30.086249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72246b6d-89eb-402b-90aa-c7128f1e7087 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:30.086622 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72246b6d-89eb-402b-90aa-c7128f1e7087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:30.086957 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72246b6d-89eb-402b-90aa-c7128f1e7087 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:30.087865 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72246b6d-89eb-402b-90aa-c7128f1e7087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:30.090329 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72246b6d-89eb-402b-90aa-c7128f1e7087 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:30.092328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:30.128035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1325/2601] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:20:30.132300 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb795f84-9ac0-4728-b4d6-f2dce840af69 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:30.138589 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-cb795f84-9ac0-4728-b4d6-f2dce840af69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:30.257744 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb795f84-9ac0-4728-b4d6-f2dce840af69 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:30.263220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa3f46-86d9-4656-9ea1-03dd6942adf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:30.264036 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa3f46-86d9-4656-9ea1-03dd6942adf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:30.264419 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa3f46-86d9-4656-9ea1-03dd6942adf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:30.264798 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa3f46-86d9-4656-9ea1-03dd6942adf4 admin admin] PATH_INFO: `/v3/projects/1bcc2620991b470085ff49bc2af3b369/users/2c3ade39c1ab4a8d9ba150e2e7e93890/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:30.267015 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa3f46-86d9-4656-9ea1-03dd6942adf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bcc2620991b470085ff49bc2af3b369, user_id=2c3ade39c1ab4a8d9ba150e2e7e93890, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:30.270091 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa3f46-86d9-4656-9ea1-03dd6942adf4 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:30.300995 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1277/2602] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:20:30 2022] PUT /identity/v3/projects/1bcc2620991b470085ff49bc2af3b369/users/2c3ade39c1ab4a8d9ba150e2e7e93890/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:20:31.025363 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebcfe0-48ec-42c0-8412-fd46fad3f948 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:31.025971 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebcfe0-48ec-42c0-8412-fd46fad3f948 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:31.026504 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebcfe0-48ec-42c0-8412-fd46fad3f948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:31.058133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-a0ebcfe0-48ec-42c0-8412-fd46fad3f948 None None] MFA Rules not processed for user `2c3ade39c1ab4a8d9ba150e2e7e93890`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:31.059345 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a0ebcfe0-48ec-42c0-8412-fd46fad3f948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:31.134556 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1326/2603] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:31 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:32.486590 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa3f46-86d9-4656-9ea1-03dd6942adf4 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:32.553957 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa3f46-86d9-4656-9ea1-03dd6942adf4 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:32.559453 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afcbad-d0b6-4031-b603-532ceffa7558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:32.560098 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afcbad-d0b6-4031-b603-532ceffa7558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:32.560388 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afcbad-d0b6-4031-b603-532ceffa7558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:32.560655 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afcbad-d0b6-4031-b603-532ceffa7558 admin admin] PATH_INFO: `/v3/users/4cafabfbf1864885b0f8c3f2407dbc72` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:32.561780 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afcbad-d0b6-4031-b603-532ceffa7558 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cafabfbf1864885b0f8c3f2407dbc72)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:32.563713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afcbad-d0b6-4031-b603-532ceffa7558 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:32.579328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:32.611045 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c2afcbad-d0b6-4031-b603-532ceffa7558 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cafabfbf1864885b0f8c3f2407dbc72'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:32.623751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c2afcbad-d0b6-4031-b603-532ceffa7558 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cafabfbf1864885b0f8c3f2407dbc72'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:32.624448 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c2afcbad-d0b6-4031-b603-532ceffa7558 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cafabfbf1864885b0f8c3f2407dbc72'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:32.632872 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c2afcbad-d0b6-4031-b603-532ceffa7558 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cafabfbf1864885b0f8c3f2407dbc72'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:32.641274 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-c2afcbad-d0b6-4031-b603-532ceffa7558 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cafabfbf1864885b0f8c3f2407dbc72'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:32.649330 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1278/2604] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:20:32 2022] DELETE /identity/v3/users/4cafabfbf1864885b0f8c3f2407dbc72 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:20:32.863205 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebcfe0-48ec-42c0-8412-fd46fad3f948 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:32.874578 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebcfe0-48ec-42c0-8412-fd46fad3f948 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:32.931982 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14d595-6fd1-4e26-98c1-5aa2bc19a381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:32.932600 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14d595-6fd1-4e26-98c1-5aa2bc19a381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:32.932879 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14d595-6fd1-4e26-98c1-5aa2bc19a381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:32.933151 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14d595-6fd1-4e26-98c1-5aa2bc19a381 admin admin] PATH_INFO: `/v3/projects/ad454cef678142ef8db3380cded913c8` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:32.934264 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14d595-6fd1-4e26-98c1-5aa2bc19a381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad454cef678142ef8db3380cded913c8)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:32.936245 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14d595-6fd1-4e26-98c1-5aa2bc19a381 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:32.981545 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ce14d595-6fd1-4e26-98c1-5aa2bc19a381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad454cef678142ef8db3380cded913c8', 'request_id': 'req-ce14d595-6fd1-4e26-98c1-5aa2bc19a381'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:32.987067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ce14d595-6fd1-4e26-98c1-5aa2bc19a381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad454cef678142ef8db3380cded913c8', 'request_id': 'req-ce14d595-6fd1-4e26-98c1-5aa2bc19a381'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:32.993148 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ce14d595-6fd1-4e26-98c1-5aa2bc19a381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad454cef678142ef8db3380cded913c8', 'request_id': 'req-ce14d595-6fd1-4e26-98c1-5aa2bc19a381'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:33.005403 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ce14d595-6fd1-4e26-98c1-5aa2bc19a381 admin admin] The token cache is being invalidate because project ad454cef678142ef8db3380cded913c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:20:33.005687 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ce14d595-6fd1-4e26-98c1-5aa2bc19a381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:33.006305 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ce14d595-6fd1-4e26-98c1-5aa2bc19a381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:33.007847 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1327/2605] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:20:32 2022] DELETE /identity/v3/projects/ad454cef678142ef8db3380cded913c8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:20:33.011856 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afcbad-d0b6-4031-b603-532ceffa7558 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:33.013345 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-c2afcbad-d0b6-4031-b603-532ceffa7558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:33.026480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afcbad-d0b6-4031-b603-532ceffa7558 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:33.086098 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5bc95-7cd0-4196-9086-355f4039f80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:33.086861 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5bc95-7cd0-4196-9086-355f4039f80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:33.087162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5bc95-7cd0-4196-9086-355f4039f80e admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:33.087467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5bc95-7cd0-4196-9086-355f4039f80e admin admin] PATH_INFO: `/v3/users/2c3ade39c1ab4a8d9ba150e2e7e93890` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:33.088710 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5bc95-7cd0-4196-9086-355f4039f80e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c3ade39c1ab4a8d9ba150e2e7e93890)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:33.091279 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5bc95-7cd0-4196-9086-355f4039f80e admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:33.143775 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-46a5bc95-7cd0-4196-9086-355f4039f80e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c3ade39c1ab4a8d9ba150e2e7e93890'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:33.156667 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-46a5bc95-7cd0-4196-9086-355f4039f80e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c3ade39c1ab4a8d9ba150e2e7e93890'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:33.157614 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-46a5bc95-7cd0-4196-9086-355f4039f80e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c3ade39c1ab4a8d9ba150e2e7e93890'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:33.165861 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-46a5bc95-7cd0-4196-9086-355f4039f80e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c3ade39c1ab4a8d9ba150e2e7e93890'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:33.173736 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-46a5bc95-7cd0-4196-9086-355f4039f80e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c3ade39c1ab4a8d9ba150e2e7e93890'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:33.179596 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1279/2606] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:20:33 2022] DELETE /identity/v3/users/2c3ade39c1ab4a8d9ba150e2e7e93890 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:20:33.363784 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14d595-6fd1-4e26-98c1-5aa2bc19a381 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:33.365442 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ce14d595-6fd1-4e26-98c1-5aa2bc19a381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:33.382667 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14d595-6fd1-4e26-98c1-5aa2bc19a381 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:33.392479 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:33.446884 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b292e-fdab-4be6-a593-52890419fe97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:33.447543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b292e-fdab-4be6-a593-52890419fe97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:33.447842 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b292e-fdab-4be6-a593-52890419fe97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:33.448136 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b292e-fdab-4be6-a593-52890419fe97 admin admin] PATH_INFO: `/v3/projects/1bcc2620991b470085ff49bc2af3b369` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:33.449953 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b292e-fdab-4be6-a593-52890419fe97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bcc2620991b470085ff49bc2af3b369)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:33.452080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b292e-fdab-4be6-a593-52890419fe97 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:33.503005 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-625b292e-fdab-4be6-a593-52890419fe97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bcc2620991b470085ff49bc2af3b369', 'request_id': 'req-625b292e-fdab-4be6-a593-52890419fe97'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:33.508542 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-625b292e-fdab-4be6-a593-52890419fe97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bcc2620991b470085ff49bc2af3b369', 'request_id': 'req-625b292e-fdab-4be6-a593-52890419fe97'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:33.515213 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-625b292e-fdab-4be6-a593-52890419fe97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bcc2620991b470085ff49bc2af3b369', 'request_id': 'req-625b292e-fdab-4be6-a593-52890419fe97'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:33.526685 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-625b292e-fdab-4be6-a593-52890419fe97 admin admin] The token cache is being invalidate because project 1bcc2620991b470085ff49bc2af3b369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:20:33.526972 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-625b292e-fdab-4be6-a593-52890419fe97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:33.528236 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-625b292e-fdab-4be6-a593-52890419fe97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:33.529790 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1328/2607] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:20:33 2022] DELETE /identity/v3/projects/1bcc2620991b470085ff49bc2af3b369 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:20:33.534593 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35740ee1-1b5f-42da-9887-63ff530f96e8 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:33.535084 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35740ee1-1b5f-42da-9887-63ff530f96e8 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:33.535202 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35740ee1-1b5f-42da-9887-63ff530f96e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:33.554180 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-35740ee1-1b5f-42da-9887-63ff530f96e8 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:33.555366 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-35740ee1-1b5f-42da-9887-63ff530f96e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:33.563806 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:33.617184 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1280/2608] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:33.625570 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e692b-8fa6-4730-a3d8-55df711e3f54 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:33.625855 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e692b-8fa6-4730-a3d8-55df711e3f54 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:33.626129 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e692b-8fa6-4730-a3d8-55df711e3f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:33.647016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-068e692b-8fa6-4730-a3d8-55df711e3f54 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:33.648253 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-068e692b-8fa6-4730-a3d8-55df711e3f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:33.656573 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1329/2609] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:33.660887 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35740ee1-1b5f-42da-9887-63ff530f96e8 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:33.673425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35740ee1-1b5f-42da-9887-63ff530f96e8 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:33.678106 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a22be-85d0-4e0d-a7fb-d5660b5a5761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:33.678710 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a22be-85d0-4e0d-a7fb-d5660b5a5761 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:33.678987 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a22be-85d0-4e0d-a7fb-d5660b5a5761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:33.679258 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a22be-85d0-4e0d-a7fb-d5660b5a5761 admin admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:33.679940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a22be-85d0-4e0d-a7fb-d5660b5a5761 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:20:33.680246 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a22be-85d0-4e0d-a7fb-d5660b5a5761 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:33.681852 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a22be-85d0-4e0d-a7fb-d5660b5a5761 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:33.694316 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1281/2610] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:20:33.698974 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e692b-8fa6-4730-a3d8-55df711e3f54 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:33.711847 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e692b-8fa6-4730-a3d8-55df711e3f54 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:33.716880 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6c3fd-9c24-4cdd-be11-c4ea8e7a219a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:33.717489 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6c3fd-9c24-4cdd-be11-c4ea8e7a219a admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:33.717769 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6c3fd-9c24-4cdd-be11-c4ea8e7a219a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:33.718041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6c3fd-9c24-4cdd-be11-c4ea8e7a219a admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:33.718671 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6c3fd-9c24-4cdd-be11-c4ea8e7a219a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:33.720590 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6c3fd-9c24-4cdd-be11-c4ea8e7a219a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:33.752067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1330/2611] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:20:33 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:20:33.754110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a22be-85d0-4e0d-a7fb-d5660b5a5761 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:33.765098 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a22be-85d0-4e0d-a7fb-d5660b5a5761 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:33.822046 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a48e06-04bf-413c-b8b0-04380525ed17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:33.822649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a48e06-04bf-413c-b8b0-04380525ed17 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:33.822966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a48e06-04bf-413c-b8b0-04380525ed17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:33.823200 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a48e06-04bf-413c-b8b0-04380525ed17 admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:33.823962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a48e06-04bf-413c-b8b0-04380525ed17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:33.826574 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a48e06-04bf-413c-b8b0-04380525ed17 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:33.849484 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1282/2612] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:20:33 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:20:33.853532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6c3fd-9c24-4cdd-be11-c4ea8e7a219a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:33.863826 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6c3fd-9c24-4cdd-be11-c4ea8e7a219a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:33.868909 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f589cd-8aa2-4587-b147-d86bd463b6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:33.869445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f589cd-8aa2-4587-b147-d86bd463b6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:33.869728 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f589cd-8aa2-4587-b147-d86bd463b6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:33.870371 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f589cd-8aa2-4587-b147-d86bd463b6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:33.871612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f589cd-8aa2-4587-b147-d86bd463b6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:33.873208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f589cd-8aa2-4587-b147-d86bd463b6a3 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:33.883306 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1331/2613] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:20:33.887949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a48e06-04bf-413c-b8b0-04380525ed17 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:33.898489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a48e06-04bf-413c-b8b0-04380525ed17 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:33.903310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdd868-3e42-4852-b652-7736cfe02757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:33.903947 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdd868-3e42-4852-b652-7736cfe02757 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:33.904226 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdd868-3e42-4852-b652-7736cfe02757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:33.904492 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdd868-3e42-4852-b652-7736cfe02757 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:33.905127 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdd868-3e42-4852-b652-7736cfe02757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:33.906700 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdd868-3e42-4852-b652-7736cfe02757 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:33.917854 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1283/2614] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:20:33.922515 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f589cd-8aa2-4587-b147-d86bd463b6a3 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:33.932916 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f589cd-8aa2-4587-b147-d86bd463b6a3 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:33.937978 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df75eca-efe4-4fc7-971f-41ca69269049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:33.938621 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df75eca-efe4-4fc7-971f-41ca69269049 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:33.938899 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df75eca-efe4-4fc7-971f-41ca69269049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:33.939196 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df75eca-efe4-4fc7-971f-41ca69269049 admin admin] PATH_INFO: `/v3/projects/0d5f107754af43f5834c040226409dd1/users/0e16a2c426f949419f3de3255abb339b/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:33.954152 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df75eca-efe4-4fc7-971f-41ca69269049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d5f107754af43f5834c040226409dd1, user_id=0e16a2c426f949419f3de3255abb339b, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:33.957111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df75eca-efe4-4fc7-971f-41ca69269049 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:33.970064 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1332/2615] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:20:33 2022] PUT /identity/v3/projects/0d5f107754af43f5834c040226409dd1/users/0e16a2c426f949419f3de3255abb339b/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:20:33.981771 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286fa3c-bc19-41ba-925e-7666f4eaa7ff None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:33.982068 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286fa3c-bc19-41ba-925e-7666f4eaa7ff None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:33.982341 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286fa3c-bc19-41ba-925e-7666f4eaa7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:34.010761 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-c286fa3c-bc19-41ba-925e-7666f4eaa7ff None None] MFA Rules not processed for user `0e16a2c426f949419f3de3255abb339b`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:34.012006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-c286fa3c-bc19-41ba-925e-7666f4eaa7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:34.078074 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1284/2616] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:34.082726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df75eca-efe4-4fc7-971f-41ca69269049 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:34.124485 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:34.147515 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df75eca-efe4-4fc7-971f-41ca69269049 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:34.153335 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ca0df-d26a-4690-86cf-3200bede0733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:34.153335 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ca0df-d26a-4690-86cf-3200bede0733 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:34.153335 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ca0df-d26a-4690-86cf-3200bede0733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:34.153335 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ca0df-d26a-4690-86cf-3200bede0733 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:34.153880 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ca0df-d26a-4690-86cf-3200bede0733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:34.155802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ca0df-d26a-4690-86cf-3200bede0733 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:34.181979 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1333/2617] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:20:34 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:20:34.186142 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286fa3c-bc19-41ba-925e-7666f4eaa7ff None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:34.196796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286fa3c-bc19-41ba-925e-7666f4eaa7ff None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:34.201970 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:34.254159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3facc-c709-43cb-a4dc-871483714a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:34.254807 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3facc-c709-43cb-a4dc-871483714a5a admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:34.255089 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3facc-c709-43cb-a4dc-871483714a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:34.255359 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3facc-c709-43cb-a4dc-871483714a5a admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:34.256020 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3facc-c709-43cb-a4dc-871483714a5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:34.257935 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3facc-c709-43cb-a4dc-871483714a5a admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:34.279219 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1285/2618] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:20:34 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:20:34.283246 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ca0df-d26a-4690-86cf-3200bede0733 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:34.293439 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ca0df-d26a-4690-86cf-3200bede0733 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:34.298445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fff39-f136-4c24-84c3-a6a4ce83c7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:34.299042 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fff39-f136-4c24-84c3-a6a4ce83c7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:34.299319 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fff39-f136-4c24-84c3-a6a4ce83c7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:34.299622 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fff39-f136-4c24-84c3-a6a4ce83c7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:34.300314 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fff39-f136-4c24-84c3-a6a4ce83c7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:34.301946 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fff39-f136-4c24-84c3-a6a4ce83c7b9 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:34.312561 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1334/2619] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:20:34.316559 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3facc-c709-43cb-a4dc-871483714a5a admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:34.327078 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3facc-c709-43cb-a4dc-871483714a5a admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:34.331863 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e35af5-de5b-4bab-bffc-88e9ed7dfba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:34.332581 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e35af5-de5b-4bab-bffc-88e9ed7dfba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:34.332778 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e35af5-de5b-4bab-bffc-88e9ed7dfba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:34.333050 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e35af5-de5b-4bab-bffc-88e9ed7dfba8 admin admin] PATH_INFO: `/v3/projects/9c4f6c4cac1846a0979e785f45b5bebf/users/1ccf7ddd060e4b6e8213ed251432eba4/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:34.352202 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e35af5-de5b-4bab-bffc-88e9ed7dfba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4f6c4cac1846a0979e785f45b5bebf, user_id=1ccf7ddd060e4b6e8213ed251432eba4, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:34.354881 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e35af5-de5b-4bab-bffc-88e9ed7dfba8 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:34.368457 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1286/2620] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:20:34 2022] PUT /identity/v3/projects/9c4f6c4cac1846a0979e785f45b5bebf/users/1ccf7ddd060e4b6e8213ed251432eba4/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:20:34.373147 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fff39-f136-4c24-84c3-a6a4ce83c7b9 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:34.383936 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fff39-f136-4c24-84c3-a6a4ce83c7b9 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:34.446059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ddde7-6b67-40c8-aa96-3398d605151f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:34.446754 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ddde7-6b67-40c8-aa96-3398d605151f admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:34.447035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ddde7-6b67-40c8-aa96-3398d605151f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:34.447414 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ddde7-6b67-40c8-aa96-3398d605151f admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:34.448138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ddde7-6b67-40c8-aa96-3398d605151f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:34.450385 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ddde7-6b67-40c8-aa96-3398d605151f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:34.461184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1335/2621] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:20:34.466326 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e35af5-de5b-4bab-bffc-88e9ed7dfba8 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:34.476656 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e35af5-de5b-4bab-bffc-88e9ed7dfba8 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:34.481462 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c033660-05d6-416a-be66-808eb422a21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:34.482114 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c033660-05d6-416a-be66-808eb422a21a admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:34.482397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c033660-05d6-416a-be66-808eb422a21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:34.482674 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c033660-05d6-416a-be66-808eb422a21a admin admin] PATH_INFO: `/v3/projects/9c4f6c4cac1846a0979e785f45b5bebf/users/1ccf7ddd060e4b6e8213ed251432eba4/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:34.484623 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c033660-05d6-416a-be66-808eb422a21a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4f6c4cac1846a0979e785f45b5bebf, user_id=1ccf7ddd060e4b6e8213ed251432eba4, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:34.487257 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c033660-05d6-416a-be66-808eb422a21a admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:34.498648 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1287/2622] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:20:34 2022] PUT /identity/v3/projects/9c4f6c4cac1846a0979e785f45b5bebf/users/1ccf7ddd060e4b6e8213ed251432eba4/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:20:34.508996 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042d7b3-f8cc-4580-aaf8-003f0cac8ae1 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:34.509294 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042d7b3-f8cc-4580-aaf8-003f0cac8ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:34.509561 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042d7b3-f8cc-4580-aaf8-003f0cac8ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:34.538856 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-d042d7b3-f8cc-4580-aaf8-003f0cac8ae1 None None] MFA Rules not processed for user `1ccf7ddd060e4b6e8213ed251432eba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:34.540528 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d042d7b3-f8cc-4580-aaf8-003f0cac8ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:34.615818 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1336/2623] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:34 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:34.627936 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c033660-05d6-416a-be66-808eb422a21a admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:34.629753 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-9c033660-05d6-416a-be66-808eb422a21a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:34.687077 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c033660-05d6-416a-be66-808eb422a21a admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:34.690727 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c17428-a7dd-498d-830b-4d99b24381fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:34.691324 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c17428-a7dd-498d-830b-4d99b24381fe service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:34.691634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c17428-a7dd-498d-830b-4d99b24381fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:34.691908 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c17428-a7dd-498d-830b-4d99b24381fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:34.701488 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c17428-a7dd-498d-830b-4d99b24381fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:34.702927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c17428-a7dd-498d-830b-4d99b24381fe service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:34.712796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1288/2624] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:20:34 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:20:34.741298 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042d7b3-f8cc-4580-aaf8-003f0cac8ae1 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:34.775716 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:34.804161 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042d7b3-f8cc-4580-aaf8-003f0cac8ae1 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:34.809309 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e16f1-b191-47ea-ad33-f8dcf87bc44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:34.809926 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e16f1-b191-47ea-ad33-f8dcf87bc44d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:34.810203 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e16f1-b191-47ea-ad33-f8dcf87bc44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:34.810468 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e16f1-b191-47ea-ad33-f8dcf87bc44d admin admin] PATH_INFO: `/v3/users/0e16a2c426f949419f3de3255abb339b` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:34.811613 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e16f1-b191-47ea-ad33-f8dcf87bc44d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e16a2c426f949419f3de3255abb339b)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:34.813494 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e16f1-b191-47ea-ad33-f8dcf87bc44d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:34.861461 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-650e16f1-b191-47ea-ad33-f8dcf87bc44d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e16a2c426f949419f3de3255abb339b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:34.862145 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-650e16f1-b191-47ea-ad33-f8dcf87bc44d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e16a2c426f949419f3de3255abb339b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:34.869189 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-650e16f1-b191-47ea-ad33-f8dcf87bc44d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e16a2c426f949419f3de3255abb339b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:34.877403 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-650e16f1-b191-47ea-ad33-f8dcf87bc44d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e16a2c426f949419f3de3255abb339b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:34.878081 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-650e16f1-b191-47ea-ad33-f8dcf87bc44d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e16a2c426f949419f3de3255abb339b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:34.896088 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1337/2625] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:20:34 2022] DELETE /identity/v3/users/0e16a2c426f949419f3de3255abb339b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:20:34.900740 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e14db-1d8b-46ae-9a48-ad2035915f7b None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:34.901028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e14db-1d8b-46ae-9a48-ad2035915f7b None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:34.901304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e14db-1d8b-46ae-9a48-ad2035915f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:34.921344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-c52e14db-1d8b-46ae-9a48-ad2035915f7b None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:34.922548 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-c52e14db-1d8b-46ae-9a48-ad2035915f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:34.986663 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1289/2626] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:35.011189 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e16f1-b191-47ea-ad33-f8dcf87bc44d admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:35.013148 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-650e16f1-b191-47ea-ad33-f8dcf87bc44d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:35.070694 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e16f1-b191-47ea-ad33-f8dcf87bc44d admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:35.074903 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09e4e7-4bbc-4546-97c3-f6737d925c1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:35.075532 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09e4e7-4bbc-4546-97c3-f6737d925c1e service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:35.075814 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09e4e7-4bbc-4546-97c3-f6737d925c1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:35.076082 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09e4e7-4bbc-4546-97c3-f6737d925c1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:35.085317 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09e4e7-4bbc-4546-97c3-f6737d925c1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:35.086735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09e4e7-4bbc-4546-97c3-f6737d925c1e service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:35.097130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1338/2627] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:20:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:20:35.355525 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e14db-1d8b-46ae-9a48-ad2035915f7b None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:35.357458 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-c52e14db-1d8b-46ae-9a48-ad2035915f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:35.370521 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:35.377590 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e14db-1d8b-46ae-9a48-ad2035915f7b None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:35.384695 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488c801-9418-4a02-a8f7-b625716d0a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:35.385399 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488c801-9418-4a02-a8f7-b625716d0a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:35.385737 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488c801-9418-4a02-a8f7-b625716d0a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:35.386089 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488c801-9418-4a02-a8f7-b625716d0a32 admin admin] PATH_INFO: `/v3/projects/0d5f107754af43f5834c040226409dd1` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:35.387839 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488c801-9418-4a02-a8f7-b625716d0a32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d5f107754af43f5834c040226409dd1)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:35.389723 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488c801-9418-4a02-a8f7-b625716d0a32 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:35.440028 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-b488c801-9418-4a02-a8f7-b625716d0a32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d5f107754af43f5834c040226409dd1', 'request_id': 'req-b488c801-9418-4a02-a8f7-b625716d0a32'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:35.447169 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-b488c801-9418-4a02-a8f7-b625716d0a32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d5f107754af43f5834c040226409dd1', 'request_id': 'req-b488c801-9418-4a02-a8f7-b625716d0a32'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:35.455850 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-b488c801-9418-4a02-a8f7-b625716d0a32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d5f107754af43f5834c040226409dd1', 'request_id': 'req-b488c801-9418-4a02-a8f7-b625716d0a32'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:35.468402 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-b488c801-9418-4a02-a8f7-b625716d0a32 admin admin] The token cache is being invalidate because project 0d5f107754af43f5834c040226409dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:20:35.468745 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-b488c801-9418-4a02-a8f7-b625716d0a32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:35.469775 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-b488c801-9418-4a02-a8f7-b625716d0a32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:35.474650 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1290/2628] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:20:35 2022] DELETE /identity/v3/projects/0d5f107754af43f5834c040226409dd1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:20:35.479206 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09e4e7-4bbc-4546-97c3-f6737d925c1e service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:35.500402 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09e4e7-4bbc-4546-97c3-f6737d925c1e service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:35.572424 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:35.586952 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b663e-afeb-44ca-bd49-add518316146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:35.587708 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b663e-afeb-44ca-bd49-add518316146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:35.587985 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b663e-afeb-44ca-bd49-add518316146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:35.588251 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b663e-afeb-44ca-bd49-add518316146 admin admin] PATH_INFO: `/v3/users/1ccf7ddd060e4b6e8213ed251432eba4` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:35.589476 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b663e-afeb-44ca-bd49-add518316146 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ccf7ddd060e4b6e8213ed251432eba4)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:35.591561 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b663e-afeb-44ca-bd49-add518316146 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:35.659122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e92b663e-afeb-44ca-bd49-add518316146 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ccf7ddd060e4b6e8213ed251432eba4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:35.660009 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e92b663e-afeb-44ca-bd49-add518316146 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ccf7ddd060e4b6e8213ed251432eba4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:35.668778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e92b663e-afeb-44ca-bd49-add518316146 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ccf7ddd060e4b6e8213ed251432eba4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:35.677017 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e92b663e-afeb-44ca-bd49-add518316146 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ccf7ddd060e4b6e8213ed251432eba4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:35.677730 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e92b663e-afeb-44ca-bd49-add518316146 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ccf7ddd060e4b6e8213ed251432eba4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:35.696190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1339/2629] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:20:35 2022] DELETE /identity/v3/users/1ccf7ddd060e4b6e8213ed251432eba4 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:20:35.979778 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488c801-9418-4a02-a8f7-b625716d0a32 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:35.981384 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b488c801-9418-4a02-a8f7-b625716d0a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:35.994713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488c801-9418-4a02-a8f7-b625716d0a32 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:36.053676 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df05f3-98f7-450a-9853-23200202546d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:36.054316 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df05f3-98f7-450a-9853-23200202546d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:36.054598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df05f3-98f7-450a-9853-23200202546d admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:36.054873 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df05f3-98f7-450a-9853-23200202546d admin admin] PATH_INFO: `/v3/projects/9c4f6c4cac1846a0979e785f45b5bebf` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:36.056023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df05f3-98f7-450a-9853-23200202546d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c4f6c4cac1846a0979e785f45b5bebf)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:36.057933 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df05f3-98f7-450a-9853-23200202546d admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:36.104293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-e9df05f3-98f7-450a-9853-23200202546d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c4f6c4cac1846a0979e785f45b5bebf', 'request_id': 'req-e9df05f3-98f7-450a-9853-23200202546d'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:36.109775 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-e9df05f3-98f7-450a-9853-23200202546d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c4f6c4cac1846a0979e785f45b5bebf', 'request_id': 'req-e9df05f3-98f7-450a-9853-23200202546d'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:36.117225 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-e9df05f3-98f7-450a-9853-23200202546d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c4f6c4cac1846a0979e785f45b5bebf', 'request_id': 'req-e9df05f3-98f7-450a-9853-23200202546d'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:36.129111 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-e9df05f3-98f7-450a-9853-23200202546d admin admin] The token cache is being invalidate because project 9c4f6c4cac1846a0979e785f45b5bebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:20:36.129399 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-e9df05f3-98f7-450a-9853-23200202546d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:36.130034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-e9df05f3-98f7-450a-9853-23200202546d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:36.131544 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1291/2630] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:20:35 2022] DELETE /identity/v3/projects/9c4f6c4cac1846a0979e785f45b5bebf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:20:36.136513 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9a6ae-5627-4c50-942c-9301babafee9 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:36.137534 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9a6ae-5627-4c50-942c-9301babafee9 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:36.137804 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9a6ae-5627-4c50-942c-9301babafee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:36.157182 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-1ef9a6ae-5627-4c50-942c-9301babafee9 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:36.158481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-1ef9a6ae-5627-4c50-942c-9301babafee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:36.220123 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1340/2631] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:36.227919 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141039e-68b8-4538-9cfc-b01d84d21269 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:36.228142 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141039e-68b8-4538-9cfc-b01d84d21269 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:36.228415 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141039e-68b8-4538-9cfc-b01d84d21269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:36.249254 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-b141039e-68b8-4538-9cfc-b01d84d21269 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:36.250460 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b141039e-68b8-4538-9cfc-b01d84d21269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:36.258591 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1292/2632] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:36.263309 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9a6ae-5627-4c50-942c-9301babafee9 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:36.273020 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9a6ae-5627-4c50-942c-9301babafee9 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:36.277708 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0374621-b526-40d9-9dd9-1fb7b271e201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:36.278302 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0374621-b526-40d9-9dd9-1fb7b271e201 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:36.278579 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0374621-b526-40d9-9dd9-1fb7b271e201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:36.278840 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0374621-b526-40d9-9dd9-1fb7b271e201 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:36.279522 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0374621-b526-40d9-9dd9-1fb7b271e201 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:20:36.279827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0374621-b526-40d9-9dd9-1fb7b271e201 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:36.281433 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0374621-b526-40d9-9dd9-1fb7b271e201 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:36.293999 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1341/2633] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:20:36.298345 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141039e-68b8-4538-9cfc-b01d84d21269 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:36.309277 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141039e-68b8-4538-9cfc-b01d84d21269 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:36.314494 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e44336-2fc7-4e6d-8277-d5ca4a31c8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:36.314887 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e44336-2fc7-4e6d-8277-d5ca4a31c8da admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:36.315164 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e44336-2fc7-4e6d-8277-d5ca4a31c8da admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:36.315466 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e44336-2fc7-4e6d-8277-d5ca4a31c8da admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:36.316113 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e44336-2fc7-4e6d-8277-d5ca4a31c8da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:36.318004 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e44336-2fc7-4e6d-8277-d5ca4a31c8da admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:36.328291 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:36.350818 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1293/2634] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:20:36 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:20:36.352087 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0374621-b526-40d9-9dd9-1fb7b271e201 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:36.362921 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0374621-b526-40d9-9dd9-1fb7b271e201 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:36.422025 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae50258-2894-44b1-81e0-e12eb9debc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:36.422629 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae50258-2894-44b1-81e0-e12eb9debc7b admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:36.422902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae50258-2894-44b1-81e0-e12eb9debc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:36.423200 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae50258-2894-44b1-81e0-e12eb9debc7b admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:36.423866 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae50258-2894-44b1-81e0-e12eb9debc7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:36.425758 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae50258-2894-44b1-81e0-e12eb9debc7b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:36.435248 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:36.450296 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1342/2635] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:20:36 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:20:36.454482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e44336-2fc7-4e6d-8277-d5ca4a31c8da admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:36.465256 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e44336-2fc7-4e6d-8277-d5ca4a31c8da admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:36.470277 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ac21f-6a65-4620-b782-4541a7fd9328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:36.470888 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ac21f-6a65-4620-b782-4541a7fd9328 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:36.471159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ac21f-6a65-4620-b782-4541a7fd9328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:36.471426 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ac21f-6a65-4620-b782-4541a7fd9328 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:36.472084 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ac21f-6a65-4620-b782-4541a7fd9328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:36.473673 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ac21f-6a65-4620-b782-4541a7fd9328 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:36.488782 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1294/2636] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:20:36.490017 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae50258-2894-44b1-81e0-e12eb9debc7b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:36.501269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae50258-2894-44b1-81e0-e12eb9debc7b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:36.505875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995c55f-db32-44f2-a107-27a5ee371c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:36.506475 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995c55f-db32-44f2-a107-27a5ee371c81 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:36.506755 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995c55f-db32-44f2-a107-27a5ee371c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:36.507016 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995c55f-db32-44f2-a107-27a5ee371c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:36.507712 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995c55f-db32-44f2-a107-27a5ee371c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:36.509312 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995c55f-db32-44f2-a107-27a5ee371c81 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:36.519857 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1343/2637] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:20:36.524001 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ac21f-6a65-4620-b782-4541a7fd9328 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:36.535035 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ac21f-6a65-4620-b782-4541a7fd9328 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:36.539735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ecee8-6023-49f6-9ffd-3bb873c53103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:36.540425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ecee8-6023-49f6-9ffd-3bb873c53103 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:36.540705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ecee8-6023-49f6-9ffd-3bb873c53103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:36.540979 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ecee8-6023-49f6-9ffd-3bb873c53103 admin admin] PATH_INFO: `/v3/projects/d3c5b34b705a450dbd16305320d83f75/users/c81ddf7c524648f6968456890d092865/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:36.556372 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ecee8-6023-49f6-9ffd-3bb873c53103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c5b34b705a450dbd16305320d83f75, user_id=c81ddf7c524648f6968456890d092865, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:36.559737 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ecee8-6023-49f6-9ffd-3bb873c53103 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:36.573169 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1295/2638] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:20:36 2022] PUT /identity/v3/projects/d3c5b34b705a450dbd16305320d83f75/users/c81ddf7c524648f6968456890d092865/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:20:36.584343 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28eb6f-096b-4eca-b797-80e9e49f7dc8 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:36.584632 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28eb6f-096b-4eca-b797-80e9e49f7dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:36.584907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28eb6f-096b-4eca-b797-80e9e49f7dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:36.614123 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-5b28eb6f-096b-4eca-b797-80e9e49f7dc8 None None] MFA Rules not processed for user `c81ddf7c524648f6968456890d092865`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:36.615328 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5b28eb6f-096b-4eca-b797-80e9e49f7dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:36.658362 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ecee8-6023-49f6-9ffd-3bb873c53103 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:36.660220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-5d1ecee8-6023-49f6-9ffd-3bb873c53103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:36.683539 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1344/2639] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:36.695488 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28eb6f-096b-4eca-b797-80e9e49f7dc8 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:36.697453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5b28eb6f-096b-4eca-b797-80e9e49f7dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:36.750619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ecee8-6023-49f6-9ffd-3bb873c53103 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:36.756002 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26892f5d-7a33-4d95-a216-9072d8b38528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:36.756726 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26892f5d-7a33-4d95-a216-9072d8b38528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:36.757071 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26892f5d-7a33-4d95-a216-9072d8b38528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:36.757439 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26892f5d-7a33-4d95-a216-9072d8b38528 admin admin] PATH_INFO: `/v3/users/01b15b772c1245f3b8155fc2cced06ca` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:36.759205 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26892f5d-7a33-4d95-a216-9072d8b38528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01b15b772c1245f3b8155fc2cced06ca)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:36.762547 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26892f5d-7a33-4d95-a216-9072d8b38528 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:36.782949 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28eb6f-096b-4eca-b797-80e9e49f7dc8 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:36.788588 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e18ad5-0e9b-4f5b-9900-275c0aae0979 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9180b1616c524905b86769a9eb8f7757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:36.789359 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e18ad5-0e9b-4f5b-9900-275c0aae0979 service glance] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:36.789738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e18ad5-0e9b-4f5b-9900-275c0aae0979 service glance] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:36.790111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e18ad5-0e9b-4f5b-9900-275c0aae0979 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:36.802642 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e18ad5-0e9b-4f5b-9900-275c0aae0979 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:36.804506 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e18ad5-0e9b-4f5b-9900-275c0aae0979 service glance] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:36.816661 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1345/2640] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:20:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:20:36.830258 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-26892f5d-7a33-4d95-a216-9072d8b38528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01b15b772c1245f3b8155fc2cced06ca'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:36.846949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-26892f5d-7a33-4d95-a216-9072d8b38528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01b15b772c1245f3b8155fc2cced06ca'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:36.848552 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-26892f5d-7a33-4d95-a216-9072d8b38528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01b15b772c1245f3b8155fc2cced06ca'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:36.873844 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-26892f5d-7a33-4d95-a216-9072d8b38528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01b15b772c1245f3b8155fc2cced06ca'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:36.887249 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-26892f5d-7a33-4d95-a216-9072d8b38528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01b15b772c1245f3b8155fc2cced06ca'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:36.905096 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1296/2641] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:20:36 2022] DELETE /identity/v3/users/01b15b772c1245f3b8155fc2cced06ca => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:20:36.909891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce799f03-5435-4b43-9721-646efc27039f None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:36.910370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce799f03-5435-4b43-9721-646efc27039f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:36.910743 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce799f03-5435-4b43-9721-646efc27039f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:36.933737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-ce799f03-5435-4b43-9721-646efc27039f None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:36.935081 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ce799f03-5435-4b43-9721-646efc27039f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:37.006876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1346/2642] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:37.016427 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26892f5d-7a33-4d95-a216-9072d8b38528 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:37.019642 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-26892f5d-7a33-4d95-a216-9072d8b38528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:37.057398 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:37.083144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26892f5d-7a33-4d95-a216-9072d8b38528 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:37.086827 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02afa7-9d7d-40d0-a37f-a86add3c921e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:37.087428 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02afa7-9d7d-40d0-a37f-a86add3c921e service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:37.087730 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02afa7-9d7d-40d0-a37f-a86add3c921e service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:37.087998 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02afa7-9d7d-40d0-a37f-a86add3c921e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:37.096900 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02afa7-9d7d-40d0-a37f-a86add3c921e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:37.098319 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02afa7-9d7d-40d0-a37f-a86add3c921e service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:37.108962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1297/2643] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:20:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:20:37.391144 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce799f03-5435-4b43-9721-646efc27039f None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:37.393336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ce799f03-5435-4b43-9721-646efc27039f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:37.418599 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce799f03-5435-4b43-9721-646efc27039f None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:37.423495 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb92765-5454-473d-8ce7-5671cff9f671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:37.424137 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb92765-5454-473d-8ce7-5671cff9f671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:37.424412 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb92765-5454-473d-8ce7-5671cff9f671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:37.424728 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb92765-5454-473d-8ce7-5671cff9f671 admin admin] PATH_INFO: `/v3/projects/ab1f03a509364ffa8078a69cae024bcc` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:37.425798 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb92765-5454-473d-8ce7-5671cff9f671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab1f03a509364ffa8078a69cae024bcc)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:37.427703 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb92765-5454-473d-8ce7-5671cff9f671 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:37.436812 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:37.486030 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-afb92765-5454-473d-8ce7-5671cff9f671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab1f03a509364ffa8078a69cae024bcc', 'request_id': 'req-afb92765-5454-473d-8ce7-5671cff9f671'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:37.491896 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-afb92765-5454-473d-8ce7-5671cff9f671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab1f03a509364ffa8078a69cae024bcc', 'request_id': 'req-afb92765-5454-473d-8ce7-5671cff9f671'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:37.512978 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-afb92765-5454-473d-8ce7-5671cff9f671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab1f03a509364ffa8078a69cae024bcc', 'request_id': 'req-afb92765-5454-473d-8ce7-5671cff9f671'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:37.529691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-afb92765-5454-473d-8ce7-5671cff9f671 admin admin] The token cache is being invalidate because project ab1f03a509364ffa8078a69cae024bcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:20:37.530004 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-afb92765-5454-473d-8ce7-5671cff9f671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:37.530617 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-afb92765-5454-473d-8ce7-5671cff9f671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:37.532115 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1347/2644] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:20:37 2022] DELETE /identity/v3/projects/ab1f03a509364ffa8078a69cae024bcc => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:20:37.536885 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e9e65-b663-4f1a-8c0c-e204a36bf754 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:37.537169 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e9e65-b663-4f1a-8c0c-e204a36bf754 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:37.537441 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e9e65-b663-4f1a-8c0c-e204a36bf754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:37.557335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-a77e9e65-b663-4f1a-8c0c-e204a36bf754 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:37.558564 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-a77e9e65-b663-4f1a-8c0c-e204a36bf754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:37.633205 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1298/2645] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:37.642269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79657fa0-e941-4986-bc7a-b4f7a04e11c0 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:37.642591 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79657fa0-e941-4986-bc7a-b4f7a04e11c0 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:37.642867 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79657fa0-e941-4986-bc7a-b4f7a04e11c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:37.663600 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-79657fa0-e941-4986-bc7a-b4f7a04e11c0 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:37.664895 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-79657fa0-e941-4986-bc7a-b4f7a04e11c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:37.673436 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1348/2646] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:37.677878 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e9e65-b663-4f1a-8c0c-e204a36bf754 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:37.687540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e9e65-b663-4f1a-8c0c-e204a36bf754 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:37.692292 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa58342-a0ac-445c-9818-bb36f7ae9dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:37.692907 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa58342-a0ac-445c-9818-bb36f7ae9dcd admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:37.693201 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa58342-a0ac-445c-9818-bb36f7ae9dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:37.693479 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa58342-a0ac-445c-9818-bb36f7ae9dcd admin admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:37.694251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa58342-a0ac-445c-9818-bb36f7ae9dcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:20:37.694566 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa58342-a0ac-445c-9818-bb36f7ae9dcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:37.696256 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa58342-a0ac-445c-9818-bb36f7ae9dcd admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:37.709496 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1299/2647] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:20:37.713568 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79657fa0-e941-4986-bc7a-b4f7a04e11c0 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:37.723674 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79657fa0-e941-4986-bc7a-b4f7a04e11c0 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:37.728438 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e830a-5d70-47fc-b400-8a2df9886fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:37.729049 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e830a-5d70-47fc-b400-8a2df9886fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:37.729326 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e830a-5d70-47fc-b400-8a2df9886fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:37.729594 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e830a-5d70-47fc-b400-8a2df9886fe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:37.730293 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e830a-5d70-47fc-b400-8a2df9886fe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:37.732218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e830a-5d70-47fc-b400-8a2df9886fe6 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:37.759831 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1349/2648] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:20:37 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:20:37.764510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa58342-a0ac-445c-9818-bb36f7ae9dcd admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:37.775352 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa58342-a0ac-445c-9818-bb36f7ae9dcd admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:37.833672 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a8f09-b1b8-45e8-9716-e233dbc0174d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:37.834288 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a8f09-b1b8-45e8-9716-e233dbc0174d admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:37.834595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a8f09-b1b8-45e8-9716-e233dbc0174d admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:37.834886 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a8f09-b1b8-45e8-9716-e233dbc0174d admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:37.835591 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a8f09-b1b8-45e8-9716-e233dbc0174d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:37.837504 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a8f09-b1b8-45e8-9716-e233dbc0174d admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:37.859775 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1300/2649] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:20:37 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:20:37.863688 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e830a-5d70-47fc-b400-8a2df9886fe6 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:37.874358 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e830a-5d70-47fc-b400-8a2df9886fe6 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:37.880528 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a5277-0561-4716-bebd-e9f22831d31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:37.881132 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a5277-0561-4716-bebd-e9f22831d31c admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:37.881409 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a5277-0561-4716-bebd-e9f22831d31c admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:37.881680 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a5277-0561-4716-bebd-e9f22831d31c admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:37.882543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a5277-0561-4716-bebd-e9f22831d31c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:37.884573 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a5277-0561-4716-bebd-e9f22831d31c admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:37.895585 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1350/2650] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:20:37.899529 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a8f09-b1b8-45e8-9716-e233dbc0174d admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:37.911283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a8f09-b1b8-45e8-9716-e233dbc0174d admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:37.916513 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca4d16-2655-4223-920f-ca12fa739d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:37.917343 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca4d16-2655-4223-920f-ca12fa739d18 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:37.917848 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca4d16-2655-4223-920f-ca12fa739d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:37.918284 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca4d16-2655-4223-920f-ca12fa739d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:37.918928 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca4d16-2655-4223-920f-ca12fa739d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:37.921151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca4d16-2655-4223-920f-ca12fa739d18 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:37.935685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1301/2651] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:20:37.937011 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a5277-0561-4716-bebd-e9f22831d31c admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:37.947340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a5277-0561-4716-bebd-e9f22831d31c admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:37.953178 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda1d18-614b-4c68-a35e-f4c1a586e444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:37.953905 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda1d18-614b-4c68-a35e-f4c1a586e444 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:37.954189 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda1d18-614b-4c68-a35e-f4c1a586e444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:37.954465 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda1d18-614b-4c68-a35e-f4c1a586e444 admin admin] PATH_INFO: `/v3/projects/7ec1f09c583140f3a67f70ae5c2ef9aa/users/f5a365cf09de492594393c12d768f3bf/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:37.971194 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda1d18-614b-4c68-a35e-f4c1a586e444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec1f09c583140f3a67f70ae5c2ef9aa, user_id=f5a365cf09de492594393c12d768f3bf, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:37.973891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda1d18-614b-4c68-a35e-f4c1a586e444 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:37.989491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1351/2652] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:20:37 2022] PUT /identity/v3/projects/7ec1f09c583140f3a67f70ae5c2ef9aa/users/f5a365cf09de492594393c12d768f3bf/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:20:38.001263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b7f2f-5a88-48ff-a44d-85fffd4c472b None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:38.001549 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b7f2f-5a88-48ff-a44d-85fffd4c472b None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:38.001824 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b7f2f-5a88-48ff-a44d-85fffd4c472b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:38.040820 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-fd8b7f2f-5a88-48ff-a44d-85fffd4c472b None None] MFA Rules not processed for user `f5a365cf09de492594393c12d768f3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:38.042489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-fd8b7f2f-5a88-48ff-a44d-85fffd4c472b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:38.077017 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:38.117454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1302/2653] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:38.129702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda1d18-614b-4c68-a35e-f4c1a586e444 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:38.131609 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9eda1d18-614b-4c68-a35e-f4c1a586e444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:38.192555 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda1d18-614b-4c68-a35e-f4c1a586e444 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:38.196302 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dabe9e-52ca-4486-8fb5-fcfc32821a34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:38.196911 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dabe9e-52ca-4486-8fb5-fcfc32821a34 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:38.197185 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dabe9e-52ca-4486-8fb5-fcfc32821a34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:38.197452 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dabe9e-52ca-4486-8fb5-fcfc32821a34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:38.207164 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dabe9e-52ca-4486-8fb5-fcfc32821a34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:38.208624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dabe9e-52ca-4486-8fb5-fcfc32821a34 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:38.217445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1352/2654] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:20:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:20:40.427192 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253d629-be6e-43fa-89a7-4c97dc85dc60 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:40.427769 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253d629-be6e-43fa-89a7-4c97dc85dc60 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:40.427769 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253d629-be6e-43fa-89a7-4c97dc85dc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:40.448513 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-6253d629-be6e-43fa-89a7-4c97dc85dc60 None None] MFA Rules not processed for user `c0e57ea982d349c1a86b544e9a6e7758`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:40.450313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-6253d629-be6e-43fa-89a7-4c97dc85dc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:40.514525 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1303/2655] 10.222.0.16 () {58 vars in 967 bytes} [Wed Sep 28 12:20:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:40.528061 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dabe9e-52ca-4486-8fb5-fcfc32821a34 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:40.529554 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b6dabe9e-52ca-4486-8fb5-fcfc32821a34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:40.570668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:40.603297 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dabe9e-52ca-4486-8fb5-fcfc32821a34 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:40.608940 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c82869-eac9-4dca-843a-47251f480d0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '822e394e80fd41adb54d330adaf65a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:40.609539 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c82869-eac9-4dca-843a-47251f480d0c service swift] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:40.609816 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c82869-eac9-4dca-843a-47251f480d0c service swift] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:40.610082 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c82869-eac9-4dca-843a-47251f480d0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:40.618307 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c82869-eac9-4dca-843a-47251f480d0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:40.620153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c82869-eac9-4dca-843a-47251f480d0c service swift] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:40.628111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1353/2656] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 28 12:20:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 12:20:48.388613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253d629-be6e-43fa-89a7-4c97dc85dc60 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:48.451280 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253d629-be6e-43fa-89a7-4c97dc85dc60 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:48.455789 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c04fa-1b8d-4589-8064-4b1a82d61b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:48.456410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c04fa-1b8d-4589-8064-4b1a82d61b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:48.456686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c04fa-1b8d-4589-8064-4b1a82d61b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:48.456959 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c04fa-1b8d-4589-8064-4b1a82d61b9a admin admin] PATH_INFO: `/v3/users/f5a365cf09de492594393c12d768f3bf` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:48.458327 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c04fa-1b8d-4589-8064-4b1a82d61b9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5a365cf09de492594393c12d768f3bf)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:48.460456 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c04fa-1b8d-4589-8064-4b1a82d61b9a admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:48.505921 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-5d3c04fa-1b8d-4589-8064-4b1a82d61b9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5a365cf09de492594393c12d768f3bf'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:48.517861 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-5d3c04fa-1b8d-4589-8064-4b1a82d61b9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5a365cf09de492594393c12d768f3bf'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:48.518520 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-5d3c04fa-1b8d-4589-8064-4b1a82d61b9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5a365cf09de492594393c12d768f3bf'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:48.525118 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-5d3c04fa-1b8d-4589-8064-4b1a82d61b9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5a365cf09de492594393c12d768f3bf'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:48.531040 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:48.533215 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-5d3c04fa-1b8d-4589-8064-4b1a82d61b9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5a365cf09de492594393c12d768f3bf'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:48.543514 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1304/2657] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:20:48 2022] DELETE /identity/v3/users/f5a365cf09de492594393c12d768f3bf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:20:48.545070 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a3cc0-be65-4ce4-9baa-f0a78b1b1e28 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:48.545570 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a3cc0-be65-4ce4-9baa-f0a78b1b1e28 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:48.546048 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a3cc0-be65-4ce4-9baa-f0a78b1b1e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:48.565144 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-628a3cc0-be65-4ce4-9baa-f0a78b1b1e28 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:48.566360 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-628a3cc0-be65-4ce4-9baa-f0a78b1b1e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:48.627757 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1354/2658] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:20:48.638296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c04fa-1b8d-4589-8064-4b1a82d61b9a admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:48.639714 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-5d3c04fa-1b8d-4589-8064-4b1a82d61b9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:48.702679 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c04fa-1b8d-4589-8064-4b1a82d61b9a admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:48.708721 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23fa99-2851-4578-ba90-732d6c8584fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:48.709336 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23fa99-2851-4578-ba90-732d6c8584fe service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:48.709608 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23fa99-2851-4578-ba90-732d6c8584fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:48.709882 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23fa99-2851-4578-ba90-732d6c8584fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:48.721165 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23fa99-2851-4578-ba90-732d6c8584fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:48.722916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23fa99-2851-4578-ba90-732d6c8584fe service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:48.743662 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1305/2659] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:20:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:20:48.775049 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a3cc0-be65-4ce4-9baa-f0a78b1b1e28 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:48.776528 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-628a3cc0-be65-4ce4-9baa-f0a78b1b1e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:48.788798 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a3cc0-be65-4ce4-9baa-f0a78b1b1e28 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:48.792770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5751e-e0f2-466c-881b-cd46751d05ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:48.795237 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5751e-e0f2-466c-881b-cd46751d05ce service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:48.795615 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5751e-e0f2-466c-881b-cd46751d05ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:48.795856 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5751e-e0f2-466c-881b-cd46751d05ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:48.797691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-aab5751e-e0f2-466c-881b-cd46751d05ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:48.808091 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5751e-e0f2-466c-881b-cd46751d05ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:48.810036 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5751e-e0f2-466c-881b-cd46751d05ce service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:48.818400 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1355/2660] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:20:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:20:48.975539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860647b6-dc50-4476-a977-b713e3518af4 None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:48.975822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860647b6-dc50-4476-a977-b713e3518af4 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:48.976128 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860647b6-dc50-4476-a977-b713e3518af4 None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:48.977495 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1306/2661] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 28 12:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:20:48.983814 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cc022-d28d-44dd-95ba-2fd3170978ff None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:48.984097 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cc022-d28d-44dd-95ba-2fd3170978ff None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:48.984400 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cc022-d28d-44dd-95ba-2fd3170978ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:49.004677 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-7c3cc022-d28d-44dd-95ba-2fd3170978ff None None] MFA Rules not processed for user `ca51ff621664452db7dd991714462e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:49.005896 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7c3cc022-d28d-44dd-95ba-2fd3170978ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:49.012825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1356/2662] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 28 12:20:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:49.026287 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860647b6-dc50-4476-a977-b713e3518af4 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:49.037547 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860647b6-dc50-4476-a977-b713e3518af4 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:49.041122 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d21767-d2d5-431e-9175-bf0026a0fb02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:49.041711 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d21767-d2d5-431e-9175-bf0026a0fb02 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:49.041990 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d21767-d2d5-431e-9175-bf0026a0fb02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:49.042262 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d21767-d2d5-431e-9175-bf0026a0fb02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:49.050167 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d21767-d2d5-431e-9175-bf0026a0fb02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:49.051608 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d21767-d2d5-431e-9175-bf0026a0fb02 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:49.060135 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1307/2663] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:20:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:20:49.131819 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cc022-d28d-44dd-95ba-2fd3170978ff None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:49.133501 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7c3cc022-d28d-44dd-95ba-2fd3170978ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:49.148669 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a328bc6-7dc2-4b39-8939-07f387a0a2da None None] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:49.149357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a328bc6-7dc2-4b39-8939-07f387a0a2da None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:49.149858 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a328bc6-7dc2-4b39-8939-07f387a0a2da None None] PATH_INFO: `/` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:49.151996 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1308/2664] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 28 12:20:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:20:49.157842 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ad6ef-53cc-4681-9be0-ed34f5183c94 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:49.158125 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ad6ef-53cc-4681-9be0-ed34f5183c94 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:49.158398 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ad6ef-53cc-4681-9be0-ed34f5183c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:49.160971 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cc022-d28d-44dd-95ba-2fd3170978ff None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:49.166796 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f7fd0-1706-4a86-852f-b4f2bfe05f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:49.167509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f7fd0-1706-4a86-852f-b4f2bfe05f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:49.167706 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f7fd0-1706-4a86-852f-b4f2bfe05f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:49.167978 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f7fd0-1706-4a86-852f-b4f2bfe05f6e admin admin] PATH_INFO: `/v3/projects/7ec1f09c583140f3a67f70ae5c2ef9aa` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:49.171229 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f7fd0-1706-4a86-852f-b4f2bfe05f6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ec1f09c583140f3a67f70ae5c2ef9aa)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:49.173173 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f7fd0-1706-4a86-852f-b4f2bfe05f6e admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:49.183782 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-494ad6ef-53cc-4681-9be0-ed34f5183c94 None None] MFA Rules not processed for user `0e81804e04514ae882a1fd93789db025`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:49.185532 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-494ad6ef-53cc-4681-9be0-ed34f5183c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:49.220260 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ad6f7fd0-1706-4a86-852f-b4f2bfe05f6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ec1f09c583140f3a67f70ae5c2ef9aa', 'request_id': 'req-ad6f7fd0-1706-4a86-852f-b4f2bfe05f6e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:49.226267 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ad6f7fd0-1706-4a86-852f-b4f2bfe05f6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ec1f09c583140f3a67f70ae5c2ef9aa', 'request_id': 'req-ad6f7fd0-1706-4a86-852f-b4f2bfe05f6e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:49.233507 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ad6f7fd0-1706-4a86-852f-b4f2bfe05f6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ec1f09c583140f3a67f70ae5c2ef9aa', 'request_id': 'req-ad6f7fd0-1706-4a86-852f-b4f2bfe05f6e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:49.247315 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ad6f7fd0-1706-4a86-852f-b4f2bfe05f6e admin admin] The token cache is being invalidate because project 7ec1f09c583140f3a67f70ae5c2ef9aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:20:49.247675 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ad6f7fd0-1706-4a86-852f-b4f2bfe05f6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:49.248459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ad6f7fd0-1706-4a86-852f-b4f2bfe05f6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:49.250028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1357/2665] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:20:49 2022] DELETE /identity/v3/projects/7ec1f09c583140f3a67f70ae5c2ef9aa => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:20:49.254563 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c267ba8-9cc1-46d6-b664-674c51bd06b6 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:49.254843 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c267ba8-9cc1-46d6-b664-674c51bd06b6 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:49.255116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c267ba8-9cc1-46d6-b664-674c51bd06b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:49.256389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1309/2666] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 28 12:20:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:20:49.266788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ad6ef-53cc-4681-9be0-ed34f5183c94 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:49.268357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-494ad6ef-53cc-4681-9be0-ed34f5183c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:49.275138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-6c267ba8-9cc1-46d6-b664-674c51bd06b6 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:49.276367 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6c267ba8-9cc1-46d6-b664-674c51bd06b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:49.279429 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ad6ef-53cc-4681-9be0-ed34f5183c94 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:49.301358 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:49.330290 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4196786-70e0-413b-bed8-aea20bbe31b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:49.330898 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4196786-70e0-413b-bed8-aea20bbe31b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:49.331176 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4196786-70e0-413b-bed8-aea20bbe31b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:49.331459 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4196786-70e0-413b-bed8-aea20bbe31b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:49.339951 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1358/2667] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:20:49.348091 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e87ba-1fb8-40bc-af84-e11b0afb1d12 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:49.348373 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e87ba-1fb8-40bc-af84-e11b0afb1d12 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:49.348651 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e87ba-1fb8-40bc-af84-e11b0afb1d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:49.362450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:49.369846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-292e87ba-1fb8-40bc-af84-e11b0afb1d12 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:49.371340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-292e87ba-1fb8-40bc-af84-e11b0afb1d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:49.379207 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1359/2668] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:20:49.383249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e87ba-1fb8-40bc-af84-e11b0afb1d12 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:49.392352 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e87ba-1fb8-40bc-af84-e11b0afb1d12 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:49.396867 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d97eb-191b-411c-a617-d82b210298aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:49.397448 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d97eb-191b-411c-a617-d82b210298aa admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:49.397720 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d97eb-191b-411c-a617-d82b210298aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:49.397983 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d97eb-191b-411c-a617-d82b210298aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:49.398616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d97eb-191b-411c-a617-d82b210298aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:20:49.398913 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d97eb-191b-411c-a617-d82b210298aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:49.400500 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d97eb-191b-411c-a617-d82b210298aa admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:49.409307 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4196786-70e0-413b-bed8-aea20bbe31b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:49.411241 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4196786-70e0-413b-bed8-aea20bbe31b1 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:49.412823 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1360/2669] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:20:49.417177 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d97eb-191b-411c-a617-d82b210298aa admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:49.423089 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1310/2670] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:20:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:20:49.427663 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d97eb-191b-411c-a617-d82b210298aa admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:49.432304 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b1b37-d721-4e41-ad3b-f67ea4d072a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:49.432894 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b1b37-d721-4e41-ad3b-f67ea4d072a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:49.433177 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b1b37-d721-4e41-ad3b-f67ea4d072a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:49.433446 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b1b37-d721-4e41-ad3b-f67ea4d072a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:49.434127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b1b37-d721-4e41-ad3b-f67ea4d072a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:49.436039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b1b37-d721-4e41-ad3b-f67ea4d072a6 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:49.463269 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1361/2671] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:20:49 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:20:49.468037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4196786-70e0-413b-bed8-aea20bbe31b1 service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:49.478743 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4196786-70e0-413b-bed8-aea20bbe31b1 service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:49.536210 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aaedfe-c3de-4ed1-ab6b-98352d31416d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:49.536822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aaedfe-c3de-4ed1-ab6b-98352d31416d admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:49.537095 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aaedfe-c3de-4ed1-ab6b-98352d31416d admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:49.537364 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aaedfe-c3de-4ed1-ab6b-98352d31416d admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:49.537996 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aaedfe-c3de-4ed1-ab6b-98352d31416d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:49.539918 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aaedfe-c3de-4ed1-ab6b-98352d31416d admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:49.562443 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1311/2672] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:20:49 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:20:49.566409 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b1b37-d721-4e41-ad3b-f67ea4d072a6 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:49.576840 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b1b37-d721-4e41-ad3b-f67ea4d072a6 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:49.581575 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c9d18-7235-46e6-be1c-a7bb221b047f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:49.582152 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c9d18-7235-46e6-be1c-a7bb221b047f admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:49.582432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c9d18-7235-46e6-be1c-a7bb221b047f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:49.582702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c9d18-7235-46e6-be1c-a7bb221b047f admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:49.583343 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c9d18-7235-46e6-be1c-a7bb221b047f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:49.585019 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c9d18-7235-46e6-be1c-a7bb221b047f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:49.598821 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1362/2673] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:20:49.600001 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aaedfe-c3de-4ed1-ab6b-98352d31416d admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:49.610981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aaedfe-c3de-4ed1-ab6b-98352d31416d admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:49.615606 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89cd1bc-2d7c-47aa-abcd-b893d1bd2ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:49.616205 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cd1bc-2d7c-47aa-abcd-b893d1bd2ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:49.616482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cd1bc-2d7c-47aa-abcd-b893d1bd2ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:49.616751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cd1bc-2d7c-47aa-abcd-b893d1bd2ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:49.617386 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89cd1bc-2d7c-47aa-abcd-b893d1bd2ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:49.618953 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89cd1bc-2d7c-47aa-abcd-b893d1bd2ec5 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:49.629193 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1312/2674] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:20:49.633327 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c9d18-7235-46e6-be1c-a7bb221b047f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:49.644443 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c9d18-7235-46e6-be1c-a7bb221b047f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:49.649838 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c41772-145b-43b4-970f-f3d98177fe1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:49.650625 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c41772-145b-43b4-970f-f3d98177fe1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:49.650903 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c41772-145b-43b4-970f-f3d98177fe1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:49.651176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c41772-145b-43b4-970f-f3d98177fe1b admin admin] PATH_INFO: `/v3/projects/951095d195d744729715cefa80fa4359/users/86045fa118c34cd28ac166afd0abbb3c/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:49.667288 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c41772-145b-43b4-970f-f3d98177fe1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=951095d195d744729715cefa80fa4359, user_id=86045fa118c34cd28ac166afd0abbb3c, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:49.670573 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c41772-145b-43b4-970f-f3d98177fe1b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:49.684116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1363/2675] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:20:49 2022] PUT /identity/v3/projects/951095d195d744729715cefa80fa4359/users/86045fa118c34cd28ac166afd0abbb3c/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:20:49.751653 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917bfd1-48a8-484d-aec1-cec28941d22e None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:49.751974 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917bfd1-48a8-484d-aec1-cec28941d22e None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:49.752285 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917bfd1-48a8-484d-aec1-cec28941d22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:49.782056 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-d917bfd1-48a8-484d-aec1-cec28941d22e None None] MFA Rules not processed for user `86045fa118c34cd28ac166afd0abbb3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:49.783292 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-d917bfd1-48a8-484d-aec1-cec28941d22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:49.852650 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1313/2676] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:49 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:49.864265 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c41772-145b-43b4-970f-f3d98177fe1b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:49.866041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-94c41772-145b-43b4-970f-f3d98177fe1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:49.925335 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c41772-145b-43b4-970f-f3d98177fe1b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:49.929235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9cb80-55b3-4cdd-ab22-b31867c07205 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:49.929841 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9cb80-55b3-4cdd-ab22-b31867c07205 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:49.930119 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9cb80-55b3-4cdd-ab22-b31867c07205 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:49.930388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9cb80-55b3-4cdd-ab22-b31867c07205 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:49.939027 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9cb80-55b3-4cdd-ab22-b31867c07205 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:49.940475 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9cb80-55b3-4cdd-ab22-b31867c07205 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:49.950280 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1364/2677] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:20:49 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:20:50.536208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917bfd1-48a8-484d-aec1-cec28941d22e None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:50.537814 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-d917bfd1-48a8-484d-aec1-cec28941d22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:50.573014 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:50.627402 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917bfd1-48a8-484d-aec1-cec28941d22e None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:50.633029 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466806b-caa1-4a40-be7b-50edd41b64b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:50.633635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466806b-caa1-4a40-be7b-50edd41b64b8 service nova] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:50.633916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466806b-caa1-4a40-be7b-50edd41b64b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:50.634193 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466806b-caa1-4a40-be7b-50edd41b64b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:50.636032 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-6466806b-caa1-4a40-be7b-50edd41b64b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:50.648629 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466806b-caa1-4a40-be7b-50edd41b64b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:50.650211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466806b-caa1-4a40-be7b-50edd41b64b8 service nova] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:50.661687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1314/2678] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:20:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:20:52.427281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9cb80-55b3-4cdd-ab22-b31867c07205 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:52.428715 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9de9cb80-55b3-4cdd-ab22-b31867c07205 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:52.487699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:52.494440 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9cb80-55b3-4cdd-ab22-b31867c07205 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:52.499991 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e309ec-5965-417b-858f-6d89554ae0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:52.500607 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e309ec-5965-417b-858f-6d89554ae0e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:52.500886 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e309ec-5965-417b-858f-6d89554ae0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:52.501148 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e309ec-5965-417b-858f-6d89554ae0e7 admin admin] PATH_INFO: `/v3/users/c81ddf7c524648f6968456890d092865` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:52.502265 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e309ec-5965-417b-858f-6d89554ae0e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c81ddf7c524648f6968456890d092865)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:52.504210 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e309ec-5965-417b-858f-6d89554ae0e7 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:52.551866 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c4e309ec-5965-417b-858f-6d89554ae0e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c81ddf7c524648f6968456890d092865'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:52.552636 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c4e309ec-5965-417b-858f-6d89554ae0e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c81ddf7c524648f6968456890d092865'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:52.560664 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c4e309ec-5965-417b-858f-6d89554ae0e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c81ddf7c524648f6968456890d092865'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:52.567751 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c4e309ec-5965-417b-858f-6d89554ae0e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c81ddf7c524648f6968456890d092865'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:52.568445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c4e309ec-5965-417b-858f-6d89554ae0e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c81ddf7c524648f6968456890d092865'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:52.586803 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1365/2679] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:20:52 2022] DELETE /identity/v3/users/c81ddf7c524648f6968456890d092865 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:20:52.591190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5e891-fcb1-4b37-addf-cb4d4c23c115 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:52.591642 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5e891-fcb1-4b37-addf-cb4d4c23c115 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:52.591772 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5e891-fcb1-4b37-addf-cb4d4c23c115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:52.611012 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-34c5e891-fcb1-4b37-addf-cb4d4c23c115 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:52.612275 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-34c5e891-fcb1-4b37-addf-cb4d4c23c115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:52.674687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1315/2680] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:52.685289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e309ec-5965-417b-858f-6d89554ae0e7 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:52.686744 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c4e309ec-5965-417b-858f-6d89554ae0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:52.766570 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e309ec-5965-417b-858f-6d89554ae0e7 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:52.770431 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eeb688-4bbb-43f5-8adb-afb759488543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:52.771050 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeb688-4bbb-43f5-8adb-afb759488543 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:52.771327 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeb688-4bbb-43f5-8adb-afb759488543 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:52.771629 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeb688-4bbb-43f5-8adb-afb759488543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:52.782021 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eeb688-4bbb-43f5-8adb-afb759488543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:52.783547 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eeb688-4bbb-43f5-8adb-afb759488543 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:52.797453 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1366/2681] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:20:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:20:53.079429 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5e891-fcb1-4b37-addf-cb4d4c23c115 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:53.080996 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-34c5e891-fcb1-4b37-addf-cb4d4c23c115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:53.097619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5e891-fcb1-4b37-addf-cb4d4c23c115 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:53.104147 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2a1e8-6057-4afe-9a7f-fc57e9acda3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:53.104868 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2a1e8-6057-4afe-9a7f-fc57e9acda3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:53.105204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2a1e8-6057-4afe-9a7f-fc57e9acda3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:53.105427 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2a1e8-6057-4afe-9a7f-fc57e9acda3e admin admin] PATH_INFO: `/v3/projects/d3c5b34b705a450dbd16305320d83f75` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:53.107108 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2a1e8-6057-4afe-9a7f-fc57e9acda3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3c5b34b705a450dbd16305320d83f75)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:53.109306 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2a1e8-6057-4afe-9a7f-fc57e9acda3e admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:53.155792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-61d2a1e8-6057-4afe-9a7f-fc57e9acda3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3c5b34b705a450dbd16305320d83f75', 'request_id': 'req-61d2a1e8-6057-4afe-9a7f-fc57e9acda3e'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:53.161524 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-61d2a1e8-6057-4afe-9a7f-fc57e9acda3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3c5b34b705a450dbd16305320d83f75', 'request_id': 'req-61d2a1e8-6057-4afe-9a7f-fc57e9acda3e'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:53.169306 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-61d2a1e8-6057-4afe-9a7f-fc57e9acda3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3c5b34b705a450dbd16305320d83f75', 'request_id': 'req-61d2a1e8-6057-4afe-9a7f-fc57e9acda3e'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:53.180261 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-61d2a1e8-6057-4afe-9a7f-fc57e9acda3e admin admin] The token cache is being invalidate because project d3c5b34b705a450dbd16305320d83f75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:20:53.180549 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-61d2a1e8-6057-4afe-9a7f-fc57e9acda3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:53.181170 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-61d2a1e8-6057-4afe-9a7f-fc57e9acda3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:53.182680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1316/2682] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:20:53 2022] DELETE /identity/v3/projects/d3c5b34b705a450dbd16305320d83f75 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:20:53.187810 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7e584-90a1-4aea-bae5-f71f16149952 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:53.188102 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7e584-90a1-4aea-bae5-f71f16149952 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:53.188380 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7e584-90a1-4aea-bae5-f71f16149952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:53.207469 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-a3b7e584-90a1-4aea-bae5-f71f16149952 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:53.208628 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a3b7e584-90a1-4aea-bae5-f71f16149952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:53.267272 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1367/2683] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:53.274986 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf7208-72cd-4b9d-a6a9-d017e9c43fcc None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:53.275269 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf7208-72cd-4b9d-a6a9-d017e9c43fcc None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:53.275581 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf7208-72cd-4b9d-a6a9-d017e9c43fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:53.295852 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-3cbf7208-72cd-4b9d-a6a9-d017e9c43fcc None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:53.297040 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-3cbf7208-72cd-4b9d-a6a9-d017e9c43fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:53.304783 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1317/2684] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:53.308876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7e584-90a1-4aea-bae5-f71f16149952 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:53.318364 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7e584-90a1-4aea-bae5-f71f16149952 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:53.322937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e3dee-c431-40ed-b448-570af9710dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:53.323565 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e3dee-c431-40ed-b448-570af9710dcc admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:53.323846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e3dee-c431-40ed-b448-570af9710dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:53.324118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e3dee-c431-40ed-b448-570af9710dcc admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:53.324757 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e3dee-c431-40ed-b448-570af9710dcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:20:53.325061 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e3dee-c431-40ed-b448-570af9710dcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:53.326677 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e3dee-c431-40ed-b448-570af9710dcc admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:53.337944 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1368/2685] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:20:53.342416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf7208-72cd-4b9d-a6a9-d017e9c43fcc None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:53.351369 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf7208-72cd-4b9d-a6a9-d017e9c43fcc None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:53.356683 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c7806-fbb6-499f-928c-ecc4cc8b41aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:53.357264 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c7806-fbb6-499f-928c-ecc4cc8b41aa admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:53.357557 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c7806-fbb6-499f-928c-ecc4cc8b41aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:53.357804 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c7806-fbb6-499f-928c-ecc4cc8b41aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:53.358414 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c7806-fbb6-499f-928c-ecc4cc8b41aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:53.360319 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c7806-fbb6-499f-928c-ecc4cc8b41aa admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:53.386738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1318/2686] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:20:53 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:20:53.390779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e3dee-c431-40ed-b448-570af9710dcc admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:53.396931 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:53.400988 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e3dee-c431-40ed-b448-570af9710dcc admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:53.460179 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc795eff-6130-43f0-8de7-11a0f92e5d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:53.461509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc795eff-6130-43f0-8de7-11a0f92e5d5b admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:53.461793 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc795eff-6130-43f0-8de7-11a0f92e5d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:53.462067 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc795eff-6130-43f0-8de7-11a0f92e5d5b admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:53.462719 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc795eff-6130-43f0-8de7-11a0f92e5d5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:53.464676 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc795eff-6130-43f0-8de7-11a0f92e5d5b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:53.485782 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1369/2687] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:20:53 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:20:53.490230 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c7806-fbb6-499f-928c-ecc4cc8b41aa admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:53.500852 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c7806-fbb6-499f-928c-ecc4cc8b41aa admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:53.505520 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21768df-289d-4a4e-8e28-52b41d540acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:53.506113 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21768df-289d-4a4e-8e28-52b41d540acc admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:53.506397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21768df-289d-4a4e-8e28-52b41d540acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:53.506673 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21768df-289d-4a4e-8e28-52b41d540acc admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:53.507312 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21768df-289d-4a4e-8e28-52b41d540acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:53.508946 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21768df-289d-4a4e-8e28-52b41d540acc admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:53.510170 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:53.520701 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1319/2688] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:20:53.524220 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc795eff-6130-43f0-8de7-11a0f92e5d5b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:53.534553 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc795eff-6130-43f0-8de7-11a0f92e5d5b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:53.539628 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a31d88-c518-4b33-8dba-d40d0a702292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:53.540218 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a31d88-c518-4b33-8dba-d40d0a702292 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:53.540521 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a31d88-c518-4b33-8dba-d40d0a702292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:53.540799 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a31d88-c518-4b33-8dba-d40d0a702292 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:53.541435 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a31d88-c518-4b33-8dba-d40d0a702292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:53.543017 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a31d88-c518-4b33-8dba-d40d0a702292 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:53.554025 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1370/2689] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:20:53.558183 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21768df-289d-4a4e-8e28-52b41d540acc admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:53.568121 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21768df-289d-4a4e-8e28-52b41d540acc admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:53.572949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d670b-7741-4bb3-9e71-f979e45b08c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:53.573594 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d670b-7741-4bb3-9e71-f979e45b08c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:53.573876 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d670b-7741-4bb3-9e71-f979e45b08c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:53.574152 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d670b-7741-4bb3-9e71-f979e45b08c5 admin admin] PATH_INFO: `/v3/projects/4fc4cea516b242ebbcd0250c0fdff20e/users/dff6674554204b41a2920ed3f92cbf79/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:53.589002 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d670b-7741-4bb3-9e71-f979e45b08c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc4cea516b242ebbcd0250c0fdff20e, user_id=dff6674554204b41a2920ed3f92cbf79, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:53.592341 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d670b-7741-4bb3-9e71-f979e45b08c5 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:53.604755 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1320/2690] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:20:53 2022] PUT /identity/v3/projects/4fc4cea516b242ebbcd0250c0fdff20e/users/dff6674554204b41a2920ed3f92cbf79/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:20:53.615049 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16b2da-77b4-41a4-aaa8-10029e1de144 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:53.615332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16b2da-77b4-41a4-aaa8-10029e1de144 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:53.615662 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16b2da-77b4-41a4-aaa8-10029e1de144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:53.643309 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-3e16b2da-77b4-41a4-aaa8-10029e1de144 None None] MFA Rules not processed for user `dff6674554204b41a2920ed3f92cbf79`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:53.644548 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3e16b2da-77b4-41a4-aaa8-10029e1de144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:53.708866 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1371/2691] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:53.720224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d670b-7741-4bb3-9e71-f979e45b08c5 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:53.721885 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-4e6d670b-7741-4bb3-9e71-f979e45b08c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:53.786053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d670b-7741-4bb3-9e71-f979e45b08c5 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:53.789741 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb3eda-e590-4788-82e3-2ba0022516a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:53.790346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb3eda-e590-4788-82e3-2ba0022516a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:53.790622 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb3eda-e590-4788-82e3-2ba0022516a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:53.790893 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb3eda-e590-4788-82e3-2ba0022516a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:53.799034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb3eda-e590-4788-82e3-2ba0022516a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:53.800475 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb3eda-e590-4788-82e3-2ba0022516a8 service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:53.809636 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1321/2692] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:20:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:20:55.070462 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16b2da-77b4-41a4-aaa8-10029e1de144 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:55.071922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3e16b2da-77b4-41a4-aaa8-10029e1de144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:55.140336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16b2da-77b4-41a4-aaa8-10029e1de144 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:55.145525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb9397-d8f4-4732-a8e8-e9a13aa62dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:55.146228 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb9397-d8f4-4732-a8e8-e9a13aa62dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:55.146622 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb9397-d8f4-4732-a8e8-e9a13aa62dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:55.147005 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb9397-d8f4-4732-a8e8-e9a13aa62dec admin admin] PATH_INFO: `/v3/users/86045fa118c34cd28ac166afd0abbb3c` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:55.148298 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb9397-d8f4-4732-a8e8-e9a13aa62dec admin admin] RBAC: Authorizing `identity:delete_user(user_id=86045fa118c34cd28ac166afd0abbb3c)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:55.150354 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb9397-d8f4-4732-a8e8-e9a13aa62dec admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:55.165714 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:55.203405 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a7bb9397-d8f4-4732-a8e8-e9a13aa62dec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86045fa118c34cd28ac166afd0abbb3c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:55.204108 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a7bb9397-d8f4-4732-a8e8-e9a13aa62dec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86045fa118c34cd28ac166afd0abbb3c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:55.211674 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a7bb9397-d8f4-4732-a8e8-e9a13aa62dec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86045fa118c34cd28ac166afd0abbb3c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:55.221569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a7bb9397-d8f4-4732-a8e8-e9a13aa62dec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86045fa118c34cd28ac166afd0abbb3c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:55.222447 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a7bb9397-d8f4-4732-a8e8-e9a13aa62dec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86045fa118c34cd28ac166afd0abbb3c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:55.246385 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1372/2693] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:20:55 2022] DELETE /identity/v3/users/86045fa118c34cd28ac166afd0abbb3c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:20:55.250579 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca6868-22c8-4618-b837-3c398a9ef3be None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:55.251026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca6868-22c8-4618-b837-3c398a9ef3be None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:55.251124 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca6868-22c8-4618-b837-3c398a9ef3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:55.271016 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-f3ca6868-22c8-4618-b837-3c398a9ef3be None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:55.272366 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-f3ca6868-22c8-4618-b837-3c398a9ef3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:55.343737 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1322/2694] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:20:55.352114 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb9397-d8f4-4732-a8e8-e9a13aa62dec admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:55.353766 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a7bb9397-d8f4-4732-a8e8-e9a13aa62dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:55.418919 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb9397-d8f4-4732-a8e8-e9a13aa62dec admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:55.422838 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e64c3f-5668-4eb6-a59e-b66a0ba54938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:55.423487 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e64c3f-5668-4eb6-a59e-b66a0ba54938 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:55.423767 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e64c3f-5668-4eb6-a59e-b66a0ba54938 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:55.424036 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e64c3f-5668-4eb6-a59e-b66a0ba54938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:55.433272 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e64c3f-5668-4eb6-a59e-b66a0ba54938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:55.435405 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e64c3f-5668-4eb6-a59e-b66a0ba54938 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:55.445737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1373/2695] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:20:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:20:55.715230 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca6868-22c8-4618-b837-3c398a9ef3be None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:55.716762 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-f3ca6868-22c8-4618-b837-3c398a9ef3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:55.731580 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca6868-22c8-4618-b837-3c398a9ef3be None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:55.737163 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2ffa7-3caa-4f43-9558-871e4ed93eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:55.738970 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2ffa7-3caa-4f43-9558-871e4ed93eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:55.739263 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2ffa7-3caa-4f43-9558-871e4ed93eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:55.739557 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2ffa7-3caa-4f43-9558-871e4ed93eb4 admin admin] PATH_INFO: `/v3/projects/951095d195d744729715cefa80fa4359` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:55.740697 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2ffa7-3caa-4f43-9558-871e4ed93eb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=951095d195d744729715cefa80fa4359)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:55.742589 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2ffa7-3caa-4f43-9558-871e4ed93eb4 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:55.790522 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-e7d2ffa7-3caa-4f43-9558-871e4ed93eb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '951095d195d744729715cefa80fa4359', 'request_id': 'req-e7d2ffa7-3caa-4f43-9558-871e4ed93eb4'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:55.796668 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-e7d2ffa7-3caa-4f43-9558-871e4ed93eb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '951095d195d744729715cefa80fa4359', 'request_id': 'req-e7d2ffa7-3caa-4f43-9558-871e4ed93eb4'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:55.804209 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-e7d2ffa7-3caa-4f43-9558-871e4ed93eb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '951095d195d744729715cefa80fa4359', 'request_id': 'req-e7d2ffa7-3caa-4f43-9558-871e4ed93eb4'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:55.812346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:55.817705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-e7d2ffa7-3caa-4f43-9558-871e4ed93eb4 admin admin] The token cache is being invalidate because project 951095d195d744729715cefa80fa4359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:20:55.818184 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-e7d2ffa7-3caa-4f43-9558-871e4ed93eb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:55.819368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-e7d2ffa7-3caa-4f43-9558-871e4ed93eb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:55.821034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1323/2696] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:20:55 2022] DELETE /identity/v3/projects/951095d195d744729715cefa80fa4359 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:20:59.243894 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e64c3f-5668-4eb6-a59e-b66a0ba54938 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:59.245560 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-60e64c3f-5668-4eb6-a59e-b66a0ba54938 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:59.258572 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e64c3f-5668-4eb6-a59e-b66a0ba54938 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:59.314711 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb6f67-8174-4212-addb-71a3c8a0328a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:59.315337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb6f67-8174-4212-addb-71a3c8a0328a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:59.315639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb6f67-8174-4212-addb-71a3c8a0328a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:59.315910 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb6f67-8174-4212-addb-71a3c8a0328a admin admin] PATH_INFO: `/v3/users/dff6674554204b41a2920ed3f92cbf79` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:59.317035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb6f67-8174-4212-addb-71a3c8a0328a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dff6674554204b41a2920ed3f92cbf79)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:59.318915 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb6f67-8174-4212-addb-71a3c8a0328a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:59.356608 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:59.366819 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-45cb6f67-8174-4212-addb-71a3c8a0328a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dff6674554204b41a2920ed3f92cbf79'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:59.367508 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-45cb6f67-8174-4212-addb-71a3c8a0328a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dff6674554204b41a2920ed3f92cbf79'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:59.375340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-45cb6f67-8174-4212-addb-71a3c8a0328a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dff6674554204b41a2920ed3f92cbf79'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:59.382877 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-45cb6f67-8174-4212-addb-71a3c8a0328a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dff6674554204b41a2920ed3f92cbf79'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:59.383638 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-45cb6f67-8174-4212-addb-71a3c8a0328a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dff6674554204b41a2920ed3f92cbf79'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:59.402407 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1374/2697] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:20:59 2022] DELETE /identity/v3/users/dff6674554204b41a2920ed3f92cbf79 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:20:59.407219 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b5125-ce8d-4ab1-b4d0-2caf8fe6d26b None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:59.407709 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b5125-ce8d-4ab1-b4d0-2caf8fe6d26b None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:59.407804 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b5125-ce8d-4ab1-b4d0-2caf8fe6d26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:59.426905 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-ec0b5125-ce8d-4ab1-b4d0-2caf8fe6d26b None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:59.428157 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-ec0b5125-ce8d-4ab1-b4d0-2caf8fe6d26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:59.487624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1324/2698] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:59.498363 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb6f67-8174-4212-addb-71a3c8a0328a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:59.499820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-45cb6f67-8174-4212-addb-71a3c8a0328a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:59.556077 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb6f67-8174-4212-addb-71a3c8a0328a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:59.560350 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999e7a7-c9d1-4eff-9f5a-8b4000a577ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:59.560956 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999e7a7-c9d1-4eff-9f5a-8b4000a577ea service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:59.561235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999e7a7-c9d1-4eff-9f5a-8b4000a577ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:59.561508 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999e7a7-c9d1-4eff-9f5a-8b4000a577ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:59.570553 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999e7a7-c9d1-4eff-9f5a-8b4000a577ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:59.572008 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999e7a7-c9d1-4eff-9f5a-8b4000a577ea service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:59.581740 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1375/2699] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:20:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:20:59.845601 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b5125-ce8d-4ab1-b4d0-2caf8fe6d26b None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:59.847042 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-ec0b5125-ce8d-4ab1-b4d0-2caf8fe6d26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:59.860662 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b5125-ce8d-4ab1-b4d0-2caf8fe6d26b None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:59.865352 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02f738-36be-4da8-9c7d-57fe1739f84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:59.865982 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02f738-36be-4da8-9c7d-57fe1739f84f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:59.866255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02f738-36be-4da8-9c7d-57fe1739f84f admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:59.866523 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02f738-36be-4da8-9c7d-57fe1739f84f admin admin] PATH_INFO: `/v3/projects/4fc4cea516b242ebbcd0250c0fdff20e` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:59.867675 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02f738-36be-4da8-9c7d-57fe1739f84f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fc4cea516b242ebbcd0250c0fdff20e)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:59.869574 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02f738-36be-4da8-9c7d-57fe1739f84f admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:59.920678 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-9b02f738-36be-4da8-9c7d-57fe1739f84f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fc4cea516b242ebbcd0250c0fdff20e', 'request_id': 'req-9b02f738-36be-4da8-9c7d-57fe1739f84f'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:59.928639 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-9b02f738-36be-4da8-9c7d-57fe1739f84f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fc4cea516b242ebbcd0250c0fdff20e', 'request_id': 'req-9b02f738-36be-4da8-9c7d-57fe1739f84f'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:59.940510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-9b02f738-36be-4da8-9c7d-57fe1739f84f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fc4cea516b242ebbcd0250c0fdff20e', 'request_id': 'req-9b02f738-36be-4da8-9c7d-57fe1739f84f'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:59.954122 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-9b02f738-36be-4da8-9c7d-57fe1739f84f admin admin] The token cache is being invalidate because project 4fc4cea516b242ebbcd0250c0fdff20e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:20:59.954412 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-9b02f738-36be-4da8-9c7d-57fe1739f84f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:59.955083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-9b02f738-36be-4da8-9c7d-57fe1739f84f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:20:59.956648 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1325/2700] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:20:59 2022] DELETE /identity/v3/projects/4fc4cea516b242ebbcd0250c0fdff20e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:20:59.961559 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa3238-2962-43e1-bdc8-b7d4cc43307d None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:59.961844 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa3238-2962-43e1-bdc8-b7d4cc43307d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:59.962332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa3238-2962-43e1-bdc8-b7d4cc43307d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:59.987082 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-3ffa3238-2962-43e1-bdc8-b7d4cc43307d None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:59.988324 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3ffa3238-2962-43e1-bdc8-b7d4cc43307d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:00.051828 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1376/2701] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:21:00.060157 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411d3ea-f769-4e6d-87c1-776aa67ca6f1 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:00.060453 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411d3ea-f769-4e6d-87c1-776aa67ca6f1 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:00.060736 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411d3ea-f769-4e6d-87c1-776aa67ca6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:00.080556 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-e411d3ea-f769-4e6d-87c1-776aa67ca6f1 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:21:00.081801 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-e411d3ea-f769-4e6d-87c1-776aa67ca6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:00.090515 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1326/2702] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:21:00.095466 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa3238-2962-43e1-bdc8-b7d4cc43307d None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:00.109321 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa3238-2962-43e1-bdc8-b7d4cc43307d None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:00.114853 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16871ccf-efcf-407c-94ee-390288e0e987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:00.115867 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16871ccf-efcf-407c-94ee-390288e0e987 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:00.116149 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16871ccf-efcf-407c-94ee-390288e0e987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:00.116426 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16871ccf-efcf-407c-94ee-390288e0e987 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:00.117111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16871ccf-efcf-407c-94ee-390288e0e987 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:21:00.117417 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16871ccf-efcf-407c-94ee-390288e0e987 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:00.119011 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16871ccf-efcf-407c-94ee-390288e0e987 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:00.134428 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1377/2703] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:21:00.139053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411d3ea-f769-4e6d-87c1-776aa67ca6f1 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:00.149357 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411d3ea-f769-4e6d-87c1-776aa67ca6f1 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:00.155560 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0873461-65e2-4b39-8948-366fee96ad4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:00.156183 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0873461-65e2-4b39-8948-366fee96ad4b admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:00.156462 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0873461-65e2-4b39-8948-366fee96ad4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:00.156732 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0873461-65e2-4b39-8948-366fee96ad4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:00.157395 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0873461-65e2-4b39-8948-366fee96ad4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:00.159416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0873461-65e2-4b39-8948-366fee96ad4b admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:00.192492 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1327/2704] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:21:00 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:21:00.197041 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16871ccf-efcf-407c-94ee-390288e0e987 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:00.208668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16871ccf-efcf-407c-94ee-390288e0e987 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:00.263507 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:21:00.284070 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44740e10-701a-450f-99a3-4bc7044564ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:00.284833 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44740e10-701a-450f-99a3-4bc7044564ba admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:00.285119 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44740e10-701a-450f-99a3-4bc7044564ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:00.285392 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44740e10-701a-450f-99a3-4bc7044564ba admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:00.286070 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44740e10-701a-450f-99a3-4bc7044564ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:00.288081 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44740e10-701a-450f-99a3-4bc7044564ba admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:00.315262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1378/2705] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:21:00 2022] POST /identity/v3/users => generated 285 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:21:00.316634 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0873461-65e2-4b39-8948-366fee96ad4b admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:00.327694 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0873461-65e2-4b39-8948-366fee96ad4b admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:00.332520 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbd439-e5c5-45a1-b5ee-00873503f7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:00.333129 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbd439-e5c5-45a1-b5ee-00873503f7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:00.333425 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbd439-e5c5-45a1-b5ee-00873503f7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:00.333682 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbd439-e5c5-45a1-b5ee-00873503f7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:00.334865 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbd439-e5c5-45a1-b5ee-00873503f7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:00.336579 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbd439-e5c5-45a1-b5ee-00873503f7c4 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:00.347587 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1328/2706] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:21:00.351597 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44740e10-701a-450f-99a3-4bc7044564ba admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:00.362450 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44740e10-701a-450f-99a3-4bc7044564ba admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:00.367142 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c772bdf-0b5c-4b1f-917c-b0b46e5739c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:00.367877 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c772bdf-0b5c-4b1f-917c-b0b46e5739c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:00.368223 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c772bdf-0b5c-4b1f-917c-b0b46e5739c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:00.368568 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c772bdf-0b5c-4b1f-917c-b0b46e5739c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:00.369279 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c772bdf-0b5c-4b1f-917c-b0b46e5739c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:00.371358 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c772bdf-0b5c-4b1f-917c-b0b46e5739c5 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:00.382935 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1379/2707] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:21:00.387672 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbd439-e5c5-45a1-b5ee-00873503f7c4 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:00.398060 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbd439-e5c5-45a1-b5ee-00873503f7c4 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:00.403499 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63738021-5308-4274-81d7-b7e4570a14b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:00.404161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63738021-5308-4274-81d7-b7e4570a14b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:00.404502 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63738021-5308-4274-81d7-b7e4570a14b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:00.404710 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63738021-5308-4274-81d7-b7e4570a14b3 admin admin] PATH_INFO: `/v3/projects/4d5a45df04de40ab9ef507ff64107222/users/69374499d3d74436afa18af29a62c24a/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:00.419796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63738021-5308-4274-81d7-b7e4570a14b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d5a45df04de40ab9ef507ff64107222, user_id=69374499d3d74436afa18af29a62c24a, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:00.422582 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63738021-5308-4274-81d7-b7e4570a14b3 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:00.437434 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1329/2708] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:21:00 2022] PUT /identity/v3/projects/4d5a45df04de40ab9ef507ff64107222/users/69374499d3d74436afa18af29a62c24a/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:21:00.448105 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d9843-8a11-4b23-af8a-3ac62892cf81 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:00.448386 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d9843-8a11-4b23-af8a-3ac62892cf81 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:00.448658 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d9843-8a11-4b23-af8a-3ac62892cf81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:00.478320 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-db5d9843-8a11-4b23-af8a-3ac62892cf81 None None] MFA Rules not processed for user `69374499d3d74436afa18af29a62c24a`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:21:00.479624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-db5d9843-8a11-4b23-af8a-3ac62892cf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:00.546922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1380/2709] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:21:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:21:00.559274 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63738021-5308-4274-81d7-b7e4570a14b3 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:00.561110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-63738021-5308-4274-81d7-b7e4570a14b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:00.581994 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:21:00.624982 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63738021-5308-4274-81d7-b7e4570a14b3 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:00.628678 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee97f5-4240-4a88-bf11-529fcb4f5534 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9180b1616c524905b86769a9eb8f7757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:00.629290 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee97f5-4240-4a88-bf11-529fcb4f5534 service glance] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:00.629573 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee97f5-4240-4a88-bf11-529fcb4f5534 service glance] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:00.629848 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee97f5-4240-4a88-bf11-529fcb4f5534 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:00.638365 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee97f5-4240-4a88-bf11-529fcb4f5534 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:00.639841 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee97f5-4240-4a88-bf11-529fcb4f5534 service glance] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:00.648592 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1330/2710] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:21:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:21:10.543951 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=46,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:21:10.644647 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=18 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:21:22.167565 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d9843-8a11-4b23-af8a-3ac62892cf81 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:22.230912 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d9843-8a11-4b23-af8a-3ac62892cf81 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:22.235454 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25320c55-bdf1-4385-ba86-8154e739d102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:22.236084 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25320c55-bdf1-4385-ba86-8154e739d102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:22.236360 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25320c55-bdf1-4385-ba86-8154e739d102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:22.236628 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25320c55-bdf1-4385-ba86-8154e739d102 admin admin] PATH_INFO: `/v3/users/69374499d3d74436afa18af29a62c24a` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:22.237776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25320c55-bdf1-4385-ba86-8154e739d102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69374499d3d74436afa18af29a62c24a)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:22.239694 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25320c55-bdf1-4385-ba86-8154e739d102 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:22.287686 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-25320c55-bdf1-4385-ba86-8154e739d102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69374499d3d74436afa18af29a62c24a'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:22.288383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-25320c55-bdf1-4385-ba86-8154e739d102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69374499d3d74436afa18af29a62c24a'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:22.295708 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-25320c55-bdf1-4385-ba86-8154e739d102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69374499d3d74436afa18af29a62c24a'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:22.303418 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-25320c55-bdf1-4385-ba86-8154e739d102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69374499d3d74436afa18af29a62c24a'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:22.304077 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-25320c55-bdf1-4385-ba86-8154e739d102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69374499d3d74436afa18af29a62c24a'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:22.322441 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1381/2711] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:21:22 2022] DELETE /identity/v3/users/69374499d3d74436afa18af29a62c24a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:21:22.327466 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7532a-5066-4137-80a6-4d0f5b005f9c None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:22.327952 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7532a-5066-4137-80a6-4d0f5b005f9c None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:22.328061 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7532a-5066-4137-80a6-4d0f5b005f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:22.346864 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-bab7532a-5066-4137-80a6-4d0f5b005f9c None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:21:22.348150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-bab7532a-5066-4137-80a6-4d0f5b005f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:22.407320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1331/2712] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:21:22.416951 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25320c55-bdf1-4385-ba86-8154e739d102 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:22.418337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-25320c55-bdf1-4385-ba86-8154e739d102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:22.476935 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25320c55-bdf1-4385-ba86-8154e739d102 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:22.480543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d91bf4-2f4d-4cf1-91ab-37610e882685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:22.481141 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d91bf4-2f4d-4cf1-91ab-37610e882685 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:22.481415 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d91bf4-2f4d-4cf1-91ab-37610e882685 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:22.481681 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d91bf4-2f4d-4cf1-91ab-37610e882685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:22.490459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d91bf4-2f4d-4cf1-91ab-37610e882685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:22.491913 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d91bf4-2f4d-4cf1-91ab-37610e882685 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:22.501869 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1382/2713] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:21:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:21:22.831624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7532a-5066-4137-80a6-4d0f5b005f9c None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:22.833118 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-bab7532a-5066-4137-80a6-4d0f5b005f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:22.846339 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7532a-5066-4137-80a6-4d0f5b005f9c None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:22.857543 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073b5e4-0ebb-4d88-8da8-c0e65a2d385d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:22.859414 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073b5e4-0ebb-4d88-8da8-c0e65a2d385d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:22.859876 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073b5e4-0ebb-4d88-8da8-c0e65a2d385d admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:22.860310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073b5e4-0ebb-4d88-8da8-c0e65a2d385d admin admin] PATH_INFO: `/v3/projects/4d5a45df04de40ab9ef507ff64107222` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:22.861678 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073b5e4-0ebb-4d88-8da8-c0e65a2d385d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d5a45df04de40ab9ef507ff64107222)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:22.864583 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073b5e4-0ebb-4d88-8da8-c0e65a2d385d admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:22.916747 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-2073b5e4-0ebb-4d88-8da8-c0e65a2d385d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d5a45df04de40ab9ef507ff64107222', 'request_id': 'req-2073b5e4-0ebb-4d88-8da8-c0e65a2d385d'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:22.924515 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-2073b5e4-0ebb-4d88-8da8-c0e65a2d385d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d5a45df04de40ab9ef507ff64107222', 'request_id': 'req-2073b5e4-0ebb-4d88-8da8-c0e65a2d385d'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:22.935202 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-2073b5e4-0ebb-4d88-8da8-c0e65a2d385d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d5a45df04de40ab9ef507ff64107222', 'request_id': 'req-2073b5e4-0ebb-4d88-8da8-c0e65a2d385d'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:22.949723 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-2073b5e4-0ebb-4d88-8da8-c0e65a2d385d admin admin] The token cache is being invalidate because project 4d5a45df04de40ab9ef507ff64107222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:21:22.950040 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-2073b5e4-0ebb-4d88-8da8-c0e65a2d385d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:22.950664 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-2073b5e4-0ebb-4d88-8da8-c0e65a2d385d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:22.952485 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1332/2714] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:21:22 2022] DELETE /identity/v3/projects/4d5a45df04de40ab9ef507ff64107222 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:21:22.957051 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa841d2-1b4f-4d05-8a0a-33d8133d8533 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:22.957340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa841d2-1b4f-4d05-8a0a-33d8133d8533 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:22.957614 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa841d2-1b4f-4d05-8a0a-33d8133d8533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:22.979119 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-9fa841d2-1b4f-4d05-8a0a-33d8133d8533 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:21:22.980396 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9fa841d2-1b4f-4d05-8a0a-33d8133d8533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:23.000776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:21:23.047604 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1383/2715] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:21:23.056243 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d7d60-38ab-4f83-ae0d-200c4798eedc None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:23.056505 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d7d60-38ab-4f83-ae0d-200c4798eedc None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:23.056783 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d7d60-38ab-4f83-ae0d-200c4798eedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:23.077268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-0c7d7d60-38ab-4f83-ae0d-200c4798eedc None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:21:23.078476 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-0c7d7d60-38ab-4f83-ae0d-200c4798eedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:23.086287 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1333/2716] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:21:23.090520 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa841d2-1b4f-4d05-8a0a-33d8133d8533 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:23.100518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa841d2-1b4f-4d05-8a0a-33d8133d8533 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:23.105032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e19735-5b2f-4792-a2be-95b666f256e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:23.105625 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e19735-5b2f-4792-a2be-95b666f256e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:23.105902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e19735-5b2f-4792-a2be-95b666f256e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:23.106169 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e19735-5b2f-4792-a2be-95b666f256e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:23.106812 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e19735-5b2f-4792-a2be-95b666f256e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:21:23.107112 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e19735-5b2f-4792-a2be-95b666f256e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:23.109352 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e19735-5b2f-4792-a2be-95b666f256e7 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:23.121657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1384/2717] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:21:23.125966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d7d60-38ab-4f83-ae0d-200c4798eedc None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:23.140655 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d7d60-38ab-4f83-ae0d-200c4798eedc None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:23.145915 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a64b0-d2f8-4e66-8bcb-dc3f81320f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:23.146521 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a64b0-d2f8-4e66-8bcb-dc3f81320f57 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:23.146794 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a64b0-d2f8-4e66-8bcb-dc3f81320f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:23.147058 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a64b0-d2f8-4e66-8bcb-dc3f81320f57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:23.147738 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a64b0-d2f8-4e66-8bcb-dc3f81320f57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:23.149742 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a64b0-d2f8-4e66-8bcb-dc3f81320f57 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:23.178522 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1334/2718] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:21:23 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:21:23.182490 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e19735-5b2f-4792-a2be-95b666f256e7 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:23.193307 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e19735-5b2f-4792-a2be-95b666f256e7 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:23.254922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715d8a4-fa17-47ba-9675-e879a122fb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:23.255568 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715d8a4-fa17-47ba-9675-e879a122fb72 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:23.255838 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715d8a4-fa17-47ba-9675-e879a122fb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:23.256107 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715d8a4-fa17-47ba-9675-e879a122fb72 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:23.256745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715d8a4-fa17-47ba-9675-e879a122fb72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:23.258633 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715d8a4-fa17-47ba-9675-e879a122fb72 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:23.280485 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1385/2719] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:21:23 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:21:23.284394 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a64b0-d2f8-4e66-8bcb-dc3f81320f57 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:23.294843 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a64b0-d2f8-4e66-8bcb-dc3f81320f57 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:23.300044 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf94917-7c67-4fd9-81e9-2f4944ec5112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:23.300644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf94917-7c67-4fd9-81e9-2f4944ec5112 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:23.300922 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf94917-7c67-4fd9-81e9-2f4944ec5112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:23.301192 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf94917-7c67-4fd9-81e9-2f4944ec5112 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:23.301830 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf94917-7c67-4fd9-81e9-2f4944ec5112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:23.303525 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf94917-7c67-4fd9-81e9-2f4944ec5112 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:23.314165 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1335/2720] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:21:23.318102 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715d8a4-fa17-47ba-9675-e879a122fb72 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:23.328356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715d8a4-fa17-47ba-9675-e879a122fb72 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:23.332990 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd154e-c0e7-40eb-bb8c-e0a3ffc9306a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:23.333740 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd154e-c0e7-40eb-bb8c-e0a3ffc9306a admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:23.333869 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd154e-c0e7-40eb-bb8c-e0a3ffc9306a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:23.334138 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd154e-c0e7-40eb-bb8c-e0a3ffc9306a admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:23.334776 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd154e-c0e7-40eb-bb8c-e0a3ffc9306a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:23.336416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd154e-c0e7-40eb-bb8c-e0a3ffc9306a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:23.347892 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1386/2721] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:21:23.352096 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf94917-7c67-4fd9-81e9-2f4944ec5112 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:23.362742 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf94917-7c67-4fd9-81e9-2f4944ec5112 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:23.367598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306549c-1d12-4e05-805b-50ee81370ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:23.368246 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306549c-1d12-4e05-805b-50ee81370ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:23.368521 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306549c-1d12-4e05-805b-50ee81370ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:23.368792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306549c-1d12-4e05-805b-50ee81370ce0 admin admin] PATH_INFO: `/v3/projects/b2d1bcae4ed14b2c9913466802324c02/users/cd494b6a71f84346a5a98fd290637ccf/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:23.385190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306549c-1d12-4e05-805b-50ee81370ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d1bcae4ed14b2c9913466802324c02, user_id=cd494b6a71f84346a5a98fd290637ccf, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:23.388234 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306549c-1d12-4e05-805b-50ee81370ce0 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:23.405570 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1336/2722] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:21:23 2022] PUT /identity/v3/projects/b2d1bcae4ed14b2c9913466802324c02/users/cd494b6a71f84346a5a98fd290637ccf/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:21:23.415868 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cf9a1-a245-4be4-8184-87f8f0db78a7 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:23.416154 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cf9a1-a245-4be4-8184-87f8f0db78a7 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:23.416428 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cf9a1-a245-4be4-8184-87f8f0db78a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:23.447338 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-718cf9a1-a245-4be4-8184-87f8f0db78a7 None None] MFA Rules not processed for user `cd494b6a71f84346a5a98fd290637ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:21:23.448733 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-718cf9a1-a245-4be4-8184-87f8f0db78a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:23.531211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306549c-1d12-4e05-805b-50ee81370ce0 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:23.533305 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-f306549c-1d12-4e05-805b-50ee81370ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:23.545370 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1387/2723] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:21:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:21:23.556595 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cf9a1-a245-4be4-8184-87f8f0db78a7 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:23.557994 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-718cf9a1-a245-4be4-8184-87f8f0db78a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:23.582991 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:21:23.590909 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:21:23.647235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cf9a1-a245-4be4-8184-87f8f0db78a7 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:23.651400 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb15853-2222-4d9d-a755-1d97028e2660 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:23.652153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb15853-2222-4d9d-a755-1d97028e2660 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:23.652437 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb15853-2222-4d9d-a755-1d97028e2660 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:23.652713 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb15853-2222-4d9d-a755-1d97028e2660 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:23.663310 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb15853-2222-4d9d-a755-1d97028e2660 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:23.665057 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb15853-2222-4d9d-a755-1d97028e2660 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:23.676007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306549c-1d12-4e05-805b-50ee81370ce0 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:23.676595 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1388/2724] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:21:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:21:23.681310 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc1560-7203-4ce8-b0d4-2f21af5ddf46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:23.682029 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc1560-7203-4ce8-b0d4-2f21af5ddf46 service nova] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:23.682410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc1560-7203-4ce8-b0d4-2f21af5ddf46 service nova] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:23.682794 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc1560-7203-4ce8-b0d4-2f21af5ddf46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:23.684764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-60fc1560-7203-4ce8-b0d4-2f21af5ddf46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:23.709819 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc1560-7203-4ce8-b0d4-2f21af5ddf46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:23.712083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc1560-7203-4ce8-b0d4-2f21af5ddf46 service nova] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:23.738625 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1337/2725] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:21:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:21:27.599890 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb15853-2222-4d9d-a755-1d97028e2660 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:27.601320 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-1fb15853-2222-4d9d-a755-1d97028e2660 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:27.657229 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb15853-2222-4d9d-a755-1d97028e2660 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:27.660817 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c9641-2876-481b-9dd8-c412ee0e3935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:27.661408 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c9641-2876-481b-9dd8-c412ee0e3935 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:27.661689 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c9641-2876-481b-9dd8-c412ee0e3935 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:27.661962 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c9641-2876-481b-9dd8-c412ee0e3935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:27.663676 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-170c9641-2876-481b-9dd8-c412ee0e3935 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:27.726672 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c9641-2876-481b-9dd8-c412ee0e3935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:27.728133 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c9641-2876-481b-9dd8-c412ee0e3935 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:27.738449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1389/2726] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:21:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:21:30.900484 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc1560-7203-4ce8-b0d4-2f21af5ddf46 service nova] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:30.901937 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-60fc1560-7203-4ce8-b0d4-2f21af5ddf46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:30.923656 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc1560-7203-4ce8-b0d4-2f21af5ddf46 service nova] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:30.928448 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62d3f8-05de-4a29-802d-35a4ef7e2d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:30.929298 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62d3f8-05de-4a29-802d-35a4ef7e2d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:30.929786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62d3f8-05de-4a29-802d-35a4ef7e2d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:30.930060 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62d3f8-05de-4a29-802d-35a4ef7e2d2f admin admin] PATH_INFO: `/v3/users/bb71e0c02b4647b28ed6a6194d270d35` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:30.931182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62d3f8-05de-4a29-802d-35a4ef7e2d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb71e0c02b4647b28ed6a6194d270d35)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:30.933112 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62d3f8-05de-4a29-802d-35a4ef7e2d2f admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:30.991402 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-ff62d3f8-05de-4a29-802d-35a4ef7e2d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb71e0c02b4647b28ed6a6194d270d35'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:31.004879 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-ff62d3f8-05de-4a29-802d-35a4ef7e2d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb71e0c02b4647b28ed6a6194d270d35'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:31.005569 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-ff62d3f8-05de-4a29-802d-35a4ef7e2d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb71e0c02b4647b28ed6a6194d270d35'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:31.013369 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-ff62d3f8-05de-4a29-802d-35a4ef7e2d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb71e0c02b4647b28ed6a6194d270d35'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:31.021785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-ff62d3f8-05de-4a29-802d-35a4ef7e2d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb71e0c02b4647b28ed6a6194d270d35'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:31.027705 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1338/2727] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:21:30 2022] DELETE /identity/v3/users/bb71e0c02b4647b28ed6a6194d270d35 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:21:31.194470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c9641-2876-481b-9dd8-c412ee0e3935 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:31.205116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c9641-2876-481b-9dd8-c412ee0e3935 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:31.266584 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a53323-48ca-4811-8ffc-71fbf7d4474b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:31.267205 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a53323-48ca-4811-8ffc-71fbf7d4474b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:31.267513 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a53323-48ca-4811-8ffc-71fbf7d4474b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:31.267780 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a53323-48ca-4811-8ffc-71fbf7d4474b admin admin] PATH_INFO: `/v3/projects/d16d1fb16c3e47ba973826cced4ff0dd` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:31.268906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a53323-48ca-4811-8ffc-71fbf7d4474b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d16d1fb16c3e47ba973826cced4ff0dd)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:31.270759 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a53323-48ca-4811-8ffc-71fbf7d4474b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:31.282704 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:21:31.317542 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-99a53323-48ca-4811-8ffc-71fbf7d4474b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd16d1fb16c3e47ba973826cced4ff0dd', 'request_id': 'req-99a53323-48ca-4811-8ffc-71fbf7d4474b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:31.323048 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-99a53323-48ca-4811-8ffc-71fbf7d4474b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd16d1fb16c3e47ba973826cced4ff0dd', 'request_id': 'req-99a53323-48ca-4811-8ffc-71fbf7d4474b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:31.329281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-99a53323-48ca-4811-8ffc-71fbf7d4474b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd16d1fb16c3e47ba973826cced4ff0dd', 'request_id': 'req-99a53323-48ca-4811-8ffc-71fbf7d4474b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:31.343180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-99a53323-48ca-4811-8ffc-71fbf7d4474b admin admin] The token cache is being invalidate because project d16d1fb16c3e47ba973826cced4ff0dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:21:31.343490 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-99a53323-48ca-4811-8ffc-71fbf7d4474b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:31.344119 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-99a53323-48ca-4811-8ffc-71fbf7d4474b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:31.345609 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1390/2728] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:21:31 2022] DELETE /identity/v3/projects/d16d1fb16c3e47ba973826cced4ff0dd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:21:31.350497 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0303e-f408-46d3-a65a-03f6278482f3 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:31.350788 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0303e-f408-46d3-a65a-03f6278482f3 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:31.351062 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0303e-f408-46d3-a65a-03f6278482f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:31.371352 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-45e0303e-f408-46d3-a65a-03f6278482f3 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:21:31.372578 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-45e0303e-f408-46d3-a65a-03f6278482f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:31.432269 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1339/2729] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:21:31.440880 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d37b4-22c3-482a-858b-a3baaf0ef98b None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:31.441165 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d37b4-22c3-482a-858b-a3baaf0ef98b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:31.441471 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d37b4-22c3-482a-858b-a3baaf0ef98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:31.464755 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-9c5d37b4-22c3-482a-858b-a3baaf0ef98b None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:21:31.465975 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9c5d37b4-22c3-482a-858b-a3baaf0ef98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:31.475257 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1391/2730] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:21:31.479920 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0303e-f408-46d3-a65a-03f6278482f3 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:31.491139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0303e-f408-46d3-a65a-03f6278482f3 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:31.496830 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bf04a-f1b7-411b-af9a-d2b37d906ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:31.497469 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bf04a-f1b7-411b-af9a-d2b37d906ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:31.497756 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bf04a-f1b7-411b-af9a-d2b37d906ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:31.498151 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bf04a-f1b7-411b-af9a-d2b37d906ac7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:31.499051 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bf04a-f1b7-411b-af9a-d2b37d906ac7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:21:31.499450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bf04a-f1b7-411b-af9a-d2b37d906ac7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:31.504002 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bf04a-f1b7-411b-af9a-d2b37d906ac7 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:31.520268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1340/2731] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:21:31.521605 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d37b4-22c3-482a-858b-a3baaf0ef98b None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:31.532172 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d37b4-22c3-482a-858b-a3baaf0ef98b None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:31.537163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af8c28-d389-4e8f-8772-7fd60e015e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:31.537895 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af8c28-d389-4e8f-8772-7fd60e015e9d admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:31.538200 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af8c28-d389-4e8f-8772-7fd60e015e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:31.538439 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af8c28-d389-4e8f-8772-7fd60e015e9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:31.539189 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af8c28-d389-4e8f-8772-7fd60e015e9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:31.541028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af8c28-d389-4e8f-8772-7fd60e015e9d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:31.569222 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1392/2732] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:21:31 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:21:31.573372 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bf04a-f1b7-411b-af9a-d2b37d906ac7 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:31.580039 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:21:31.584293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bf04a-f1b7-411b-af9a-d2b37d906ac7 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:31.644847 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e3524-fcc5-4375-9f20-a5727aca3d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:31.645450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e3524-fcc5-4375-9f20-a5727aca3d33 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:31.645728 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e3524-fcc5-4375-9f20-a5727aca3d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:31.645998 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e3524-fcc5-4375-9f20-a5727aca3d33 admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:31.646636 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e3524-fcc5-4375-9f20-a5727aca3d33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:31.648807 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e3524-fcc5-4375-9f20-a5727aca3d33 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:31.670664 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1341/2733] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:21:31 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:21:31.675019 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af8c28-d389-4e8f-8772-7fd60e015e9d admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:31.685653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af8c28-d389-4e8f-8772-7fd60e015e9d admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:31.690344 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023529d-3cf0-4812-940d-403d0610b602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:31.690933 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023529d-3cf0-4812-940d-403d0610b602 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:31.691209 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023529d-3cf0-4812-940d-403d0610b602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:31.691601 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023529d-3cf0-4812-940d-403d0610b602 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:31.692246 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023529d-3cf0-4812-940d-403d0610b602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:31.693821 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023529d-3cf0-4812-940d-403d0610b602 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:31.704430 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1393/2734] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:21:31.708346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e3524-fcc5-4375-9f20-a5727aca3d33 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:31.719374 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e3524-fcc5-4375-9f20-a5727aca3d33 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:31.724233 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1b2c3-5069-454d-898d-2f1e7d29700a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:31.724856 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1b2c3-5069-454d-898d-2f1e7d29700a admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:31.725114 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1b2c3-5069-454d-898d-2f1e7d29700a admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:31.725435 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1b2c3-5069-454d-898d-2f1e7d29700a admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:31.726023 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1b2c3-5069-454d-898d-2f1e7d29700a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:31.727651 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1b2c3-5069-454d-898d-2f1e7d29700a admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:31.739037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1342/2735] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:21:31.743379 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023529d-3cf0-4812-940d-403d0610b602 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:31.753828 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023529d-3cf0-4812-940d-403d0610b602 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:31.758318 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab5884-896d-4a24-adef-52c4dd014c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:31.758964 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab5884-896d-4a24-adef-52c4dd014c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:31.759275 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab5884-896d-4a24-adef-52c4dd014c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:31.759581 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab5884-896d-4a24-adef-52c4dd014c77 admin admin] PATH_INFO: `/v3/projects/ef0ec4b9454f4260bcad73c8742fc744/users/f0c3129e985c4f94b8c749c8b7401cb5/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:31.774195 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ab5884-896d-4a24-adef-52c4dd014c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef0ec4b9454f4260bcad73c8742fc744, user_id=f0c3129e985c4f94b8c749c8b7401cb5, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:31.776863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ab5884-896d-4a24-adef-52c4dd014c77 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:31.789363 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1394/2736] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:21:31 2022] PUT /identity/v3/projects/ef0ec4b9454f4260bcad73c8742fc744/users/f0c3129e985c4f94b8c749c8b7401cb5/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:21:31.794288 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fdf2c-b175-4148-9ef1-83752a7169b8 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:31.794576 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fdf2c-b175-4148-9ef1-83752a7169b8 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:31.794846 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fdf2c-b175-4148-9ef1-83752a7169b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:31.813740 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-616fdf2c-b175-4148-9ef1-83752a7169b8 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:21:31.814945 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-616fdf2c-b175-4148-9ef1-83752a7169b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:31.877371 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1343/2737] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:21:31.886982 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab5884-896d-4a24-adef-52c4dd014c77 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:31.888680 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c0ab5884-896d-4a24-adef-52c4dd014c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:31.944872 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab5884-896d-4a24-adef-52c4dd014c77 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:31.948492 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582f887-8f06-486b-9d9d-829830d4e46e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:31.949092 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582f887-8f06-486b-9d9d-829830d4e46e service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:31.949366 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582f887-8f06-486b-9d9d-829830d4e46e service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:31.949629 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582f887-8f06-486b-9d9d-829830d4e46e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:31.958926 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582f887-8f06-486b-9d9d-829830d4e46e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:31.960490 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582f887-8f06-486b-9d9d-829830d4e46e service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:31.970616 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1395/2738] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:21:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:21:33.736772 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fdf2c-b175-4148-9ef1-83752a7169b8 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:33.738332 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-616fdf2c-b175-4148-9ef1-83752a7169b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:33.751973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fdf2c-b175-4148-9ef1-83752a7169b8 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:33.756739 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90221f28-1911-4c8b-a68a-7a7fdb727c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:33.757447 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90221f28-1911-4c8b-a68a-7a7fdb727c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:33.757793 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90221f28-1911-4c8b-a68a-7a7fdb727c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:33.758126 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90221f28-1911-4c8b-a68a-7a7fdb727c32 admin admin] PATH_INFO: `/v3/users/cd494b6a71f84346a5a98fd290637ccf` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:33.759305 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90221f28-1911-4c8b-a68a-7a7fdb727c32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd494b6a71f84346a5a98fd290637ccf)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:33.761323 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90221f28-1911-4c8b-a68a-7a7fdb727c32 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:33.813220 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-90221f28-1911-4c8b-a68a-7a7fdb727c32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd494b6a71f84346a5a98fd290637ccf'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:33.825807 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-90221f28-1911-4c8b-a68a-7a7fdb727c32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd494b6a71f84346a5a98fd290637ccf'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:33.827180 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-90221f28-1911-4c8b-a68a-7a7fdb727c32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd494b6a71f84346a5a98fd290637ccf'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:33.836368 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-90221f28-1911-4c8b-a68a-7a7fdb727c32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd494b6a71f84346a5a98fd290637ccf'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:33.842148 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:21:33.844315 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-90221f28-1911-4c8b-a68a-7a7fdb727c32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd494b6a71f84346a5a98fd290637ccf'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:33.852764 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1344/2739] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:21:33 2022] DELETE /identity/v3/users/cd494b6a71f84346a5a98fd290637ccf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:21:33.857544 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930d23d-735e-47e8-b363-d5668254c82e None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:33.858033 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930d23d-735e-47e8-b363-d5668254c82e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:33.858033 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930d23d-735e-47e8-b363-d5668254c82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:33.891485 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-8930d23d-735e-47e8-b363-d5668254c82e None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:21:33.892759 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8930d23d-735e-47e8-b363-d5668254c82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:33.928007 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:21:33.957000 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1396/2740] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:21:33.968777 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90221f28-1911-4c8b-a68a-7a7fdb727c32 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:33.970744 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-90221f28-1911-4c8b-a68a-7a7fdb727c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:34.038943 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90221f28-1911-4c8b-a68a-7a7fdb727c32 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:34.042938 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e7fd2-c737-4a56-9034-15a211fd298b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:34.043599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e7fd2-c737-4a56-9034-15a211fd298b service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:34.043890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e7fd2-c737-4a56-9034-15a211fd298b service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:34.044168 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e7fd2-c737-4a56-9034-15a211fd298b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:34.054991 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e7fd2-c737-4a56-9034-15a211fd298b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:34.056507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e7fd2-c737-4a56-9034-15a211fd298b service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:34.067983 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1345/2741] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:21:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:21:34.471564 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930d23d-735e-47e8-b363-d5668254c82e None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:34.473626 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8930d23d-735e-47e8-b363-d5668254c82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:34.500238 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930d23d-735e-47e8-b363-d5668254c82e None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:34.505065 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b366c8b-7d8e-41ad-a5b4-4b671da77e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:34.505749 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b366c8b-7d8e-41ad-a5b4-4b671da77e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:34.506027 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b366c8b-7d8e-41ad-a5b4-4b671da77e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:34.506304 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b366c8b-7d8e-41ad-a5b4-4b671da77e93 admin admin] PATH_INFO: `/v3/projects/b2d1bcae4ed14b2c9913466802324c02` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:34.507461 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b366c8b-7d8e-41ad-a5b4-4b671da77e93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2d1bcae4ed14b2c9913466802324c02)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:34.512449 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b366c8b-7d8e-41ad-a5b4-4b671da77e93 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:34.589378 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7b366c8b-7d8e-41ad-a5b4-4b671da77e93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2d1bcae4ed14b2c9913466802324c02', 'request_id': 'req-7b366c8b-7d8e-41ad-a5b4-4b671da77e93'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:34.597333 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7b366c8b-7d8e-41ad-a5b4-4b671da77e93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2d1bcae4ed14b2c9913466802324c02', 'request_id': 'req-7b366c8b-7d8e-41ad-a5b4-4b671da77e93'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:34.605729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7b366c8b-7d8e-41ad-a5b4-4b671da77e93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2d1bcae4ed14b2c9913466802324c02', 'request_id': 'req-7b366c8b-7d8e-41ad-a5b4-4b671da77e93'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:34.625241 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7b366c8b-7d8e-41ad-a5b4-4b671da77e93 admin admin] The token cache is being invalidate because project b2d1bcae4ed14b2c9913466802324c02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:21:34.625536 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7b366c8b-7d8e-41ad-a5b4-4b671da77e93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:34.626433 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7b366c8b-7d8e-41ad-a5b4-4b671da77e93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:21:34.628253 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1397/2742] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:21:34 2022] DELETE /identity/v3/projects/b2d1bcae4ed14b2c9913466802324c02 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:21:34.632968 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dccf2-d882-4229-b985-27068eeee795 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:34.633225 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dccf2-d882-4229-b985-27068eeee795 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:34.634886 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dccf2-d882-4229-b985-27068eeee795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:34.658081 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-9b0dccf2-d882-4229-b985-27068eeee795 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:21:34.659790 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-9b0dccf2-d882-4229-b985-27068eeee795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:34.763630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1346/2743] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:21:34.766229 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf036bb-d315-46a3-998e-b3e7336a21f5 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:34.766516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf036bb-d315-46a3-998e-b3e7336a21f5 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:34.766903 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf036bb-d315-46a3-998e-b3e7336a21f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:34.788437 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-baf036bb-d315-46a3-998e-b3e7336a21f5 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:21:34.789737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-baf036bb-d315-46a3-998e-b3e7336a21f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:34.799019 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1398/2744] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:21:34.803019 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dccf2-d882-4229-b985-27068eeee795 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:34.813463 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dccf2-d882-4229-b985-27068eeee795 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:34.818488 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e3864-b367-40ca-bf8a-5297261dcf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:34.819186 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e3864-b367-40ca-bf8a-5297261dcf56 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:34.819543 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e3864-b367-40ca-bf8a-5297261dcf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:34.819821 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e3864-b367-40ca-bf8a-5297261dcf56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:34.820478 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e3864-b367-40ca-bf8a-5297261dcf56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:21:34.820783 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e3864-b367-40ca-bf8a-5297261dcf56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:34.822455 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e3864-b367-40ca-bf8a-5297261dcf56 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:34.834912 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1347/2745] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:21:34.839054 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf036bb-d315-46a3-998e-b3e7336a21f5 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:34.850737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf036bb-d315-46a3-998e-b3e7336a21f5 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:34.856741 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee7d1c-c255-4012-9405-096694666ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:34.857431 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee7d1c-c255-4012-9405-096694666ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:34.858337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee7d1c-c255-4012-9405-096694666ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:34.858932 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee7d1c-c255-4012-9405-096694666ee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:34.859590 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee7d1c-c255-4012-9405-096694666ee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:34.861629 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee7d1c-c255-4012-9405-096694666ee8 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:34.906483 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e3864-b367-40ca-bf8a-5297261dcf56 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:34.915791 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1399/2746] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:21:34 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:21:34.927565 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e3864-b367-40ca-bf8a-5297261dcf56 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:35.017422 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6601e-a8e9-4873-b7c0-d1edfd18bbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:35.018069 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6601e-a8e9-4873-b7c0-d1edfd18bbbc admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:35.018916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6601e-a8e9-4873-b7c0-d1edfd18bbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:35.018916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6601e-a8e9-4873-b7c0-d1edfd18bbbc admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:35.019323 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6601e-a8e9-4873-b7c0-d1edfd18bbbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:35.021613 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6601e-a8e9-4873-b7c0-d1edfd18bbbc admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:35.047469 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1348/2747] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:21:34 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:21:35.051319 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee7d1c-c255-4012-9405-096694666ee8 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:35.062325 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee7d1c-c255-4012-9405-096694666ee8 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:35.068327 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88720d-da51-48c3-bd97-ffc1ecbc27c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:35.068727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88720d-da51-48c3-bd97-ffc1ecbc27c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:35.069130 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88720d-da51-48c3-bd97-ffc1ecbc27c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:35.069506 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88720d-da51-48c3-bd97-ffc1ecbc27c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:35.070256 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88720d-da51-48c3-bd97-ffc1ecbc27c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:35.071989 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88720d-da51-48c3-bd97-ffc1ecbc27c7 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:35.088131 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1400/2748] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:21:35.088853 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6601e-a8e9-4873-b7c0-d1edfd18bbbc admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:35.099826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6601e-a8e9-4873-b7c0-d1edfd18bbbc admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:35.104695 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586c403-6f07-496b-8a02-6f9d16530940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:35.105410 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586c403-6f07-496b-8a02-6f9d16530940 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:35.105800 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586c403-6f07-496b-8a02-6f9d16530940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:35.106206 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586c403-6f07-496b-8a02-6f9d16530940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:35.106953 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586c403-6f07-496b-8a02-6f9d16530940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:35.109333 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586c403-6f07-496b-8a02-6f9d16530940 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:35.124367 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1349/2749] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:21:35.125569 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88720d-da51-48c3-bd97-ffc1ecbc27c7 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:35.137503 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88720d-da51-48c3-bd97-ffc1ecbc27c7 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:35.142465 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb49c4-f8bf-4bbe-9ea2-6c6141bd8d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:35.143214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb49c4-f8bf-4bbe-9ea2-6c6141bd8d8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:35.143624 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb49c4-f8bf-4bbe-9ea2-6c6141bd8d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:35.144023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb49c4-f8bf-4bbe-9ea2-6c6141bd8d8b admin admin] PATH_INFO: `/v3/projects/6efb31fc7dc64b3eaf580ec6301e4346/users/0b5326f31314429fb695f274cf73bd6c/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:35.165353 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb49c4-f8bf-4bbe-9ea2-6c6141bd8d8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6efb31fc7dc64b3eaf580ec6301e4346, user_id=0b5326f31314429fb695f274cf73bd6c, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:35.168223 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb49c4-f8bf-4bbe-9ea2-6c6141bd8d8b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:35.189695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1401/2750] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:21:35 2022] PUT /identity/v3/projects/6efb31fc7dc64b3eaf580ec6301e4346/users/0b5326f31314429fb695f274cf73bd6c/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:21:35.194958 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877d9ba-4036-461f-a535-31261943e188 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:35.195249 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877d9ba-4036-461f-a535-31261943e188 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:35.195568 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877d9ba-4036-461f-a535-31261943e188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:35.205223 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:21:35.219093 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-e877d9ba-4036-461f-a535-31261943e188 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:21:35.220388 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-e877d9ba-4036-461f-a535-31261943e188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:35.293828 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1350/2751] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:21:35.303372 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb49c4-f8bf-4bbe-9ea2-6c6141bd8d8b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:35.305071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9bdb49c4-f8bf-4bbe-9ea2-6c6141bd8d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:35.375096 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb49c4-f8bf-4bbe-9ea2-6c6141bd8d8b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:35.379421 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cfc787-da68-4833-8d98-b7af2e9b62f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:35.380191 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfc787-da68-4833-8d98-b7af2e9b62f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:35.380472 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfc787-da68-4833-8d98-b7af2e9b62f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:35.380751 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfc787-da68-4833-8d98-b7af2e9b62f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:35.391772 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cfc787-da68-4833-8d98-b7af2e9b62f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:35.393212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cfc787-da68-4833-8d98-b7af2e9b62f2 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:35.404322 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1402/2752] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:21:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:21:36.573924 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903adb3f-b877-490c-b1db-0a50d563e490 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:36.574557 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903adb3f-b877-490c-b1db-0a50d563e490 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:36.574557 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903adb3f-b877-490c-b1db-0a50d563e490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:36.617837 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-903adb3f-b877-490c-b1db-0a50d563e490 None None] MFA Rules not processed for user `f0c3129e985c4f94b8c749c8b7401cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:21:36.619349 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-903adb3f-b877-490c-b1db-0a50d563e490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:36.719889 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1351/2753] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:21:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:21:36.733234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cfc787-da68-4833-8d98-b7af2e9b62f2 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:36.743407 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d3cfc787-da68-4833-8d98-b7af2e9b62f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:36.768986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:21:36.876659 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cfc787-da68-4833-8d98-b7af2e9b62f2 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:36.883187 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bda1e-4708-4d07-99e7-024b2a30a9ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:36.883937 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bda1e-4708-4d07-99e7-024b2a30a9ba service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:36.884273 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bda1e-4708-4d07-99e7-024b2a30a9ba service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:36.884608 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bda1e-4708-4d07-99e7-024b2a30a9ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:36.893745 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16bda1e-4708-4d07-99e7-024b2a30a9ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:36.895332 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16bda1e-4708-4d07-99e7-024b2a30a9ba service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:36.906296 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1403/2754] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:21:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:21:40.117087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f7849-3379-4913-aa11-8ddc3bbad9a8 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:40.118412 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f7849-3379-4913-aa11-8ddc3bbad9a8 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:40.118693 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f7849-3379-4913-aa11-8ddc3bbad9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:40.158200 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-9d4f7849-3379-4913-aa11-8ddc3bbad9a8 None None] MFA Rules not processed for user `f0c3129e985c4f94b8c749c8b7401cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:21:40.160274 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-9d4f7849-3379-4913-aa11-8ddc3bbad9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:40.185421 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1352/2755] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:21:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:21:40.999297 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bda1e-4708-4d07-99e7-024b2a30a9ba service nova] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:41.000718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e16bda1e-4708-4d07-99e7-024b2a30a9ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:41.019596 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bda1e-4708-4d07-99e7-024b2a30a9ba service nova] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:41.030959 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac050a9-0517-41f9-a166-39fc29da8528 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:41.032113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac050a9-0517-41f9-a166-39fc29da8528 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:41.032613 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac050a9-0517-41f9-a166-39fc29da8528 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:41.033098 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac050a9-0517-41f9-a166-39fc29da8528 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:41.035758 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9ac050a9-0517-41f9-a166-39fc29da8528 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:41.052377 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac050a9-0517-41f9-a166-39fc29da8528 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:41.054759 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac050a9-0517-41f9-a166-39fc29da8528 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:41.067573 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1404/2756] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:21:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:21:41.584845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59703de3-3aa7-40f2-908c-f8b9047070b6 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:41.587296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59703de3-3aa7-40f2-908c-f8b9047070b6 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:41.591697 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59703de3-3aa7-40f2-908c-f8b9047070b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:41.657578 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-59703de3-3aa7-40f2-908c-f8b9047070b6 None None] MFA Rules not processed for user `0b5326f31314429fb695f274cf73bd6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:21:41.659183 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-59703de3-3aa7-40f2-908c-f8b9047070b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:41.943552 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1353/2757] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:21:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:21:41.948102 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac050a9-0517-41f9-a166-39fc29da8528 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:41.980362 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac050a9-0517-41f9-a166-39fc29da8528 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:41.985762 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ff30c-0eff-48ee-8b9c-650fe625a9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:41.986738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ff30c-0eff-48ee-8b9c-650fe625a9b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:41.987023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ff30c-0eff-48ee-8b9c-650fe625a9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:41.987296 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ff30c-0eff-48ee-8b9c-650fe625a9b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:41.988144 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ff30c-0eff-48ee-8b9c-650fe625a9b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:41.990153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ff30c-0eff-48ee-8b9c-650fe625a9b7 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:42.031356 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1405/2758] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:21:41 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:21:42.035905 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59703de3-3aa7-40f2-908c-f8b9047070b6 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:42.049912 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59703de3-3aa7-40f2-908c-f8b9047070b6 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:42.071399 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=100 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:21:42.122950 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7509f-c617-4b21-9449-d970f19c8617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:42.123629 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7509f-c617-4b21-9449-d970f19c8617 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:42.125054 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7509f-c617-4b21-9449-d970f19c8617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:42.125589 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7509f-c617-4b21-9449-d970f19c8617 admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:42.126795 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7509f-c617-4b21-9449-d970f19c8617 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:42.129358 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7509f-c617-4b21-9449-d970f19c8617 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:42.166018 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1354/2759] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:21:42 2022] POST /identity/v3/users => generated 299 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:21:42.167137 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ff30c-0eff-48ee-8b9c-650fe625a9b7 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:42.180962 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ff30c-0eff-48ee-8b9c-650fe625a9b7 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:42.187875 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c752af8-b308-437b-ab2e-dd023c126d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:42.188657 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c752af8-b308-437b-ab2e-dd023c126d17 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:42.189003 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c752af8-b308-437b-ab2e-dd023c126d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:42.189398 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c752af8-b308-437b-ab2e-dd023c126d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:42.190634 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c752af8-b308-437b-ab2e-dd023c126d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:42.192757 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c752af8-b308-437b-ab2e-dd023c126d17 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:42.210812 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1406/2760] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:21:42.216108 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7509f-c617-4b21-9449-d970f19c8617 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:42.227660 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7509f-c617-4b21-9449-d970f19c8617 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:42.232541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089633f6-0f9d-4856-a296-202f7dea1481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:42.233372 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089633f6-0f9d-4856-a296-202f7dea1481 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:42.233867 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089633f6-0f9d-4856-a296-202f7dea1481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:42.234375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089633f6-0f9d-4856-a296-202f7dea1481 admin admin] PATH_INFO: `/v3/projects/71a396d737974ae99afc35726249b6e0/users/c10a0ba5bd17421a8fc5900b646cd20d/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:42.252940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089633f6-0f9d-4856-a296-202f7dea1481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71a396d737974ae99afc35726249b6e0, user_id=c10a0ba5bd17421a8fc5900b646cd20d, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:42.256177 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089633f6-0f9d-4856-a296-202f7dea1481 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:42.274312 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1355/2761] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:21:42 2022] PUT /identity/v3/projects/71a396d737974ae99afc35726249b6e0/users/c10a0ba5bd17421a8fc5900b646cd20d/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:21:42.279171 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c752af8-b308-437b-ab2e-dd023c126d17 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:42.307371 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c752af8-b308-437b-ab2e-dd023c126d17 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:42.410036 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d07b3-8d97-44c3-8d5e-f1835a91102b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:42.410907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d07b3-8d97-44c3-8d5e-f1835a91102b admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:42.411727 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d07b3-8d97-44c3-8d5e-f1835a91102b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:42.412107 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d07b3-8d97-44c3-8d5e-f1835a91102b admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:42.413023 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d07b3-8d97-44c3-8d5e-f1835a91102b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:42.414888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d07b3-8d97-44c3-8d5e-f1835a91102b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:42.427291 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1407/2762] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:21:42.431539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089633f6-0f9d-4856-a296-202f7dea1481 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:42.442117 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089633f6-0f9d-4856-a296-202f7dea1481 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:42.447526 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d165d5f-cb66-42e7-9fea-3e7a5ed459bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:42.448614 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d165d5f-cb66-42e7-9fea-3e7a5ed459bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:42.448890 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d165d5f-cb66-42e7-9fea-3e7a5ed459bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:42.449162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d165d5f-cb66-42e7-9fea-3e7a5ed459bd admin admin] PATH_INFO: `/v3/projects/71a396d737974ae99afc35726249b6e0/users/c10a0ba5bd17421a8fc5900b646cd20d/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:42.452091 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d165d5f-cb66-42e7-9fea-3e7a5ed459bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=71a396d737974ae99afc35726249b6e0, user_id=c10a0ba5bd17421a8fc5900b646cd20d, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:42.455109 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d165d5f-cb66-42e7-9fea-3e7a5ed459bd admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:42.468421 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1356/2763] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:21:42 2022] PUT /identity/v3/projects/71a396d737974ae99afc35726249b6e0/users/c10a0ba5bd17421a8fc5900b646cd20d/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:21:47.946354 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b9339-4217-486a-bc2f-9ca605998cc6 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:47.946854 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b9339-4217-486a-bc2f-9ca605998cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:47.946979 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b9339-4217-486a-bc2f-9ca605998cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:47.975834 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-5c7b9339-4217-486a-bc2f-9ca605998cc6 None None] MFA Rules not processed for user `c10a0ba5bd17421a8fc5900b646cd20d`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:21:47.977444 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5c7b9339-4217-486a-bc2f-9ca605998cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:48.004121 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:21:48.061643 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1408/2764] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:21:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:21:48.074496 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d165d5f-cb66-42e7-9fea-3e7a5ed459bd admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:48.076918 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-8d165d5f-cb66-42e7-9fea-3e7a5ed459bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:48.143995 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d165d5f-cb66-42e7-9fea-3e7a5ed459bd admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:48.147699 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce7541-d612-4d65-8753-4c3b3f0e7b2a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9180b1616c524905b86769a9eb8f7757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:48.150007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce7541-d612-4d65-8753-4c3b3f0e7b2a service glance] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:48.150303 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce7541-d612-4d65-8753-4c3b3f0e7b2a service glance] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:48.150574 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce7541-d612-4d65-8753-4c3b3f0e7b2a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:48.220581 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce7541-d612-4d65-8753-4c3b3f0e7b2a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:48.222003 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce7541-d612-4d65-8753-4c3b3f0e7b2a service glance] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:48.231375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1357/2765] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:21:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:21:48.375978 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9e9f4-cb86-464a-8558-2ad4cb861470 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:48.376264 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9e9f4-cb86-464a-8558-2ad4cb861470 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:48.376566 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9e9f4-cb86-464a-8558-2ad4cb861470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:48.396706 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-84f9e9f4-cb86-464a-8558-2ad4cb861470 None None] MFA Rules not processed for user `c0e57ea982d349c1a86b544e9a6e7758`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:21:48.398316 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-84f9e9f4-cb86-464a-8558-2ad4cb861470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:48.460796 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1409/2766] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 28 12:21:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:21:48.510182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce7541-d612-4d65-8753-4c3b3f0e7b2a service glance] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:48.511696 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-e7ce7541-d612-4d65-8753-4c3b3f0e7b2a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:48.542080 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:21:48.585895 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce7541-d612-4d65-8753-4c3b3f0e7b2a service glance] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:48.591286 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb6a5d-11db-498f-9a4c-d1177d9f0ee1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '822e394e80fd41adb54d330adaf65a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:48.592541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb6a5d-11db-498f-9a4c-d1177d9f0ee1 service swift] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:48.592849 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb6a5d-11db-498f-9a4c-d1177d9f0ee1 service swift] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:48.593116 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb6a5d-11db-498f-9a4c-d1177d9f0ee1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:48.602288 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb6a5d-11db-498f-9a4c-d1177d9f0ee1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:48.603872 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb6a5d-11db-498f-9a4c-d1177d9f0ee1 service swift] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:48.613470 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1358/2767] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 28 12:21:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 12:21:57.990450 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25790039-c67d-4571-a212-8ae5db518890 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:57.991039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25790039-c67d-4571-a212-8ae5db518890 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:57.991227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25790039-c67d-4571-a212-8ae5db518890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:58.010897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-25790039-c67d-4571-a212-8ae5db518890 None None] MFA Rules not processed for user `0b5326f31314429fb695f274cf73bd6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:21:58.012134 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-25790039-c67d-4571-a212-8ae5db518890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:58.018908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1410/2768] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:21:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:21:58.609731 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=21 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:00.079989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf7b21-f01d-48f4-896c-40ac6061826f None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:00.080590 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf7b21-f01d-48f4-896c-40ac6061826f None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:00.080590 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf7b21-f01d-48f4-896c-40ac6061826f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:00.099936 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-4eaf7b21-f01d-48f4-896c-40ac6061826f None None] MFA Rules not processed for user `c0e57ea982d349c1a86b544e9a6e7758`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:00.101146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-4eaf7b21-f01d-48f4-896c-40ac6061826f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:00.109336 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1359/2769] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 28 12:22:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:00.121704 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25790039-c67d-4571-a212-8ae5db518890 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:00.134426 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25790039-c67d-4571-a212-8ae5db518890 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:00.139962 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1266a3-6f69-49e0-8830-4f803d3bebd3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '822e394e80fd41adb54d330adaf65a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:00.140652 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1266a3-6f69-49e0-8830-4f803d3bebd3 service swift] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:00.140999 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1266a3-6f69-49e0-8830-4f803d3bebd3 service swift] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:00.141337 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1266a3-6f69-49e0-8830-4f803d3bebd3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:00.149751 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1266a3-6f69-49e0-8830-4f803d3bebd3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:00.151484 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1266a3-6f69-49e0-8830-4f803d3bebd3 service swift] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:00.160032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1411/2770] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 28 12:22:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 12:22:10.094446 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:10.156488 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=51 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:19.165000 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf7b21-f01d-48f4-896c-40ac6061826f None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:19.220106 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf7b21-f01d-48f4-896c-40ac6061826f None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:19.223685 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c1cde-fff5-4017-9006-5f259b1185bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:19.224294 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c1cde-fff5-4017-9006-5f259b1185bb service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:19.224660 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c1cde-fff5-4017-9006-5f259b1185bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:19.224877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c1cde-fff5-4017-9006-5f259b1185bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:19.240042 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c1cde-fff5-4017-9006-5f259b1185bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:19.241485 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c1cde-fff5-4017-9006-5f259b1185bb service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:19.252743 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1360/2771] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:22:19 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:22:23.521502 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1266a3-6f69-49e0-8830-4f803d3bebd3 service swift] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:23.643823 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1266a3-6f69-49e0-8830-4f803d3bebd3 service swift] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:23.653812 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac065ea1-6a2a-4df6-8a5b-c5d4299fdea4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:23.655758 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac065ea1-6a2a-4df6-8a5b-c5d4299fdea4 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:23.656382 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac065ea1-6a2a-4df6-8a5b-c5d4299fdea4 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:23.656955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac065ea1-6a2a-4df6-8a5b-c5d4299fdea4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:23.659168 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ac065ea1-6a2a-4df6-8a5b-c5d4299fdea4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:23.672841 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac065ea1-6a2a-4df6-8a5b-c5d4299fdea4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:23.675760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac065ea1-6a2a-4df6-8a5b-c5d4299fdea4 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:23.699214 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1412/2772] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:22:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:22:26.832388 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c1cde-fff5-4017-9006-5f259b1185bb service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:26.834886 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-915c1cde-fff5-4017-9006-5f259b1185bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:26.965470 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c1cde-fff5-4017-9006-5f259b1185bb service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:26.974065 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c941c-a8fe-4af5-90bc-bfbc11c686fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09e495edc6fd47c892679bb908c3f5bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:26.974065 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c941c-a8fe-4af5-90bc-bfbc11c686fd service placement] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:26.974065 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c941c-a8fe-4af5-90bc-bfbc11c686fd service placement] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:26.974065 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c941c-a8fe-4af5-90bc-bfbc11c686fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:26.978658 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-ed3c941c-a8fe-4af5-90bc-bfbc11c686fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:26.988292 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c941c-a8fe-4af5-90bc-bfbc11c686fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:26.989439 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c941c-a8fe-4af5-90bc-bfbc11c686fd service placement] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:27.002607 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1361/2773] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:22:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:22:29.968599 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac065ea1-6a2a-4df6-8a5b-c5d4299fdea4 service nova] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:29.971854 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ac065ea1-6a2a-4df6-8a5b-c5d4299fdea4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:30.042739 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac065ea1-6a2a-4df6-8a5b-c5d4299fdea4 service nova] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:30.047962 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44304699-85e2-497f-a9b9-ad9d0b915501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:30.048604 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44304699-85e2-497f-a9b9-ad9d0b915501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:30.048951 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44304699-85e2-497f-a9b9-ad9d0b915501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:30.049226 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44304699-85e2-497f-a9b9-ad9d0b915501 admin admin] PATH_INFO: `/v3/users/e099900dbbe04577abc315f691c62ed2` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:30.050364 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44304699-85e2-497f-a9b9-ad9d0b915501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e099900dbbe04577abc315f691c62ed2)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:30.052346 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44304699-85e2-497f-a9b9-ad9d0b915501 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:30.102512 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-44304699-85e2-497f-a9b9-ad9d0b915501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e099900dbbe04577abc315f691c62ed2'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:22:30.103165 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-44304699-85e2-497f-a9b9-ad9d0b915501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e099900dbbe04577abc315f691c62ed2'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:22:30.110696 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-44304699-85e2-497f-a9b9-ad9d0b915501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e099900dbbe04577abc315f691c62ed2'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:22:30.118057 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-44304699-85e2-497f-a9b9-ad9d0b915501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e099900dbbe04577abc315f691c62ed2'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:22:30.118674 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-44304699-85e2-497f-a9b9-ad9d0b915501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e099900dbbe04577abc315f691c62ed2'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:22:30.136172 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1413/2774] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:22:29 2022] DELETE /identity/v3/users/e099900dbbe04577abc315f691c62ed2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:22:30.301435 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c941c-a8fe-4af5-90bc-bfbc11c686fd service placement] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:30.312723 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c941c-a8fe-4af5-90bc-bfbc11c686fd service placement] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:30.370111 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260fd71-b7b4-4d55-ab53-bc86962e3b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:30.370736 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260fd71-b7b4-4d55-ab53-bc86962e3b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:30.371018 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260fd71-b7b4-4d55-ab53-bc86962e3b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:30.371294 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260fd71-b7b4-4d55-ab53-bc86962e3b5e admin admin] PATH_INFO: `/v3/projects/9fd5d009f0464525baab8c007482a89c` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:30.372727 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260fd71-b7b4-4d55-ab53-bc86962e3b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fd5d009f0464525baab8c007482a89c)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:30.374635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260fd71-b7b4-4d55-ab53-bc86962e3b5e admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:30.420695 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:30.431292 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-a260fd71-b7b4-4d55-ab53-bc86962e3b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fd5d009f0464525baab8c007482a89c', 'request_id': 'req-a260fd71-b7b4-4d55-ab53-bc86962e3b5e'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:22:30.436821 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-a260fd71-b7b4-4d55-ab53-bc86962e3b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fd5d009f0464525baab8c007482a89c', 'request_id': 'req-a260fd71-b7b4-4d55-ab53-bc86962e3b5e'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:22:30.444188 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-a260fd71-b7b4-4d55-ab53-bc86962e3b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fd5d009f0464525baab8c007482a89c', 'request_id': 'req-a260fd71-b7b4-4d55-ab53-bc86962e3b5e'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:22:30.455821 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-a260fd71-b7b4-4d55-ab53-bc86962e3b5e admin admin] The token cache is being invalidate because project 9fd5d009f0464525baab8c007482a89c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:22:30.456105 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-a260fd71-b7b4-4d55-ab53-bc86962e3b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:22:30.456736 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-a260fd71-b7b4-4d55-ab53-bc86962e3b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:22:30.458201 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1362/2775] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:22:30 2022] DELETE /identity/v3/projects/9fd5d009f0464525baab8c007482a89c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:22:30.462259 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44304699-85e2-497f-a9b9-ad9d0b915501 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:30.463719 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-44304699-85e2-497f-a9b9-ad9d0b915501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:30.473806 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:30.477608 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44304699-85e2-497f-a9b9-ad9d0b915501 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:30.538089 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e707b7-2179-4214-921a-05e94bfb20f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:30.538730 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e707b7-2179-4214-921a-05e94bfb20f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:30.539009 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e707b7-2179-4214-921a-05e94bfb20f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:30.539280 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e707b7-2179-4214-921a-05e94bfb20f5 admin admin] PATH_INFO: `/v3/users/1c398b67172048d6b9a53aa13db8b200` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:30.540448 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e707b7-2179-4214-921a-05e94bfb20f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c398b67172048d6b9a53aa13db8b200)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:30.542364 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e707b7-2179-4214-921a-05e94bfb20f5 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:30.588695 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-28e707b7-2179-4214-921a-05e94bfb20f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c398b67172048d6b9a53aa13db8b200'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:22:30.589340 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-28e707b7-2179-4214-921a-05e94bfb20f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c398b67172048d6b9a53aa13db8b200'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:22:30.596699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-28e707b7-2179-4214-921a-05e94bfb20f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c398b67172048d6b9a53aa13db8b200'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:22:30.603955 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-28e707b7-2179-4214-921a-05e94bfb20f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c398b67172048d6b9a53aa13db8b200'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:22:30.604736 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-28e707b7-2179-4214-921a-05e94bfb20f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c398b67172048d6b9a53aa13db8b200'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:22:30.622530 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1414/2776] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:22:30 2022] DELETE /identity/v3/users/1c398b67172048d6b9a53aa13db8b200 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:22:30.794626 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260fd71-b7b4-4d55-ab53-bc86962e3b5e admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:30.796141 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-a260fd71-b7b4-4d55-ab53-bc86962e3b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:30.812049 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260fd71-b7b4-4d55-ab53-bc86962e3b5e admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:30.868758 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382bb2b-92ff-4b71-9a2c-a33b1e73a5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:30.869380 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382bb2b-92ff-4b71-9a2c-a33b1e73a5d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:30.869656 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382bb2b-92ff-4b71-9a2c-a33b1e73a5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:30.869923 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382bb2b-92ff-4b71-9a2c-a33b1e73a5d8 admin admin] PATH_INFO: `/v3/projects/39148f444333403981bfd8a5ca2be468` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:30.871026 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382bb2b-92ff-4b71-9a2c-a33b1e73a5d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39148f444333403981bfd8a5ca2be468)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:30.873713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382bb2b-92ff-4b71-9a2c-a33b1e73a5d8 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:30.918250 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-0382bb2b-92ff-4b71-9a2c-a33b1e73a5d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39148f444333403981bfd8a5ca2be468', 'request_id': 'req-0382bb2b-92ff-4b71-9a2c-a33b1e73a5d8'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:22:30.924268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-0382bb2b-92ff-4b71-9a2c-a33b1e73a5d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39148f444333403981bfd8a5ca2be468', 'request_id': 'req-0382bb2b-92ff-4b71-9a2c-a33b1e73a5d8'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:22:30.932193 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-0382bb2b-92ff-4b71-9a2c-a33b1e73a5d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39148f444333403981bfd8a5ca2be468', 'request_id': 'req-0382bb2b-92ff-4b71-9a2c-a33b1e73a5d8'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:22:30.944092 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-0382bb2b-92ff-4b71-9a2c-a33b1e73a5d8 admin admin] The token cache is being invalidate because project 39148f444333403981bfd8a5ca2be468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:22:30.944385 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-0382bb2b-92ff-4b71-9a2c-a33b1e73a5d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:22:30.945048 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-0382bb2b-92ff-4b71-9a2c-a33b1e73a5d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:22:30.946607 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1363/2777] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:22:30 2022] DELETE /identity/v3/projects/39148f444333403981bfd8a5ca2be468 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:22:35.548191 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803442d-fe06-4370-a727-441c17b5f80e None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:35.548696 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803442d-fe06-4370-a727-441c17b5f80e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:35.548814 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803442d-fe06-4370-a727-441c17b5f80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:35.568491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-3803442d-fe06-4370-a727-441c17b5f80e None None] MFA Rules not processed for user `f0c3129e985c4f94b8c749c8b7401cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:35.569692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3803442d-fe06-4370-a727-441c17b5f80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:35.627753 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1415/2778] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:22:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:40.941126 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:DELETE=12,keystone:SELECT=62,keystone:INSERT=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:45.620654 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=76,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:57.228154 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382bb2b-92ff-4b71-9a2c-a33b1e73a5d8 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:57.229655 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-0382bb2b-92ff-4b71-9a2c-a33b1e73a5d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:57.370155 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382bb2b-92ff-4b71-9a2c-a33b1e73a5d8 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:57.375734 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958b1f9-190a-4308-898c-c003b5da1bb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09e495edc6fd47c892679bb908c3f5bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:57.376330 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958b1f9-190a-4308-898c-c003b5da1bb3 service placement] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:57.376606 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958b1f9-190a-4308-898c-c003b5da1bb3 service placement] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:57.376869 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958b1f9-190a-4308-898c-c003b5da1bb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:57.378535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-7958b1f9-190a-4308-898c-c003b5da1bb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:57.390363 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958b1f9-190a-4308-898c-c003b5da1bb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:57.391948 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958b1f9-190a-4308-898c-c003b5da1bb3 service placement] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:57.401574 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1364/2779] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:22:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:07.397403 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=63 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:36.236159 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a825f-608c-4804-99f9-adb928bbbbe0 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:36.236674 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a825f-608c-4804-99f9-adb928bbbbe0 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:36.236781 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a825f-608c-4804-99f9-adb928bbbbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:36.256057 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-c63a825f-608c-4804-99f9-adb928bbbbe0 None None] MFA Rules not processed for user `f0c3129e985c4f94b8c749c8b7401cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:36.257255 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c63a825f-608c-4804-99f9-adb928bbbbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:36.264615 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1416/2780] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:23:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:46.250608 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:55.509445 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4b047-1fce-4c89-83fc-6f3a3c6e979d None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:55.509934 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4b047-1fce-4c89-83fc-6f3a3c6e979d None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:55.510038 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4b047-1fce-4c89-83fc-6f3a3c6e979d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:55.538387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-7be4b047-1fce-4c89-83fc-6f3a3c6e979d None None] MFA Rules not processed for user `c0e57ea982d349c1a86b544e9a6e7758`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:55.539616 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-7be4b047-1fce-4c89-83fc-6f3a3c6e979d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:55.599533 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1365/2781] 10.222.0.16 () {58 vars in 967 bytes} [Wed Sep 28 12:23:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:55.641091 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a825f-608c-4804-99f9-adb928bbbbe0 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:55.642497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c63a825f-608c-4804-99f9-adb928bbbbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:55.712280 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a825f-608c-4804-99f9-adb928bbbbe0 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:55.717239 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a227129-7015-4b44-aa98-f43715a68840 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '822e394e80fd41adb54d330adaf65a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:55.718371 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a227129-7015-4b44-aa98-f43715a68840 service swift] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:55.718648 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a227129-7015-4b44-aa98-f43715a68840 service swift] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:55.718919 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a227129-7015-4b44-aa98-f43715a68840 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:55.726831 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a227129-7015-4b44-aa98-f43715a68840 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:55.728441 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a227129-7015-4b44-aa98-f43715a68840 service swift] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:55.740285 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1417/2782] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 28 12:23:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 12:24:01.921823 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4b047-1fce-4c89-83fc-6f3a3c6e979d None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:01.934799 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4b047-1fce-4c89-83fc-6f3a3c6e979d None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:01.940787 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0249e-83c5-4257-8745-faf4567bd97c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09e495edc6fd47c892679bb908c3f5bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:01.941620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0249e-83c5-4257-8745-faf4567bd97c service placement] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:01.941897 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0249e-83c5-4257-8745-faf4567bd97c service placement] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:01.942170 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0249e-83c5-4257-8745-faf4567bd97c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:01.944096 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-24e0249e-83c5-4257-8745-faf4567bd97c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:01.956416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0249e-83c5-4257-8745-faf4567bd97c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:01.958006 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0249e-83c5-4257-8745-faf4567bd97c service placement] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:01.968735 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1366/2783] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:24:01.986688 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a227129-7015-4b44-aa98-f43715a68840 service swift] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:01.988326 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7a227129-7015-4b44-aa98-f43715a68840 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:02.090314 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a227129-7015-4b44-aa98-f43715a68840 service swift] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:02.095516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2741c-419d-47a0-a42d-43e50aca759f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:02.096146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2741c-419d-47a0-a42d-43e50aca759f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:02.096427 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2741c-419d-47a0-a42d-43e50aca759f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:02.096702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2741c-419d-47a0-a42d-43e50aca759f admin admin] PATH_INFO: `/v3/users/0b5326f31314429fb695f274cf73bd6c` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:02.097880 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2741c-419d-47a0-a42d-43e50aca759f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b5326f31314429fb695f274cf73bd6c)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:02.099763 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2741c-419d-47a0-a42d-43e50aca759f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:02.145192 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5fa2741c-419d-47a0-a42d-43e50aca759f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b5326f31314429fb695f274cf73bd6c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:02.145837 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5fa2741c-419d-47a0-a42d-43e50aca759f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b5326f31314429fb695f274cf73bd6c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:02.152742 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5fa2741c-419d-47a0-a42d-43e50aca759f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b5326f31314429fb695f274cf73bd6c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:02.160419 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5fa2741c-419d-47a0-a42d-43e50aca759f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b5326f31314429fb695f274cf73bd6c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:02.161017 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5fa2741c-419d-47a0-a42d-43e50aca759f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b5326f31314429fb695f274cf73bd6c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:02.162131 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:02.181194 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1418/2784] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:24:01 2022] DELETE /identity/v3/users/0b5326f31314429fb695f274cf73bd6c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:02.347336 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0249e-83c5-4257-8745-faf4567bd97c service placement] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:02.358013 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0249e-83c5-4257-8745-faf4567bd97c service placement] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:02.415648 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e09d25-788c-4b07-91b1-ae29b2f8822e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:02.416311 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e09d25-788c-4b07-91b1-ae29b2f8822e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:02.416639 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e09d25-788c-4b07-91b1-ae29b2f8822e admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:02.416911 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e09d25-788c-4b07-91b1-ae29b2f8822e admin admin] PATH_INFO: `/v3/projects/6efb31fc7dc64b3eaf580ec6301e4346` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:02.418075 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e09d25-788c-4b07-91b1-ae29b2f8822e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6efb31fc7dc64b3eaf580ec6301e4346)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:02.419987 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e09d25-788c-4b07-91b1-ae29b2f8822e admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:02.465562 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-82e09d25-788c-4b07-91b1-ae29b2f8822e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6efb31fc7dc64b3eaf580ec6301e4346', 'request_id': 'req-82e09d25-788c-4b07-91b1-ae29b2f8822e'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:02.471045 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-82e09d25-788c-4b07-91b1-ae29b2f8822e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6efb31fc7dc64b3eaf580ec6301e4346', 'request_id': 'req-82e09d25-788c-4b07-91b1-ae29b2f8822e'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:02.478569 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-82e09d25-788c-4b07-91b1-ae29b2f8822e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6efb31fc7dc64b3eaf580ec6301e4346', 'request_id': 'req-82e09d25-788c-4b07-91b1-ae29b2f8822e'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:02.489745 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-82e09d25-788c-4b07-91b1-ae29b2f8822e admin admin] The token cache is being invalidate because project 6efb31fc7dc64b3eaf580ec6301e4346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:24:02.490034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-82e09d25-788c-4b07-91b1-ae29b2f8822e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:02.490656 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-82e09d25-788c-4b07-91b1-ae29b2f8822e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:02.492148 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1367/2785] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:24:02 2022] DELETE /identity/v3/projects/6efb31fc7dc64b3eaf580ec6301e4346 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:24:02.496331 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2741c-419d-47a0-a42d-43e50aca759f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:02.497735 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5fa2741c-419d-47a0-a42d-43e50aca759f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:02.511216 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2741c-419d-47a0-a42d-43e50aca759f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:02.566122 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be68898-b001-4ff7-8630-f8e0496fa66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:02.566747 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be68898-b001-4ff7-8630-f8e0496fa66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:02.567021 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be68898-b001-4ff7-8630-f8e0496fa66d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:02.567285 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be68898-b001-4ff7-8630-f8e0496fa66d admin admin] PATH_INFO: `/v3/users/c10a0ba5bd17421a8fc5900b646cd20d` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:02.568441 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be68898-b001-4ff7-8630-f8e0496fa66d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c10a0ba5bd17421a8fc5900b646cd20d)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:02.570358 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be68898-b001-4ff7-8630-f8e0496fa66d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:02.614940 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3be68898-b001-4ff7-8630-f8e0496fa66d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c10a0ba5bd17421a8fc5900b646cd20d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:02.615608 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3be68898-b001-4ff7-8630-f8e0496fa66d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c10a0ba5bd17421a8fc5900b646cd20d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:02.622413 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3be68898-b001-4ff7-8630-f8e0496fa66d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c10a0ba5bd17421a8fc5900b646cd20d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:02.631285 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3be68898-b001-4ff7-8630-f8e0496fa66d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c10a0ba5bd17421a8fc5900b646cd20d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:02.632065 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3be68898-b001-4ff7-8630-f8e0496fa66d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c10a0ba5bd17421a8fc5900b646cd20d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:02.649888 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1419/2786] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:24:02 2022] DELETE /identity/v3/users/c10a0ba5bd17421a8fc5900b646cd20d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:02.822583 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e09d25-788c-4b07-91b1-ae29b2f8822e admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:02.824050 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-82e09d25-788c-4b07-91b1-ae29b2f8822e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:02.837350 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e09d25-788c-4b07-91b1-ae29b2f8822e admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:02.841038 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:02.897492 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b01a3-6ca8-4007-b771-b4841fd84ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:02.898117 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b01a3-6ca8-4007-b771-b4841fd84ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:02.898397 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b01a3-6ca8-4007-b771-b4841fd84ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:02.898672 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b01a3-6ca8-4007-b771-b4841fd84ab4 admin admin] PATH_INFO: `/v3/projects/71a396d737974ae99afc35726249b6e0` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:02.899815 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b01a3-6ca8-4007-b771-b4841fd84ab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71a396d737974ae99afc35726249b6e0)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:02.901703 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b01a3-6ca8-4007-b771-b4841fd84ab4 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:02.949973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-025b01a3-6ca8-4007-b771-b4841fd84ab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71a396d737974ae99afc35726249b6e0', 'request_id': 'req-025b01a3-6ca8-4007-b771-b4841fd84ab4'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:02.955568 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-025b01a3-6ca8-4007-b771-b4841fd84ab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71a396d737974ae99afc35726249b6e0', 'request_id': 'req-025b01a3-6ca8-4007-b771-b4841fd84ab4'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:02.962781 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-025b01a3-6ca8-4007-b771-b4841fd84ab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71a396d737974ae99afc35726249b6e0', 'request_id': 'req-025b01a3-6ca8-4007-b771-b4841fd84ab4'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:02.974247 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-025b01a3-6ca8-4007-b771-b4841fd84ab4 admin admin] The token cache is being invalidate because project 71a396d737974ae99afc35726249b6e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:24:02.974534 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-025b01a3-6ca8-4007-b771-b4841fd84ab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:02.975257 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-025b01a3-6ca8-4007-b771-b4841fd84ab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:02.976942 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1368/2787] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:24:02 2022] DELETE /identity/v3/projects/71a396d737974ae99afc35726249b6e0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:12.646490 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=60,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:12.971225 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:35.731627 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011061d-e1c4-4c6a-a67b-120d3abe6fac None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:35.732126 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011061d-e1c4-4c6a-a67b-120d3abe6fac None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:35.732247 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011061d-e1c4-4c6a-a67b-120d3abe6fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:35.752777 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-c011061d-e1c4-4c6a-a67b-120d3abe6fac None None] MFA Rules not processed for user `f0c3129e985c4f94b8c749c8b7401cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:35.753980 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c011061d-e1c4-4c6a-a67b-120d3abe6fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:35.807516 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1420/2788] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:24:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:45.800913 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=25 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:26.845346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b01a3-6ca8-4007-b771-b4841fd84ab4 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:26.846785 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-025b01a3-6ca8-4007-b771-b4841fd84ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:26.924143 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b01a3-6ca8-4007-b771-b4841fd84ab4 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:26.927821 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ba8b8-8b62-42ef-bc0e-7cae9b9beff5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:26.928418 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ba8b8-8b62-42ef-bc0e-7cae9b9beff5 service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:26.928694 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ba8b8-8b62-42ef-bc0e-7cae9b9beff5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:26.928982 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ba8b8-8b62-42ef-bc0e-7cae9b9beff5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:26.930676 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-493ba8b8-8b62-42ef-bc0e-7cae9b9beff5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:27.010905 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ba8b8-8b62-42ef-bc0e-7cae9b9beff5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:27.012298 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ba8b8-8b62-42ef-bc0e-7cae9b9beff5 service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:27.032293 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1369/2789] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:25:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:25:29.627253 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011061d-e1c4-4c6a-a67b-120d3abe6fac None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:29.637570 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011061d-e1c4-4c6a-a67b-120d3abe6fac None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:29.641478 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d6d9d-a215-4492-95ee-56590128ac63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:29.642136 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d6d9d-a215-4492-95ee-56590128ac63 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:29.642470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d6d9d-a215-4492-95ee-56590128ac63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:29.642748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d6d9d-a215-4492-95ee-56590128ac63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:29.644698 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-962d6d9d-a215-4492-95ee-56590128ac63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:29.658807 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d6d9d-a215-4492-95ee-56590128ac63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:29.660425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d6d9d-a215-4492-95ee-56590128ac63 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:29.672335 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1421/2790] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:25:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:25:37.029730 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=72 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:39.667459 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=6 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:42.022786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ba8b8-8b62-42ef-bc0e-7cae9b9beff5 service cinder] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:42.024491 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-493ba8b8-8b62-42ef-bc0e-7cae9b9beff5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:42.088835 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ba8b8-8b62-42ef-bc0e-7cae9b9beff5 service cinder] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:42.093390 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb26b8e-0e90-416c-9309-46dd28b07547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:42.094036 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb26b8e-0e90-416c-9309-46dd28b07547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:42.094314 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb26b8e-0e90-416c-9309-46dd28b07547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:42.094581 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb26b8e-0e90-416c-9309-46dd28b07547 admin admin] PATH_INFO: `/v3/users/f0c3129e985c4f94b8c749c8b7401cb5` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:42.095725 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb26b8e-0e90-416c-9309-46dd28b07547 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0c3129e985c4f94b8c749c8b7401cb5)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:42.097620 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb26b8e-0e90-416c-9309-46dd28b07547 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:42.145241 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-9cb26b8e-0e90-416c-9309-46dd28b07547 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0c3129e985c4f94b8c749c8b7401cb5'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:42.157338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-9cb26b8e-0e90-416c-9309-46dd28b07547 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0c3129e985c4f94b8c749c8b7401cb5'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:42.158004 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-9cb26b8e-0e90-416c-9309-46dd28b07547 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0c3129e985c4f94b8c749c8b7401cb5'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:42.165100 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-9cb26b8e-0e90-416c-9309-46dd28b07547 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0c3129e985c4f94b8c749c8b7401cb5'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:42.171930 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-9cb26b8e-0e90-416c-9309-46dd28b07547 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0c3129e985c4f94b8c749c8b7401cb5'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:42.178207 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1370/2791] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:25:42 2022] DELETE /identity/v3/users/f0c3129e985c4f94b8c749c8b7401cb5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:42.344725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d6d9d-a215-4492-95ee-56590128ac63 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:42.356118 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d6d9d-a215-4492-95ee-56590128ac63 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:42.415250 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ffcad-ee99-442a-957e-7dbcb0ea39bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:42.415902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ffcad-ee99-442a-957e-7dbcb0ea39bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:42.416178 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ffcad-ee99-442a-957e-7dbcb0ea39bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:42.416443 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ffcad-ee99-442a-957e-7dbcb0ea39bc admin admin] PATH_INFO: `/v3/projects/ef0ec4b9454f4260bcad73c8742fc744` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:42.417556 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ffcad-ee99-442a-957e-7dbcb0ea39bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef0ec4b9454f4260bcad73c8742fc744)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:42.419414 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ffcad-ee99-442a-957e-7dbcb0ea39bc admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:42.464512 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3a0ffcad-ee99-442a-957e-7dbcb0ea39bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef0ec4b9454f4260bcad73c8742fc744', 'request_id': 'req-3a0ffcad-ee99-442a-957e-7dbcb0ea39bc'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:42.470580 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3a0ffcad-ee99-442a-957e-7dbcb0ea39bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef0ec4b9454f4260bcad73c8742fc744', 'request_id': 'req-3a0ffcad-ee99-442a-957e-7dbcb0ea39bc'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:42.476791 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3a0ffcad-ee99-442a-957e-7dbcb0ea39bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef0ec4b9454f4260bcad73c8742fc744', 'request_id': 'req-3a0ffcad-ee99-442a-957e-7dbcb0ea39bc'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:42.490539 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3a0ffcad-ee99-442a-957e-7dbcb0ea39bc admin admin] The token cache is being invalidate because project ef0ec4b9454f4260bcad73c8742fc744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:25:42.490821 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3a0ffcad-ee99-442a-957e-7dbcb0ea39bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:42.491464 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3a0ffcad-ee99-442a-957e-7dbcb0ea39bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:42.492940 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1422/2792] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:25:42 2022] DELETE /identity/v3/projects/ef0ec4b9454f4260bcad73c8742fc744 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:42.497918 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1c4ba-2968-4fb4-9321-65c11f826453 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:42.498207 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1c4ba-2968-4fb4-9321-65c11f826453 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:42.498482 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1c4ba-2968-4fb4-9321-65c11f826453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:42.555652 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-aeb1c4ba-2968-4fb4-9321-65c11f826453 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:42.557274 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-aeb1c4ba-2968-4fb4-9321-65c11f826453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:42.601466 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:42.618528 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1371/2793] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:25:42.627082 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a93a0-3e70-4717-823d-9cc77c8c21ca None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:42.627367 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a93a0-3e70-4717-823d-9cc77c8c21ca None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:42.627670 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a93a0-3e70-4717-823d-9cc77c8c21ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:42.646957 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-1c4a93a0-3e70-4717-823d-9cc77c8c21ca None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:42.648176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-1c4a93a0-3e70-4717-823d-9cc77c8c21ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:42.656049 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1423/2794] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:42.660570 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1c4ba-2968-4fb4-9321-65c11f826453 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:42.670137 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1c4ba-2968-4fb4-9321-65c11f826453 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:42.675218 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ca028-756d-4f1b-b121-91334414650c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:42.675813 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ca028-756d-4f1b-b121-91334414650c admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:42.676096 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ca028-756d-4f1b-b121-91334414650c admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:42.676363 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ca028-756d-4f1b-b121-91334414650c admin admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:42.676999 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ca028-756d-4f1b-b121-91334414650c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:25:42.677296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ca028-756d-4f1b-b121-91334414650c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:42.678874 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ca028-756d-4f1b-b121-91334414650c admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:42.690085 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1372/2795] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:25:42.694114 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a93a0-3e70-4717-823d-9cc77c8c21ca None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:42.710093 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a93a0-3e70-4717-823d-9cc77c8c21ca None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:42.714790 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980506f3-5fd5-4fbe-beca-68fb2bfc9b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:42.715398 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980506f3-5fd5-4fbe-beca-68fb2bfc9b78 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:42.715711 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980506f3-5fd5-4fbe-beca-68fb2bfc9b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:42.715985 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980506f3-5fd5-4fbe-beca-68fb2bfc9b78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:42.716617 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980506f3-5fd5-4fbe-beca-68fb2bfc9b78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:42.718544 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980506f3-5fd5-4fbe-beca-68fb2bfc9b78 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:42.755958 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1424/2796] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:25:42 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:25:42.760025 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ca028-756d-4f1b-b121-91334414650c admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:42.770018 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ca028-756d-4f1b-b121-91334414650c admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:42.824496 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e82c3-af6f-415d-a06c-62554ef42b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:42.825086 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e82c3-af6f-415d-a06c-62554ef42b9e admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:42.825360 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e82c3-af6f-415d-a06c-62554ef42b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:42.825629 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e82c3-af6f-415d-a06c-62554ef42b9e admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:42.826248 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e82c3-af6f-415d-a06c-62554ef42b9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:42.828173 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e82c3-af6f-415d-a06c-62554ef42b9e admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:42.849453 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1373/2797] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:25:42 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:25:42.853539 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980506f3-5fd5-4fbe-beca-68fb2bfc9b78 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:42.863967 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980506f3-5fd5-4fbe-beca-68fb2bfc9b78 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:42.868617 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68018579-07d0-4b11-b00a-345d1a215328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:42.869213 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68018579-07d0-4b11-b00a-345d1a215328 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:42.869492 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68018579-07d0-4b11-b00a-345d1a215328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:42.869764 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68018579-07d0-4b11-b00a-345d1a215328 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:42.870432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68018579-07d0-4b11-b00a-345d1a215328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:42.872069 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68018579-07d0-4b11-b00a-345d1a215328 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:42.882180 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1425/2798] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:25:42.886102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e82c3-af6f-415d-a06c-62554ef42b9e admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:42.896537 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e82c3-af6f-415d-a06c-62554ef42b9e admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:42.901170 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7ed59-32ca-466e-9586-3ea982e52168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:42.901755 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7ed59-32ca-466e-9586-3ea982e52168 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:42.902034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7ed59-32ca-466e-9586-3ea982e52168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:42.902305 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7ed59-32ca-466e-9586-3ea982e52168 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:42.902942 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7ed59-32ca-466e-9586-3ea982e52168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:42.904572 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7ed59-32ca-466e-9586-3ea982e52168 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:42.915563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1374/2799] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:25:42.919637 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68018579-07d0-4b11-b00a-345d1a215328 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:42.929434 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68018579-07d0-4b11-b00a-345d1a215328 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:42.934011 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a6d3d-cfbe-49ff-835e-6b70a7ee703c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:42.934645 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a6d3d-cfbe-49ff-835e-6b70a7ee703c admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:42.934922 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a6d3d-cfbe-49ff-835e-6b70a7ee703c admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:42.935234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a6d3d-cfbe-49ff-835e-6b70a7ee703c admin admin] PATH_INFO: `/v3/projects/02f3d4e5197c4f5293bd0de4e1c9b1e2/users/67317f1a2d884d9cafb0df735133e857/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:42.949685 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a6d3d-cfbe-49ff-835e-6b70a7ee703c admin admin] RBAC: Authorizing `identity:create_grant(project_id=02f3d4e5197c4f5293bd0de4e1c9b1e2, user_id=67317f1a2d884d9cafb0df735133e857, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:42.952335 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a6d3d-cfbe-49ff-835e-6b70a7ee703c admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:42.966068 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1426/2800] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:25:42 2022] PUT /identity/v3/projects/02f3d4e5197c4f5293bd0de4e1c9b1e2/users/67317f1a2d884d9cafb0df735133e857/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:42.977163 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf31e2-3d62-4b56-b575-08069cd0d3c9 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:42.977450 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf31e2-3d62-4b56-b575-08069cd0d3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:42.977724 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf31e2-3d62-4b56-b575-08069cd0d3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:43.006631 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-f4cf31e2-3d62-4b56-b575-08069cd0d3c9 None None] MFA Rules not processed for user `67317f1a2d884d9cafb0df735133e857`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:43.007822 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-f4cf31e2-3d62-4b56-b575-08069cd0d3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:43.072643 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1375/2801] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:25:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:43.084839 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a6d3d-cfbe-49ff-835e-6b70a7ee703c admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:43.086544 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-cc3a6d3d-cfbe-49ff-835e-6b70a7ee703c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:43.107827 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:43.165216 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a6d3d-cfbe-49ff-835e-6b70a7ee703c admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:43.170834 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47786163-4edd-44da-b553-9184002cd6bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e81804e04514ae882a1fd93789db025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:43.171457 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47786163-4edd-44da-b553-9184002cd6bf service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:43.171748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47786163-4edd-44da-b553-9184002cd6bf service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:43.172034 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47786163-4edd-44da-b553-9184002cd6bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:43.179642 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47786163-4edd-44da-b553-9184002cd6bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:43.181196 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47786163-4edd-44da-b553-9184002cd6bf service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:43.190456 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1427/2802] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:25:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:25:48.363943 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf31e2-3d62-4b56-b575-08069cd0d3c9 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:48.407572 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:48.425481 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf31e2-3d62-4b56-b575-08069cd0d3c9 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:48.429997 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e256f-83bf-4817-9c3b-6bac69c7c161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:48.430615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e256f-83bf-4817-9c3b-6bac69c7c161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:48.430893 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e256f-83bf-4817-9c3b-6bac69c7c161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:48.431161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e256f-83bf-4817-9c3b-6bac69c7c161 admin admin] PATH_INFO: `/v3/users/67317f1a2d884d9cafb0df735133e857` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:48.432304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e256f-83bf-4817-9c3b-6bac69c7c161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67317f1a2d884d9cafb0df735133e857)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:48.434192 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e256f-83bf-4817-9c3b-6bac69c7c161 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:48.477518 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-504e256f-83bf-4817-9c3b-6bac69c7c161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67317f1a2d884d9cafb0df735133e857'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:48.490484 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-504e256f-83bf-4817-9c3b-6bac69c7c161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67317f1a2d884d9cafb0df735133e857'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:48.491083 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-504e256f-83bf-4817-9c3b-6bac69c7c161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67317f1a2d884d9cafb0df735133e857'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:48.498494 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-504e256f-83bf-4817-9c3b-6bac69c7c161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67317f1a2d884d9cafb0df735133e857'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:48.505839 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-504e256f-83bf-4817-9c3b-6bac69c7c161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67317f1a2d884d9cafb0df735133e857'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:48.511706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1376/2803] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:25:48 2022] DELETE /identity/v3/users/67317f1a2d884d9cafb0df735133e857 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:48.516208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac1266-b69c-4961-8a21-16552892bcea None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:48.516699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac1266-b69c-4961-8a21-16552892bcea None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:48.516820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac1266-b69c-4961-8a21-16552892bcea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:48.536185 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-abac1266-b69c-4961-8a21-16552892bcea None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:48.537425 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-abac1266-b69c-4961-8a21-16552892bcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:48.595488 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1428/2804] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:48.605149 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e256f-83bf-4817-9c3b-6bac69c7c161 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:48.606570 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-504e256f-83bf-4817-9c3b-6bac69c7c161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:48.685114 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e256f-83bf-4817-9c3b-6bac69c7c161 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:48.689353 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc31389-5bc8-491c-8306-de3ffe570305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:48.689945 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc31389-5bc8-491c-8306-de3ffe570305 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:48.690224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc31389-5bc8-491c-8306-de3ffe570305 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:48.690494 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc31389-5bc8-491c-8306-de3ffe570305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:48.699314 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc31389-5bc8-491c-8306-de3ffe570305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:48.700769 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc31389-5bc8-491c-8306-de3ffe570305 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:48.711208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1377/2805] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:25:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:25:48.978793 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac1266-b69c-4961-8a21-16552892bcea None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:48.980379 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-abac1266-b69c-4961-8a21-16552892bcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:48.993802 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac1266-b69c-4961-8a21-16552892bcea None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:48.998818 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a904df3-7ed9-4726-9b1e-e1a039c532e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:48.999417 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a904df3-7ed9-4726-9b1e-e1a039c532e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:48.999741 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a904df3-7ed9-4726-9b1e-e1a039c532e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:49.000797 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a904df3-7ed9-4726-9b1e-e1a039c532e4 admin admin] PATH_INFO: `/v3/projects/02f3d4e5197c4f5293bd0de4e1c9b1e2` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:49.002055 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a904df3-7ed9-4726-9b1e-e1a039c532e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02f3d4e5197c4f5293bd0de4e1c9b1e2)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:49.004249 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a904df3-7ed9-4726-9b1e-e1a039c532e4 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:49.053034 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5a904df3-7ed9-4726-9b1e-e1a039c532e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02f3d4e5197c4f5293bd0de4e1c9b1e2', 'request_id': 'req-5a904df3-7ed9-4726-9b1e-e1a039c532e4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:49.058770 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5a904df3-7ed9-4726-9b1e-e1a039c532e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02f3d4e5197c4f5293bd0de4e1c9b1e2', 'request_id': 'req-5a904df3-7ed9-4726-9b1e-e1a039c532e4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:49.065496 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5a904df3-7ed9-4726-9b1e-e1a039c532e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02f3d4e5197c4f5293bd0de4e1c9b1e2', 'request_id': 'req-5a904df3-7ed9-4726-9b1e-e1a039c532e4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:49.077742 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5a904df3-7ed9-4726-9b1e-e1a039c532e4 admin admin] The token cache is being invalidate because project 02f3d4e5197c4f5293bd0de4e1c9b1e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:25:49.078027 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5a904df3-7ed9-4726-9b1e-e1a039c532e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:49.078644 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5a904df3-7ed9-4726-9b1e-e1a039c532e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:49.080182 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1429/2806] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:25:48 2022] DELETE /identity/v3/projects/02f3d4e5197c4f5293bd0de4e1c9b1e2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:49.084976 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ae9f7-af5e-417e-ae4b-46698f95ad5e None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:49.085296 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ae9f7-af5e-417e-ae4b-46698f95ad5e None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:49.085575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ae9f7-af5e-417e-ae4b-46698f95ad5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:49.104571 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-fc2ae9f7-af5e-417e-ae4b-46698f95ad5e None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:49.105760 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-fc2ae9f7-af5e-417e-ae4b-46698f95ad5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:49.147463 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:49.166182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1378/2807] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:49.174612 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f3b25-0119-40fa-80e3-f78ebf62f486 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:49.174898 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f3b25-0119-40fa-80e3-f78ebf62f486 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:49.175176 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f3b25-0119-40fa-80e3-f78ebf62f486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:49.194590 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-3a6f3b25-0119-40fa-80e3-f78ebf62f486 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:49.195823 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3a6f3b25-0119-40fa-80e3-f78ebf62f486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:49.203618 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1430/2808] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:49.207616 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ae9f7-af5e-417e-ae4b-46698f95ad5e None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:49.217147 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ae9f7-af5e-417e-ae4b-46698f95ad5e None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:49.222241 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956b342-f0e8-4292-8aad-dfff745a1bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:49.222838 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956b342-f0e8-4292-8aad-dfff745a1bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:49.223112 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956b342-f0e8-4292-8aad-dfff745a1bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:49.223386 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956b342-f0e8-4292-8aad-dfff745a1bd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:49.224108 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956b342-f0e8-4292-8aad-dfff745a1bd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:25:49.224409 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956b342-f0e8-4292-8aad-dfff745a1bd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:49.225993 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956b342-f0e8-4292-8aad-dfff745a1bd0 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:49.239380 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1379/2809] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:25:49.244065 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f3b25-0119-40fa-80e3-f78ebf62f486 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:49.253762 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f3b25-0119-40fa-80e3-f78ebf62f486 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:49.258284 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa322dc8-7f8d-4552-bdf9-b0cd9856a8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:49.258876 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa322dc8-7f8d-4552-bdf9-b0cd9856a8af admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:49.259152 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa322dc8-7f8d-4552-bdf9-b0cd9856a8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:49.259421 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa322dc8-7f8d-4552-bdf9-b0cd9856a8af admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:49.260076 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa322dc8-7f8d-4552-bdf9-b0cd9856a8af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:49.261950 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa322dc8-7f8d-4552-bdf9-b0cd9856a8af admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:49.284101 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:49.292275 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1431/2810] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:25:49 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:25:49.296504 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956b342-f0e8-4292-8aad-dfff745a1bd0 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:49.306815 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956b342-f0e8-4292-8aad-dfff745a1bd0 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:49.361509 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68574e16-7d69-488d-83e7-559cdabfbecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:49.362107 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68574e16-7d69-488d-83e7-559cdabfbecc admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:49.362386 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68574e16-7d69-488d-83e7-559cdabfbecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:49.362658 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68574e16-7d69-488d-83e7-559cdabfbecc admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:49.363289 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68574e16-7d69-488d-83e7-559cdabfbecc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:49.365297 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68574e16-7d69-488d-83e7-559cdabfbecc admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:49.385719 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1380/2811] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:25:49 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:25:49.389805 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa322dc8-7f8d-4552-bdf9-b0cd9856a8af admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:49.400146 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa322dc8-7f8d-4552-bdf9-b0cd9856a8af admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:49.404746 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1390a5-4382-4d31-bbe4-27b6768e361d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:49.405339 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1390a5-4382-4d31-bbe4-27b6768e361d admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:49.405618 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1390a5-4382-4d31-bbe4-27b6768e361d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:49.405891 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1390a5-4382-4d31-bbe4-27b6768e361d admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:49.407048 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1390a5-4382-4d31-bbe4-27b6768e361d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:49.408707 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1390a5-4382-4d31-bbe4-27b6768e361d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:49.418456 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1432/2812] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:25:49.423022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68574e16-7d69-488d-83e7-559cdabfbecc admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:49.432840 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68574e16-7d69-488d-83e7-559cdabfbecc admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:49.437405 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed79f75-52ab-4771-b5d6-9615d9261442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:49.437994 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed79f75-52ab-4771-b5d6-9615d9261442 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:49.438275 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed79f75-52ab-4771-b5d6-9615d9261442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:49.438547 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed79f75-52ab-4771-b5d6-9615d9261442 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:49.439185 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed79f75-52ab-4771-b5d6-9615d9261442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:49.440898 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed79f75-52ab-4771-b5d6-9615d9261442 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:49.451208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1381/2813] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:25:49.455690 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1390a5-4382-4d31-bbe4-27b6768e361d admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:49.465584 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1390a5-4382-4d31-bbe4-27b6768e361d admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:49.470734 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ced34c-3c88-4c65-839d-5348cf2cdf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:49.471369 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ced34c-3c88-4c65-839d-5348cf2cdf32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:49.471678 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ced34c-3c88-4c65-839d-5348cf2cdf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:49.471951 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ced34c-3c88-4c65-839d-5348cf2cdf32 admin admin] PATH_INFO: `/v3/projects/e489e000dcc64b4faa0ac0bfdefed8c7/users/ab8337c8c69c4c77933219c0068a48ee/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:49.487389 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ced34c-3c88-4c65-839d-5348cf2cdf32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e489e000dcc64b4faa0ac0bfdefed8c7, user_id=ab8337c8c69c4c77933219c0068a48ee, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:49.490154 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ced34c-3c88-4c65-839d-5348cf2cdf32 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:49.502710 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1433/2814] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:25:49 2022] PUT /identity/v3/projects/e489e000dcc64b4faa0ac0bfdefed8c7/users/ab8337c8c69c4c77933219c0068a48ee/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:49.514048 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f5285-9e9b-4435-97c5-ca94c0cd33f1 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:49.514268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f5285-9e9b-4435-97c5-ca94c0cd33f1 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:49.514537 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f5285-9e9b-4435-97c5-ca94c0cd33f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:49.542046 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-c42f5285-9e9b-4435-97c5-ca94c0cd33f1 None None] MFA Rules not processed for user `ab8337c8c69c4c77933219c0068a48ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:49.543353 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-c42f5285-9e9b-4435-97c5-ca94c0cd33f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:49.612388 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1382/2815] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:25:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:49.617024 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ced34c-3c88-4c65-839d-5348cf2cdf32 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:49.678702 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ced34c-3c88-4c65-839d-5348cf2cdf32 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:49.683347 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d54ace-0448-4277-8c98-d3dabd8f5bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:49.683970 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d54ace-0448-4277-8c98-d3dabd8f5bed admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:49.684251 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d54ace-0448-4277-8c98-d3dabd8f5bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:49.684525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d54ace-0448-4277-8c98-d3dabd8f5bed admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:49.685149 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d54ace-0448-4277-8c98-d3dabd8f5bed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:49.687076 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d54ace-0448-4277-8c98-d3dabd8f5bed admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:49.713368 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1434/2816] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:25:49 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:25:49.717335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f5285-9e9b-4435-97c5-ca94c0cd33f1 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:49.727899 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f5285-9e9b-4435-97c5-ca94c0cd33f1 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:49.768010 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:49.785660 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445e54f-58d9-49fd-beff-8d36d49a7b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:49.786264 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445e54f-58d9-49fd-beff-8d36d49a7b5c admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:49.786541 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445e54f-58d9-49fd-beff-8d36d49a7b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:49.786809 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445e54f-58d9-49fd-beff-8d36d49a7b5c admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:49.787483 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445e54f-58d9-49fd-beff-8d36d49a7b5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:49.789377 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445e54f-58d9-49fd-beff-8d36d49a7b5c admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:49.809452 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1383/2817] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:25:49 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:25:49.813457 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d54ace-0448-4277-8c98-d3dabd8f5bed admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:49.823726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d54ace-0448-4277-8c98-d3dabd8f5bed admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:49.828828 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b62ef-a2df-42a5-a474-40fbe09dcbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:49.829448 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b62ef-a2df-42a5-a474-40fbe09dcbab admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:49.829728 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b62ef-a2df-42a5-a474-40fbe09dcbab admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:49.830002 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b62ef-a2df-42a5-a474-40fbe09dcbab admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:49.830644 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b62ef-a2df-42a5-a474-40fbe09dcbab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:49.832307 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b62ef-a2df-42a5-a474-40fbe09dcbab admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:49.842779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1435/2818] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:25:49.847530 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445e54f-58d9-49fd-beff-8d36d49a7b5c admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:49.857314 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445e54f-58d9-49fd-beff-8d36d49a7b5c admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:49.861942 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed0135-1fd6-41a0-9446-32f95ce805ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:49.862575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed0135-1fd6-41a0-9446-32f95ce805ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:49.862851 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed0135-1fd6-41a0-9446-32f95ce805ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:49.863141 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed0135-1fd6-41a0-9446-32f95ce805ae admin admin] PATH_INFO: `/v3/projects/829135f7ac3a4f3ea14b2ad54b33f666/users/a182d0e1a2404737bf25f69032e66c2d/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:49.878756 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed0135-1fd6-41a0-9446-32f95ce805ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=829135f7ac3a4f3ea14b2ad54b33f666, user_id=a182d0e1a2404737bf25f69032e66c2d, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:49.881925 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed0135-1fd6-41a0-9446-32f95ce805ae admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:49.899453 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1384/2819] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:25:49 2022] PUT /identity/v3/projects/829135f7ac3a4f3ea14b2ad54b33f666/users/a182d0e1a2404737bf25f69032e66c2d/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:49.903906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b62ef-a2df-42a5-a474-40fbe09dcbab admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:49.914463 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b62ef-a2df-42a5-a474-40fbe09dcbab admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:49.969926 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f47b1-74d0-4818-98d4-37124612a669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:49.970534 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f47b1-74d0-4818-98d4-37124612a669 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:49.970815 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f47b1-74d0-4818-98d4-37124612a669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:49.971115 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f47b1-74d0-4818-98d4-37124612a669 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:49.971795 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f47b1-74d0-4818-98d4-37124612a669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:49.973385 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f47b1-74d0-4818-98d4-37124612a669 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:49.983108 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1436/2820] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:25:49.987224 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed0135-1fd6-41a0-9446-32f95ce805ae admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:49.997271 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed0135-1fd6-41a0-9446-32f95ce805ae admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:50.002633 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d13e4-2916-4497-bd9d-afc5c865ebfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:50.003268 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d13e4-2916-4497-bd9d-afc5c865ebfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:50.003585 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d13e4-2916-4497-bd9d-afc5c865ebfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:50.003857 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d13e4-2916-4497-bd9d-afc5c865ebfb admin admin] PATH_INFO: `/v3/projects/829135f7ac3a4f3ea14b2ad54b33f666/users/a182d0e1a2404737bf25f69032e66c2d/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:50.005737 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d13e4-2916-4497-bd9d-afc5c865ebfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=829135f7ac3a4f3ea14b2ad54b33f666, user_id=a182d0e1a2404737bf25f69032e66c2d, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:50.008352 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d13e4-2916-4497-bd9d-afc5c865ebfb admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:50.018821 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1385/2821] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:25:49 2022] PUT /identity/v3/projects/829135f7ac3a4f3ea14b2ad54b33f666/users/a182d0e1a2404737bf25f69032e66c2d/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:50.028683 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf823c-ff57-43ab-892e-80482da8d5d8 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:50.028972 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf823c-ff57-43ab-892e-80482da8d5d8 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:50.029278 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf823c-ff57-43ab-892e-80482da8d5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:50.057252 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-96bf823c-ff57-43ab-892e-80482da8d5d8 None None] MFA Rules not processed for user `a182d0e1a2404737bf25f69032e66c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:50.058491 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-96bf823c-ff57-43ab-892e-80482da8d5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:50.079528 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:50.128673 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1437/2822] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:25:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:50.139168 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d13e4-2916-4497-bd9d-afc5c865ebfb admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:50.141455 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-482d13e4-2916-4497-bd9d-afc5c865ebfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:50.197863 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d13e4-2916-4497-bd9d-afc5c865ebfb admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:50.201573 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda4e89-9f74-4abe-a083-5095a4c21b58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:50.202167 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda4e89-9f74-4abe-a083-5095a4c21b58 service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:50.202446 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda4e89-9f74-4abe-a083-5095a4c21b58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:50.202715 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda4e89-9f74-4abe-a083-5095a4c21b58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:50.212443 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda4e89-9f74-4abe-a083-5095a4c21b58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:50.213883 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda4e89-9f74-4abe-a083-5095a4c21b58 service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:50.223097 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1386/2823] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:25:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:25:51.530812 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf823c-ff57-43ab-892e-80482da8d5d8 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:51.594242 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf823c-ff57-43ab-892e-80482da8d5d8 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:51.598784 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d4f3c-3dee-4e93-b75f-4c573b942ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:51.599407 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d4f3c-3dee-4e93-b75f-4c573b942ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:51.599714 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d4f3c-3dee-4e93-b75f-4c573b942ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:51.599984 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d4f3c-3dee-4e93-b75f-4c573b942ff1 admin admin] PATH_INFO: `/v3/users/ab8337c8c69c4c77933219c0068a48ee` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:51.601108 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d4f3c-3dee-4e93-b75f-4c573b942ff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab8337c8c69c4c77933219c0068a48ee)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:51.603044 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d4f3c-3dee-4e93-b75f-4c573b942ff1 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:51.649497 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a51d4f3c-3dee-4e93-b75f-4c573b942ff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab8337c8c69c4c77933219c0068a48ee'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:51.650127 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a51d4f3c-3dee-4e93-b75f-4c573b942ff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab8337c8c69c4c77933219c0068a48ee'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:51.657022 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a51d4f3c-3dee-4e93-b75f-4c573b942ff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab8337c8c69c4c77933219c0068a48ee'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:51.664213 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a51d4f3c-3dee-4e93-b75f-4c573b942ff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab8337c8c69c4c77933219c0068a48ee'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:51.664966 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a51d4f3c-3dee-4e93-b75f-4c573b942ff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab8337c8c69c4c77933219c0068a48ee'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:51.681878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1438/2824] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:25:51 2022] DELETE /identity/v3/users/ab8337c8c69c4c77933219c0068a48ee => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:51.686650 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340ab35-31ca-4f13-8ece-fd28d10ae36c None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:51.687114 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340ab35-31ca-4f13-8ece-fd28d10ae36c None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:51.687742 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340ab35-31ca-4f13-8ece-fd28d10ae36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:51.706886 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-8340ab35-31ca-4f13-8ece-fd28d10ae36c None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:51.708119 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-8340ab35-31ca-4f13-8ece-fd28d10ae36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:51.767529 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1387/2825] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:51.777108 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d4f3c-3dee-4e93-b75f-4c573b942ff1 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:51.778430 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a51d4f3c-3dee-4e93-b75f-4c573b942ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:51.819942 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:51.836471 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d4f3c-3dee-4e93-b75f-4c573b942ff1 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:51.840058 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd940f05-bd8d-46c2-839a-ab798064f910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:51.840645 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd940f05-bd8d-46c2-839a-ab798064f910 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:51.840918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd940f05-bd8d-46c2-839a-ab798064f910 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:51.841183 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd940f05-bd8d-46c2-839a-ab798064f910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:51.850082 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd940f05-bd8d-46c2-839a-ab798064f910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:51.851417 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd940f05-bd8d-46c2-839a-ab798064f910 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:51.861424 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1439/2826] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:25:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:25:52.122551 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340ab35-31ca-4f13-8ece-fd28d10ae36c None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:52.124251 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-8340ab35-31ca-4f13-8ece-fd28d10ae36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:52.138954 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340ab35-31ca-4f13-8ece-fd28d10ae36c None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:52.144670 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd95567-f109-4e2a-b6a3-4510ca7939f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:52.145579 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd95567-f109-4e2a-b6a3-4510ca7939f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:52.145984 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd95567-f109-4e2a-b6a3-4510ca7939f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:52.146260 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd95567-f109-4e2a-b6a3-4510ca7939f0 admin admin] PATH_INFO: `/v3/projects/e489e000dcc64b4faa0ac0bfdefed8c7` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:52.147466 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd95567-f109-4e2a-b6a3-4510ca7939f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e489e000dcc64b4faa0ac0bfdefed8c7)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:52.149502 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd95567-f109-4e2a-b6a3-4510ca7939f0 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:52.184626 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:52.198365 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-afd95567-f109-4e2a-b6a3-4510ca7939f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e489e000dcc64b4faa0ac0bfdefed8c7', 'request_id': 'req-afd95567-f109-4e2a-b6a3-4510ca7939f0'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:52.204454 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-afd95567-f109-4e2a-b6a3-4510ca7939f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e489e000dcc64b4faa0ac0bfdefed8c7', 'request_id': 'req-afd95567-f109-4e2a-b6a3-4510ca7939f0'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:52.214078 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-afd95567-f109-4e2a-b6a3-4510ca7939f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e489e000dcc64b4faa0ac0bfdefed8c7', 'request_id': 'req-afd95567-f109-4e2a-b6a3-4510ca7939f0'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:52.227657 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-afd95567-f109-4e2a-b6a3-4510ca7939f0 admin admin] The token cache is being invalidate because project e489e000dcc64b4faa0ac0bfdefed8c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:25:52.227945 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-afd95567-f109-4e2a-b6a3-4510ca7939f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:52.228595 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-afd95567-f109-4e2a-b6a3-4510ca7939f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:52.230094 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1388/2827] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:25:52 2022] DELETE /identity/v3/projects/e489e000dcc64b4faa0ac0bfdefed8c7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:52.234820 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd940f05-bd8d-46c2-839a-ab798064f910 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:52.244379 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd940f05-bd8d-46c2-839a-ab798064f910 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:52.300061 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36688321-37b5-4f4c-bb5b-527c47879581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:52.300684 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36688321-37b5-4f4c-bb5b-527c47879581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:52.300962 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36688321-37b5-4f4c-bb5b-527c47879581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:52.301234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36688321-37b5-4f4c-bb5b-527c47879581 admin admin] PATH_INFO: `/v3/users/a182d0e1a2404737bf25f69032e66c2d` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:52.302344 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36688321-37b5-4f4c-bb5b-527c47879581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a182d0e1a2404737bf25f69032e66c2d)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:52.304272 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36688321-37b5-4f4c-bb5b-527c47879581 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:52.348897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-36688321-37b5-4f4c-bb5b-527c47879581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a182d0e1a2404737bf25f69032e66c2d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:52.349550 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-36688321-37b5-4f4c-bb5b-527c47879581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a182d0e1a2404737bf25f69032e66c2d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:52.356509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-36688321-37b5-4f4c-bb5b-527c47879581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a182d0e1a2404737bf25f69032e66c2d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:52.363940 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-36688321-37b5-4f4c-bb5b-527c47879581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a182d0e1a2404737bf25f69032e66c2d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:52.364548 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-36688321-37b5-4f4c-bb5b-527c47879581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a182d0e1a2404737bf25f69032e66c2d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:52.382068 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1440/2828] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:25:52 2022] DELETE /identity/v3/users/a182d0e1a2404737bf25f69032e66c2d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:52.651284 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd95567-f109-4e2a-b6a3-4510ca7939f0 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:52.652729 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-afd95567-f109-4e2a-b6a3-4510ca7939f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:52.667305 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd95567-f109-4e2a-b6a3-4510ca7939f0 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:52.723124 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88d312-4485-4bfc-a843-7f7626863100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:52.723759 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88d312-4485-4bfc-a843-7f7626863100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:52.724037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88d312-4485-4bfc-a843-7f7626863100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:52.724308 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88d312-4485-4bfc-a843-7f7626863100 admin admin] PATH_INFO: `/v3/projects/829135f7ac3a4f3ea14b2ad54b33f666` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:52.725393 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88d312-4485-4bfc-a843-7f7626863100 admin admin] RBAC: Authorizing `identity:delete_project(project_id=829135f7ac3a4f3ea14b2ad54b33f666)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:52.727599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88d312-4485-4bfc-a843-7f7626863100 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:52.773740 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-6f88d312-4485-4bfc-a843-7f7626863100 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '829135f7ac3a4f3ea14b2ad54b33f666', 'request_id': 'req-6f88d312-4485-4bfc-a843-7f7626863100'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:52.779205 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-6f88d312-4485-4bfc-a843-7f7626863100 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '829135f7ac3a4f3ea14b2ad54b33f666', 'request_id': 'req-6f88d312-4485-4bfc-a843-7f7626863100'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:52.786787 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-6f88d312-4485-4bfc-a843-7f7626863100 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '829135f7ac3a4f3ea14b2ad54b33f666', 'request_id': 'req-6f88d312-4485-4bfc-a843-7f7626863100'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:52.797706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-6f88d312-4485-4bfc-a843-7f7626863100 admin admin] The token cache is being invalidate because project 829135f7ac3a4f3ea14b2ad54b33f666 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:25:52.797996 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-6f88d312-4485-4bfc-a843-7f7626863100 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:52.798627 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-6f88d312-4485-4bfc-a843-7f7626863100 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:52.800177 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1389/2829] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:25:52 2022] DELETE /identity/v3/projects/829135f7ac3a4f3ea14b2ad54b33f666 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:52.804943 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ded382-71cc-4104-955b-c1c2bf3479e2 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:52.805413 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ded382-71cc-4104-955b-c1c2bf3479e2 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:52.805525 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ded382-71cc-4104-955b-c1c2bf3479e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:52.825927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-a1ded382-71cc-4104-955b-c1c2bf3479e2 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:52.827129 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a1ded382-71cc-4104-955b-c1c2bf3479e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:52.877799 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:52.887267 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1441/2830] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:52.896941 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c83661-5e75-46eb-beac-6ad95bb4f41a None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:52.897165 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c83661-5e75-46eb-beac-6ad95bb4f41a None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:52.897437 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c83661-5e75-46eb-beac-6ad95bb4f41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:52.918817 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-f2c83661-5e75-46eb-beac-6ad95bb4f41a None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:52.920032 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-f2c83661-5e75-46eb-beac-6ad95bb4f41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:52.927832 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1390/2831] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:52.931986 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ded382-71cc-4104-955b-c1c2bf3479e2 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:52.942264 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ded382-71cc-4104-955b-c1c2bf3479e2 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:52.947276 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14592c-0715-4d59-8d83-956800f7d5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:52.948170 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14592c-0715-4d59-8d83-956800f7d5ee admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:52.948454 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14592c-0715-4d59-8d83-956800f7d5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:52.948729 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14592c-0715-4d59-8d83-956800f7d5ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:52.949383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14592c-0715-4d59-8d83-956800f7d5ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:25:52.949799 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14592c-0715-4d59-8d83-956800f7d5ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:52.952582 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14592c-0715-4d59-8d83-956800f7d5ee admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:52.966518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1442/2832] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:25:52.971827 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c83661-5e75-46eb-beac-6ad95bb4f41a None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:52.980942 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c83661-5e75-46eb-beac-6ad95bb4f41a None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:52.985604 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62170b-7241-455a-9f0e-b66a6b968172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:52.986190 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62170b-7241-455a-9f0e-b66a6b968172 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:52.986464 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62170b-7241-455a-9f0e-b66a6b968172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:52.986729 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62170b-7241-455a-9f0e-b66a6b968172 admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:52.987341 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62170b-7241-455a-9f0e-b66a6b968172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:52.989242 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62170b-7241-455a-9f0e-b66a6b968172 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:53.017255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1391/2833] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:25:52 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:25:53.021556 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14592c-0715-4d59-8d83-956800f7d5ee admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:53.031545 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14592c-0715-4d59-8d83-956800f7d5ee admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:53.087011 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930355a1-33f4-47f9-948c-d8bf7716361d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:53.087642 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930355a1-33f4-47f9-948c-d8bf7716361d admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:53.087920 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930355a1-33f4-47f9-948c-d8bf7716361d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:53.088196 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930355a1-33f4-47f9-948c-d8bf7716361d admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:53.088815 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930355a1-33f4-47f9-948c-d8bf7716361d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:53.090705 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930355a1-33f4-47f9-948c-d8bf7716361d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:53.111245 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1443/2834] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:25:53 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:25:53.115292 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62170b-7241-455a-9f0e-b66a6b968172 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:53.126266 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62170b-7241-455a-9f0e-b66a6b968172 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:53.130904 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2e401-d552-475e-9b6a-68748dec0b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:53.131518 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2e401-d552-475e-9b6a-68748dec0b84 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:53.131796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2e401-d552-475e-9b6a-68748dec0b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:53.132061 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2e401-d552-475e-9b6a-68748dec0b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:53.132695 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa2e401-d552-475e-9b6a-68748dec0b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:53.134297 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa2e401-d552-475e-9b6a-68748dec0b84 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:53.144474 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1392/2835] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:25:53.148297 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930355a1-33f4-47f9-948c-d8bf7716361d admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:53.158598 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930355a1-33f4-47f9-948c-d8bf7716361d admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:53.163123 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd5e20-50a5-4bbb-92c8-b98174cb3c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:53.163751 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd5e20-50a5-4bbb-92c8-b98174cb3c52 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:53.164026 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd5e20-50a5-4bbb-92c8-b98174cb3c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:53.164292 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd5e20-50a5-4bbb-92c8-b98174cb3c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:53.164924 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd5e20-50a5-4bbb-92c8-b98174cb3c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:53.166508 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd5e20-50a5-4bbb-92c8-b98174cb3c52 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:53.177037 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1444/2836] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:25:53.180969 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2e401-d552-475e-9b6a-68748dec0b84 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:53.191098 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2e401-d552-475e-9b6a-68748dec0b84 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:53.195601 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93620fa-7bf4-4ec6-95e4-f6ec0de67b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:53.196378 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93620fa-7bf4-4ec6-95e4-f6ec0de67b17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:53.196563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93620fa-7bf4-4ec6-95e4-f6ec0de67b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:53.196835 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93620fa-7bf4-4ec6-95e4-f6ec0de67b17 admin admin] PATH_INFO: `/v3/projects/a795d09a77d74447923a0392b8a56c84/users/46da9b3968f34154927934a9352f9244/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:53.205460 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:53.213174 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93620fa-7bf4-4ec6-95e4-f6ec0de67b17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a795d09a77d74447923a0392b8a56c84, user_id=46da9b3968f34154927934a9352f9244, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:53.216117 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93620fa-7bf4-4ec6-95e4-f6ec0de67b17 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:53.228986 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1393/2837] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:25:53 2022] PUT /identity/v3/projects/a795d09a77d74447923a0392b8a56c84/users/46da9b3968f34154927934a9352f9244/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:53.239246 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0ed45-ac06-4501-b2f9-a7376dabde7f None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:53.239602 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0ed45-ac06-4501-b2f9-a7376dabde7f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:53.240080 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0ed45-ac06-4501-b2f9-a7376dabde7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:53.269445 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-73e0ed45-ac06-4501-b2f9-a7376dabde7f None None] MFA Rules not processed for user `46da9b3968f34154927934a9352f9244`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:53.270653 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-73e0ed45-ac06-4501-b2f9-a7376dabde7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:53.333432 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1445/2838] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:25:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:53.337810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93620fa-7bf4-4ec6-95e4-f6ec0de67b17 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:53.398226 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93620fa-7bf4-4ec6-95e4-f6ec0de67b17 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:53.402984 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b38fc-cda3-4770-967e-52f44e0d304d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:53.403551 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b38fc-cda3-4770-967e-52f44e0d304d admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:53.403836 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b38fc-cda3-4770-967e-52f44e0d304d admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:53.404110 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b38fc-cda3-4770-967e-52f44e0d304d admin admin] PATH_INFO: `/v3/projects` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:53.404774 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b38fc-cda3-4770-967e-52f44e0d304d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:53.406654 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b38fc-cda3-4770-967e-52f44e0d304d admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:53.432363 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1394/2839] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:25:53 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:25:53.436401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0ed45-ac06-4501-b2f9-a7376dabde7f None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:53.448509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0ed45-ac06-4501-b2f9-a7376dabde7f None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:53.501385 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:53.508883 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae55e7-a8c9-44a0-bc1e-6db2b75ed00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:53.509493 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae55e7-a8c9-44a0-bc1e-6db2b75ed00f admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:53.509759 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae55e7-a8c9-44a0-bc1e-6db2b75ed00f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:53.510028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae55e7-a8c9-44a0-bc1e-6db2b75ed00f admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:53.510689 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae55e7-a8c9-44a0-bc1e-6db2b75ed00f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:53.512632 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae55e7-a8c9-44a0-bc1e-6db2b75ed00f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:53.534163 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1446/2840] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:25:53 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:25:53.538211 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b38fc-cda3-4770-967e-52f44e0d304d admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:53.548842 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b38fc-cda3-4770-967e-52f44e0d304d admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:53.553501 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fbafc-4d65-4f00-8a38-f506f871c435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:53.554093 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fbafc-4d65-4f00-8a38-f506f871c435 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:53.554371 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fbafc-4d65-4f00-8a38-f506f871c435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:53.554644 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fbafc-4d65-4f00-8a38-f506f871c435 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:53.555294 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0fbafc-4d65-4f00-8a38-f506f871c435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:53.556912 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0fbafc-4d65-4f00-8a38-f506f871c435 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:53.568116 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1395/2841] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:25:53.572166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae55e7-a8c9-44a0-bc1e-6db2b75ed00f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:53.582485 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae55e7-a8c9-44a0-bc1e-6db2b75ed00f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:53.587125 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a1ba4-b20a-4582-8ce2-d1b099793a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:53.587818 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a1ba4-b20a-4582-8ce2-d1b099793a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:53.588095 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a1ba4-b20a-4582-8ce2-d1b099793a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:53.588371 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a1ba4-b20a-4582-8ce2-d1b099793a6a admin admin] PATH_INFO: `/v3/projects/5b9a056da6b145a390b871bba6b39168/users/a42332d330e64929b4805668c4259fa8/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:53.603277 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a1ba4-b20a-4582-8ce2-d1b099793a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b9a056da6b145a390b871bba6b39168, user_id=a42332d330e64929b4805668c4259fa8, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:53.605907 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a1ba4-b20a-4582-8ce2-d1b099793a6a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:53.618431 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1447/2842] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:25:53 2022] PUT /identity/v3/projects/5b9a056da6b145a390b871bba6b39168/users/a42332d330e64929b4805668c4259fa8/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:25:53.622255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fbafc-4d65-4f00-8a38-f506f871c435 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:53.632308 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fbafc-4d65-4f00-8a38-f506f871c435 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:53.687789 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5744f8e-bf8c-473f-abc6-9c0a78c3e5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:53.688308 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5744f8e-bf8c-473f-abc6-9c0a78c3e5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:53.688580 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5744f8e-bf8c-473f-abc6-9c0a78c3e5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:53.688845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5744f8e-bf8c-473f-abc6-9c0a78c3e5e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:53.689472 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5744f8e-bf8c-473f-abc6-9c0a78c3e5e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:53.691034 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5744f8e-bf8c-473f-abc6-9c0a78c3e5e5 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:53.700404 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1396/2843] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:25:53.705247 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a1ba4-b20a-4582-8ce2-d1b099793a6a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:53.715535 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a1ba4-b20a-4582-8ce2-d1b099793a6a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:53.720047 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4de5e-358a-43c5-917b-e256a080e83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:53.720690 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4de5e-358a-43c5-917b-e256a080e83b admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:53.720964 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4de5e-358a-43c5-917b-e256a080e83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:53.721235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4de5e-358a-43c5-917b-e256a080e83b admin admin] PATH_INFO: `/v3/projects/5b9a056da6b145a390b871bba6b39168/users/a42332d330e64929b4805668c4259fa8/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:53.723110 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4de5e-358a-43c5-917b-e256a080e83b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b9a056da6b145a390b871bba6b39168, user_id=a42332d330e64929b4805668c4259fa8, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:53.725738 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4de5e-358a-43c5-917b-e256a080e83b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:53.736325 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1448/2844] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:25:53 2022] PUT /identity/v3/projects/5b9a056da6b145a390b871bba6b39168/users/a42332d330e64929b4805668c4259fa8/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:53.746488 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ca3c9-ca69-498c-b5d3-6bb8f2303109 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:53.746935 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ca3c9-ca69-498c-b5d3-6bb8f2303109 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:53.747032 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ca3c9-ca69-498c-b5d3-6bb8f2303109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:53.775056 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-7e0ca3c9-ca69-498c-b5d3-6bb8f2303109 None None] MFA Rules not processed for user `a42332d330e64929b4805668c4259fa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:53.776280 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-7e0ca3c9-ca69-498c-b5d3-6bb8f2303109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:53.819241 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:53.842817 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1397/2845] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:25:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:53.854878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4de5e-358a-43c5-917b-e256a080e83b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:53.856684 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-76e4de5e-358a-43c5-917b-e256a080e83b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:53.914362 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4de5e-358a-43c5-917b-e256a080e83b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:53.918048 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d8fea-4a60-4e04-a24b-acf2f98d8cc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:53.918639 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d8fea-4a60-4e04-a24b-acf2f98d8cc9 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:53.918921 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d8fea-4a60-4e04-a24b-acf2f98d8cc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:53.919193 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d8fea-4a60-4e04-a24b-acf2f98d8cc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:53.928351 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d8fea-4a60-4e04-a24b-acf2f98d8cc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:53.929761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d8fea-4a60-4e04-a24b-acf2f98d8cc9 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:53.939783 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1449/2846] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:25:53 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:25:54.244765 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ca3c9-ca69-498c-b5d3-6bb8f2303109 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:54.254582 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ca3c9-ca69-498c-b5d3-6bb8f2303109 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:54.259137 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756c52b-5d61-4eee-8e9b-be74bc4bd8ab tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a42332d330e64929b4805668c4259fa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b9a056da6b145a390b871bba6b39168', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:54.259792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756c52b-5d61-4eee-8e9b-be74bc4bd8ab tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:54.260064 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756c52b-5d61-4eee-8e9b-be74bc4bd8ab tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:54.260331 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756c52b-5d61-4eee-8e9b-be74bc4bd8ab tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:54.260966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756c52b-5d61-4eee-8e9b-be74bc4bd8ab tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:25:54.261267 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756c52b-5d61-4eee-8e9b-be74bc4bd8ab tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:54.262839 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756c52b-5d61-4eee-8e9b-be74bc4bd8ab tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:54.274480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1398/2847] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:25:54.279829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d8fea-4a60-4e04-a24b-acf2f98d8cc9 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:54.289071 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d8fea-4a60-4e04-a24b-acf2f98d8cc9 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:54.293686 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041dd842-909c-4901-be95-501018a9880f tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a42332d330e64929b4805668c4259fa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b9a056da6b145a390b871bba6b39168', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:54.294303 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041dd842-909c-4901-be95-501018a9880f tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:54.294586 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041dd842-909c-4901-be95-501018a9880f tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:54.294859 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041dd842-909c-4901-be95-501018a9880f tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:54.295509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041dd842-909c-4901-be95-501018a9880f tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:54.297954 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041dd842-909c-4901-be95-501018a9880f tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:54.327325 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1450/2848] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:25:54 2022] POST /identity/v3/projects => generated 355 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:25:54.328427 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756c52b-5d61-4eee-8e9b-be74bc4bd8ab tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:54.337989 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756c52b-5d61-4eee-8e9b-be74bc4bd8ab tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:54.392312 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198eb5c-af70-44e8-ab8a-1c3f25ed222d tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a42332d330e64929b4805668c4259fa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b9a056da6b145a390b871bba6b39168', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:54.392919 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198eb5c-af70-44e8-ab8a-1c3f25ed222d tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:54.393197 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198eb5c-af70-44e8-ab8a-1c3f25ed222d tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:54.393469 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198eb5c-af70-44e8-ab8a-1c3f25ed222d tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:54.394096 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198eb5c-af70-44e8-ab8a-1c3f25ed222d tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:25:54.394401 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198eb5c-af70-44e8-ab8a-1c3f25ed222d tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:54.396012 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198eb5c-af70-44e8-ab8a-1c3f25ed222d tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:54.408057 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1399/2849] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:25:54.443915 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041dd842-909c-4901-be95-501018a9880f tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:54.454247 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041dd842-909c-4901-be95-501018a9880f tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:54.458929 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11dd708-fe7b-4aa6-92e9-5f1ccb98660d tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a42332d330e64929b4805668c4259fa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b9a056da6b145a390b871bba6b39168', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:54.459420 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11dd708-fe7b-4aa6-92e9-5f1ccb98660d tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:54.459726 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11dd708-fe7b-4aa6-92e9-5f1ccb98660d tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:54.459994 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11dd708-fe7b-4aa6-92e9-5f1ccb98660d tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] PATH_INFO: `/v3/projects/c99c1a84532f49dc870e06dfe47d46bf` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:54.461104 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11dd708-fe7b-4aa6-92e9-5f1ccb98660d tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c99c1a84532f49dc870e06dfe47d46bf)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:54.463039 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11dd708-fe7b-4aa6-92e9-5f1ccb98660d tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:54.509383 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b11dd708-fe7b-4aa6-92e9-5f1ccb98660d tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c99c1a84532f49dc870e06dfe47d46bf', 'request_id': 'req-b11dd708-fe7b-4aa6-92e9-5f1ccb98660d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:54.515010 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b11dd708-fe7b-4aa6-92e9-5f1ccb98660d tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c99c1a84532f49dc870e06dfe47d46bf', 'request_id': 'req-b11dd708-fe7b-4aa6-92e9-5f1ccb98660d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:54.521706 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b11dd708-fe7b-4aa6-92e9-5f1ccb98660d tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c99c1a84532f49dc870e06dfe47d46bf', 'request_id': 'req-b11dd708-fe7b-4aa6-92e9-5f1ccb98660d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:54.534902 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b11dd708-fe7b-4aa6-92e9-5f1ccb98660d tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] The token cache is being invalidate because project c99c1a84532f49dc870e06dfe47d46bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:25:54.535184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b11dd708-fe7b-4aa6-92e9-5f1ccb98660d tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:54.535829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b11dd708-fe7b-4aa6-92e9-5f1ccb98660d tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:54.537301 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1451/2850] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:25:54 2022] DELETE /identity/v3/projects/c99c1a84532f49dc870e06dfe47d46bf => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:54.724434 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198eb5c-af70-44e8-ab8a-1c3f25ed222d tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:54.726142 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b198eb5c-af70-44e8-ab8a-1c3f25ed222d tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:54.789681 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198eb5c-af70-44e8-ab8a-1c3f25ed222d tempest-VolumeQuotaClassesTest-1701299698 tempest-VolumeQuotaClassesTest-1701299698-project-admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:54.842832 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158cf5f-3490-40c9-a887-824b204d48ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:54.844139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158cf5f-3490-40c9-a887-824b204d48ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:54.844416 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158cf5f-3490-40c9-a887-824b204d48ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:54.844684 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158cf5f-3490-40c9-a887-824b204d48ee admin admin] PATH_INFO: `/v3/users/46da9b3968f34154927934a9352f9244` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:54.845797 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158cf5f-3490-40c9-a887-824b204d48ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=46da9b3968f34154927934a9352f9244)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:54.847897 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158cf5f-3490-40c9-a887-824b204d48ee admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:54.859694 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:54.893076 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-5158cf5f-3490-40c9-a887-824b204d48ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46da9b3968f34154927934a9352f9244'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:54.904671 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-5158cf5f-3490-40c9-a887-824b204d48ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46da9b3968f34154927934a9352f9244'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:54.905308 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-5158cf5f-3490-40c9-a887-824b204d48ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46da9b3968f34154927934a9352f9244'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:54.913571 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-5158cf5f-3490-40c9-a887-824b204d48ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46da9b3968f34154927934a9352f9244'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:54.920510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-5158cf5f-3490-40c9-a887-824b204d48ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46da9b3968f34154927934a9352f9244'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:54.926195 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1400/2851] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:25:54 2022] DELETE /identity/v3/users/46da9b3968f34154927934a9352f9244 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:54.930629 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c670e9d-a727-4161-8177-0c7afb55dc06 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:54.931111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c670e9d-a727-4161-8177-0c7afb55dc06 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:54.931233 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c670e9d-a727-4161-8177-0c7afb55dc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:54.950850 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-3c670e9d-a727-4161-8177-0c7afb55dc06 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:54.952205 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3c670e9d-a727-4161-8177-0c7afb55dc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:54.957659 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:55.013384 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1452/2852] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:55.023381 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158cf5f-3490-40c9-a887-824b204d48ee admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:55.024898 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-5158cf5f-3490-40c9-a887-824b204d48ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:55.082904 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158cf5f-3490-40c9-a887-824b204d48ee admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:55.086573 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488ca04-0ded-4c6e-a12e-0e92c3f0973a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:55.087171 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488ca04-0ded-4c6e-a12e-0e92c3f0973a service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:55.087481 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488ca04-0ded-4c6e-a12e-0e92c3f0973a service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:55.087763 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488ca04-0ded-4c6e-a12e-0e92c3f0973a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:55.097236 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488ca04-0ded-4c6e-a12e-0e92c3f0973a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:55.098651 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488ca04-0ded-4c6e-a12e-0e92c3f0973a service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:55.107923 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1401/2853] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:25:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:25:55.379361 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c670e9d-a727-4161-8177-0c7afb55dc06 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:55.380832 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3c670e9d-a727-4161-8177-0c7afb55dc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:55.394951 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c670e9d-a727-4161-8177-0c7afb55dc06 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:55.400290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1ee79-d511-42c7-9176-80b1efa0f418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:55.400860 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1ee79-d511-42c7-9176-80b1efa0f418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:55.401135 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1ee79-d511-42c7-9176-80b1efa0f418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:55.401404 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1ee79-d511-42c7-9176-80b1efa0f418 admin admin] PATH_INFO: `/v3/projects/a795d09a77d74447923a0392b8a56c84` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:55.402561 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1ee79-d511-42c7-9176-80b1efa0f418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a795d09a77d74447923a0392b8a56c84)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:55.404455 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1ee79-d511-42c7-9176-80b1efa0f418 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:55.449610 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-23f1ee79-d511-42c7-9176-80b1efa0f418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a795d09a77d74447923a0392b8a56c84', 'request_id': 'req-23f1ee79-d511-42c7-9176-80b1efa0f418'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:55.455889 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-23f1ee79-d511-42c7-9176-80b1efa0f418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a795d09a77d74447923a0392b8a56c84', 'request_id': 'req-23f1ee79-d511-42c7-9176-80b1efa0f418'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:55.461928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-23f1ee79-d511-42c7-9176-80b1efa0f418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a795d09a77d74447923a0392b8a56c84', 'request_id': 'req-23f1ee79-d511-42c7-9176-80b1efa0f418'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:55.474515 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-23f1ee79-d511-42c7-9176-80b1efa0f418 admin admin] The token cache is being invalidate because project a795d09a77d74447923a0392b8a56c84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:25:55.474831 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-23f1ee79-d511-42c7-9176-80b1efa0f418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:55.475470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-23f1ee79-d511-42c7-9176-80b1efa0f418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:55.477062 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1453/2854] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:25:55 2022] DELETE /identity/v3/projects/a795d09a77d74447923a0392b8a56c84 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:55.481056 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488ca04-0ded-4c6e-a12e-0e92c3f0973a service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:55.499467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488ca04-0ded-4c6e-a12e-0e92c3f0973a service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:55.555352 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15173ae8-3614-4c78-9b68-a2a7330cf5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:55.559857 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15173ae8-3614-4c78-9b68-a2a7330cf5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:55.560137 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15173ae8-3614-4c78-9b68-a2a7330cf5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:55.560408 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15173ae8-3614-4c78-9b68-a2a7330cf5b5 admin admin] PATH_INFO: `/v3/users/a42332d330e64929b4805668c4259fa8` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:55.561563 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15173ae8-3614-4c78-9b68-a2a7330cf5b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a42332d330e64929b4805668c4259fa8)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:55.563565 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15173ae8-3614-4c78-9b68-a2a7330cf5b5 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:55.600963 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:55.612240 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-15173ae8-3614-4c78-9b68-a2a7330cf5b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a42332d330e64929b4805668c4259fa8'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:55.625958 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-15173ae8-3614-4c78-9b68-a2a7330cf5b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a42332d330e64929b4805668c4259fa8'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:55.626612 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-15173ae8-3614-4c78-9b68-a2a7330cf5b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a42332d330e64929b4805668c4259fa8'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:55.633443 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-15173ae8-3614-4c78-9b68-a2a7330cf5b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a42332d330e64929b4805668c4259fa8'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:55.641092 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-15173ae8-3614-4c78-9b68-a2a7330cf5b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a42332d330e64929b4805668c4259fa8'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:55.646870 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1402/2855] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:25:55 2022] DELETE /identity/v3/users/a42332d330e64929b4805668c4259fa8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:55.914699 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1ee79-d511-42c7-9176-80b1efa0f418 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:55.916565 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-23f1ee79-d511-42c7-9176-80b1efa0f418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:55.930458 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1ee79-d511-42c7-9176-80b1efa0f418 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:55.995227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae22b9a-1daa-4e7b-b818-49e0a08676a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:55.995916 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae22b9a-1daa-4e7b-b818-49e0a08676a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:55.996261 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae22b9a-1daa-4e7b-b818-49e0a08676a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:55.996528 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae22b9a-1daa-4e7b-b818-49e0a08676a8 admin admin] PATH_INFO: `/v3/projects/5b9a056da6b145a390b871bba6b39168` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:55.998280 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae22b9a-1daa-4e7b-b818-49e0a08676a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b9a056da6b145a390b871bba6b39168)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:56.000958 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae22b9a-1daa-4e7b-b818-49e0a08676a8 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:56.037814 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:56.047594 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-eae22b9a-1daa-4e7b-b818-49e0a08676a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b9a056da6b145a390b871bba6b39168', 'request_id': 'req-eae22b9a-1daa-4e7b-b818-49e0a08676a8'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:56.053059 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-eae22b9a-1daa-4e7b-b818-49e0a08676a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b9a056da6b145a390b871bba6b39168', 'request_id': 'req-eae22b9a-1daa-4e7b-b818-49e0a08676a8'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:56.059114 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-eae22b9a-1daa-4e7b-b818-49e0a08676a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b9a056da6b145a390b871bba6b39168', 'request_id': 'req-eae22b9a-1daa-4e7b-b818-49e0a08676a8'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:56.071382 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-eae22b9a-1daa-4e7b-b818-49e0a08676a8 admin admin] The token cache is being invalidate because project 5b9a056da6b145a390b871bba6b39168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:25:56.071762 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-eae22b9a-1daa-4e7b-b818-49e0a08676a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:56.072378 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-eae22b9a-1daa-4e7b-b818-49e0a08676a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:56.073817 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1454/2856] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:25:55 2022] DELETE /identity/v3/projects/5b9a056da6b145a390b871bba6b39168 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:56.079306 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be031fea-c4d1-4af2-a703-5b1848e0c54f None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:56.079807 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be031fea-c4d1-4af2-a703-5b1848e0c54f None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:56.079907 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be031fea-c4d1-4af2-a703-5b1848e0c54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:56.100552 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-be031fea-c4d1-4af2-a703-5b1848e0c54f None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:56.101659 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-be031fea-c4d1-4af2-a703-5b1848e0c54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:56.164116 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1403/2857] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:56.224769 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc14b5-4a74-45a9-9296-a90da1b4d14b None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:56.225049 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc14b5-4a74-45a9-9296-a90da1b4d14b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:56.225318 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc14b5-4a74-45a9-9296-a90da1b4d14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:56.245259 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-97bc14b5-4a74-45a9-9296-a90da1b4d14b None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:56.246468 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-97bc14b5-4a74-45a9-9296-a90da1b4d14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:56.255287 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1455/2858] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:56.259782 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be031fea-c4d1-4af2-a703-5b1848e0c54f None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:56.270308 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be031fea-c4d1-4af2-a703-5b1848e0c54f None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:56.274828 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d9054-0a69-4101-b560-39cff528deaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:56.275422 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d9054-0a69-4101-b560-39cff528deaa admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:56.275724 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d9054-0a69-4101-b560-39cff528deaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:56.275990 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d9054-0a69-4101-b560-39cff528deaa admin admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:56.276627 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d9054-0a69-4101-b560-39cff528deaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:25:56.276921 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d9054-0a69-4101-b560-39cff528deaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:56.278615 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d9054-0a69-4101-b560-39cff528deaa admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:56.291162 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1404/2859] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:25:56.295566 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc14b5-4a74-45a9-9296-a90da1b4d14b None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:56.306281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc14b5-4a74-45a9-9296-a90da1b4d14b None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:56.310918 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26682c6c-2c70-4949-8ab6-d33d164d9bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:56.311549 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26682c6c-2c70-4949-8ab6-d33d164d9bfa admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:56.311825 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26682c6c-2c70-4949-8ab6-d33d164d9bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:56.312755 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26682c6c-2c70-4949-8ab6-d33d164d9bfa admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:56.313390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26682c6c-2c70-4949-8ab6-d33d164d9bfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:56.315262 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26682c6c-2c70-4949-8ab6-d33d164d9bfa admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:56.341903 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1456/2860] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:25:56 2022] POST /identity/v3/projects => generated 401 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:25:56.345985 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d9054-0a69-4101-b560-39cff528deaa admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:56.355901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d9054-0a69-4101-b560-39cff528deaa admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:56.410725 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce9413-03eb-4e22-9733-6f31516fb010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:56.411315 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce9413-03eb-4e22-9733-6f31516fb010 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:56.411649 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce9413-03eb-4e22-9733-6f31516fb010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:56.411923 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce9413-03eb-4e22-9733-6f31516fb010 admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:56.412539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce9413-03eb-4e22-9733-6f31516fb010 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:56.414420 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce9413-03eb-4e22-9733-6f31516fb010 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:56.435928 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1405/2861] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:25:56 2022] POST /identity/v3/users => generated 301 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:25:56.440788 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26682c6c-2c70-4949-8ab6-d33d164d9bfa admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:56.451066 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26682c6c-2c70-4949-8ab6-d33d164d9bfa admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:56.456056 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74650460-9f15-41b4-8242-32b7fb0375cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:56.456651 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74650460-9f15-41b4-8242-32b7fb0375cb admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:56.456928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74650460-9f15-41b4-8242-32b7fb0375cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:56.457221 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74650460-9f15-41b4-8242-32b7fb0375cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:56.457852 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74650460-9f15-41b4-8242-32b7fb0375cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:56.459457 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74650460-9f15-41b4-8242-32b7fb0375cb admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:56.469335 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1457/2862] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:25:56.473094 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce9413-03eb-4e22-9733-6f31516fb010 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:56.482986 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce9413-03eb-4e22-9733-6f31516fb010 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:56.488194 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed39e4-44cd-483b-94d9-18a61e5926ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:56.488778 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed39e4-44cd-483b-94d9-18a61e5926ee admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:56.489053 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed39e4-44cd-483b-94d9-18a61e5926ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:56.489318 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed39e4-44cd-483b-94d9-18a61e5926ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:56.489949 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed39e4-44cd-483b-94d9-18a61e5926ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:56.491546 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed39e4-44cd-483b-94d9-18a61e5926ee admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:56.502715 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1406/2863] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:25:56.506831 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74650460-9f15-41b4-8242-32b7fb0375cb admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:56.516939 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74650460-9f15-41b4-8242-32b7fb0375cb admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:56.521700 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa38555-a9a4-4837-860d-d354c705f2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:56.522344 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa38555-a9a4-4837-860d-d354c705f2d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:56.522625 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa38555-a9a4-4837-860d-d354c705f2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:56.522898 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa38555-a9a4-4837-860d-d354c705f2d4 admin admin] PATH_INFO: `/v3/projects/8d1a721fb96b42c4a9a27c27bb6e279a/users/ecfd1bdad91043b8a11ccf5a3f4337fc/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:56.537527 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa38555-a9a4-4837-860d-d354c705f2d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d1a721fb96b42c4a9a27c27bb6e279a, user_id=ecfd1bdad91043b8a11ccf5a3f4337fc, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:56.540190 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa38555-a9a4-4837-860d-d354c705f2d4 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:56.553863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1458/2864] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:25:56 2022] PUT /identity/v3/projects/8d1a721fb96b42c4a9a27c27bb6e279a/users/ecfd1bdad91043b8a11ccf5a3f4337fc/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:56.564312 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851a642-3e67-4169-9532-f21979302249 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:56.564647 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851a642-3e67-4169-9532-f21979302249 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:56.564915 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851a642-3e67-4169-9532-f21979302249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:56.594022 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-3851a642-3e67-4169-9532-f21979302249 None None] MFA Rules not processed for user `ecfd1bdad91043b8a11ccf5a3f4337fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:56.595399 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-3851a642-3e67-4169-9532-f21979302249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:56.600585 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:56.661095 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1407/2865] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:25:56 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:56.665487 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa38555-a9a4-4837-860d-d354c705f2d4 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:56.726761 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa38555-a9a4-4837-860d-d354c705f2d4 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:56.731410 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c16cda-0978-4b7a-81d9-14022eb659b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:56.732035 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c16cda-0978-4b7a-81d9-14022eb659b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:56.732312 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c16cda-0978-4b7a-81d9-14022eb659b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:56.732579 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c16cda-0978-4b7a-81d9-14022eb659b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:56.733213 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c16cda-0978-4b7a-81d9-14022eb659b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:56.735828 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c16cda-0978-4b7a-81d9-14022eb659b6 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:56.762586 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1459/2866] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:25:56 2022] POST /identity/v3/projects => generated 399 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:25:56.766604 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851a642-3e67-4169-9532-f21979302249 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:56.777047 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851a642-3e67-4169-9532-f21979302249 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:56.831739 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a8baf-07a8-403b-a702-8e82e234b396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:56.832344 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a8baf-07a8-403b-a702-8e82e234b396 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:56.832625 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a8baf-07a8-403b-a702-8e82e234b396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:56.832899 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a8baf-07a8-403b-a702-8e82e234b396 admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:56.833551 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a8baf-07a8-403b-a702-8e82e234b396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:56.835488 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a8baf-07a8-403b-a702-8e82e234b396 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:56.856775 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1408/2867] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:25:56 2022] POST /identity/v3/users => generated 306 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:25:56.861371 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c16cda-0978-4b7a-81d9-14022eb659b6 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:56.871590 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c16cda-0978-4b7a-81d9-14022eb659b6 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:56.876493 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95080143-33ae-4abc-b636-3d7239a839c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:56.877087 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95080143-33ae-4abc-b636-3d7239a839c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:56.877366 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95080143-33ae-4abc-b636-3d7239a839c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:56.877640 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95080143-33ae-4abc-b636-3d7239a839c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:56.878280 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95080143-33ae-4abc-b636-3d7239a839c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:56.879909 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95080143-33ae-4abc-b636-3d7239a839c6 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:56.892648 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1460/2868] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:25:56.897830 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a8baf-07a8-403b-a702-8e82e234b396 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:56.908889 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a8baf-07a8-403b-a702-8e82e234b396 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:56.913660 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1f7c0-ec15-418c-97f6-3c8500a0fd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:56.914244 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1f7c0-ec15-418c-97f6-3c8500a0fd3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:56.914523 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1f7c0-ec15-418c-97f6-3c8500a0fd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:56.914795 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1f7c0-ec15-418c-97f6-3c8500a0fd3e admin admin] PATH_INFO: `/v3/projects/a095b45e33644e81834bd08e0b0ae92f/users/2cbd812be6fb4394be981f1510f9c0f5/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:56.929650 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1f7c0-ec15-418c-97f6-3c8500a0fd3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a095b45e33644e81834bd08e0b0ae92f, user_id=2cbd812be6fb4394be981f1510f9c0f5, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:56.932320 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1f7c0-ec15-418c-97f6-3c8500a0fd3e admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:56.945169 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1409/2869] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:25:56 2022] PUT /identity/v3/projects/a095b45e33644e81834bd08e0b0ae92f/users/2cbd812be6fb4394be981f1510f9c0f5/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:56.949064 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95080143-33ae-4abc-b636-3d7239a839c6 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:56.959543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95080143-33ae-4abc-b636-3d7239a839c6 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:56.992265 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:57.018278 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172e0fe-e366-43a6-8723-8bbecbe51473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:57.018927 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172e0fe-e366-43a6-8723-8bbecbe51473 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:57.019148 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172e0fe-e366-43a6-8723-8bbecbe51473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:57.019416 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172e0fe-e366-43a6-8723-8bbecbe51473 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:57.020068 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172e0fe-e366-43a6-8723-8bbecbe51473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:57.021647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172e0fe-e366-43a6-8723-8bbecbe51473 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:57.031779 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1461/2870] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:25:57.035903 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1f7c0-ec15-418c-97f6-3c8500a0fd3e admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:57.046139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1f7c0-ec15-418c-97f6-3c8500a0fd3e admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:57.050804 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e34a67-bf87-44c9-ab6a-4082f2f63606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:57.051455 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e34a67-bf87-44c9-ab6a-4082f2f63606 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:57.051746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e34a67-bf87-44c9-ab6a-4082f2f63606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:57.052019 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e34a67-bf87-44c9-ab6a-4082f2f63606 admin admin] PATH_INFO: `/v3/projects/a095b45e33644e81834bd08e0b0ae92f/users/2cbd812be6fb4394be981f1510f9c0f5/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:57.053903 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e34a67-bf87-44c9-ab6a-4082f2f63606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a095b45e33644e81834bd08e0b0ae92f, user_id=2cbd812be6fb4394be981f1510f9c0f5, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:57.056539 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e34a67-bf87-44c9-ab6a-4082f2f63606 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:57.066470 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1410/2871] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:25:57 2022] PUT /identity/v3/projects/a095b45e33644e81834bd08e0b0ae92f/users/2cbd812be6fb4394be981f1510f9c0f5/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:57.077314 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f79c7-dbc7-4780-94f5-b9de0f648945 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:57.078150 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f79c7-dbc7-4780-94f5-b9de0f648945 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:57.078405 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f79c7-dbc7-4780-94f5-b9de0f648945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:57.105906 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-9b1f79c7-dbc7-4780-94f5-b9de0f648945 None None] MFA Rules not processed for user `2cbd812be6fb4394be981f1510f9c0f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:57.107134 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9b1f79c7-dbc7-4780-94f5-b9de0f648945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:57.176019 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1462/2872] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:25:57 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:57.186402 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e34a67-bf87-44c9-ab6a-4082f2f63606 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:57.188203 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-22e34a67-bf87-44c9-ab6a-4082f2f63606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:57.246237 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e34a67-bf87-44c9-ab6a-4082f2f63606 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:57.250250 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707159f-7e78-4559-a7ad-c06afa2cf6df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:57.250843 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707159f-7e78-4559-a7ad-c06afa2cf6df service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:57.251116 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707159f-7e78-4559-a7ad-c06afa2cf6df service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:57.251382 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707159f-7e78-4559-a7ad-c06afa2cf6df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:57.260212 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707159f-7e78-4559-a7ad-c06afa2cf6df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:57.261623 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707159f-7e78-4559-a7ad-c06afa2cf6df service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:57.271964 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1411/2873] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:25:57 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:25:57.347737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f79c7-dbc7-4780-94f5-b9de0f648945 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:57.357829 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f79c7-dbc7-4780-94f5-b9de0f648945 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:57.361394 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c34890-da10-4b6d-b59d-1aa4888ac695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:57.361990 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c34890-da10-4b6d-b59d-1aa4888ac695 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:57.362268 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c34890-da10-4b6d-b59d-1aa4888ac695 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:57.362538 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c34890-da10-4b6d-b59d-1aa4888ac695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:57.418374 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c34890-da10-4b6d-b59d-1aa4888ac695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:57.419754 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c34890-da10-4b6d-b59d-1aa4888ac695 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:57.428537 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1463/2874] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:25:57 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:26:01.659472 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707159f-7e78-4559-a7ad-c06afa2cf6df service cinder] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:01.663632 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:01.722928 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707159f-7e78-4559-a7ad-c06afa2cf6df service cinder] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:01.727480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376e37f-bf5b-4c3e-acd0-9c355a87f69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:01.728104 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376e37f-bf5b-4c3e-acd0-9c355a87f69b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:01.728383 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376e37f-bf5b-4c3e-acd0-9c355a87f69b admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:01.728655 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376e37f-bf5b-4c3e-acd0-9c355a87f69b admin admin] PATH_INFO: `/v3/users/ecfd1bdad91043b8a11ccf5a3f4337fc` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:01.729803 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376e37f-bf5b-4c3e-acd0-9c355a87f69b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecfd1bdad91043b8a11ccf5a3f4337fc)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:01.731729 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376e37f-bf5b-4c3e-acd0-9c355a87f69b admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:01.782614 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-d376e37f-bf5b-4c3e-acd0-9c355a87f69b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecfd1bdad91043b8a11ccf5a3f4337fc'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:01.794309 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-d376e37f-bf5b-4c3e-acd0-9c355a87f69b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecfd1bdad91043b8a11ccf5a3f4337fc'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:01.794996 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-d376e37f-bf5b-4c3e-acd0-9c355a87f69b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecfd1bdad91043b8a11ccf5a3f4337fc'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:01.802710 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-d376e37f-bf5b-4c3e-acd0-9c355a87f69b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecfd1bdad91043b8a11ccf5a3f4337fc'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:01.809874 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-d376e37f-bf5b-4c3e-acd0-9c355a87f69b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecfd1bdad91043b8a11ccf5a3f4337fc'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:01.816257 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1412/2875] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:26:01 2022] DELETE /identity/v3/users/ecfd1bdad91043b8a11ccf5a3f4337fc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:26:01.820690 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bc56b-c437-4612-af46-9774c95a8dde None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:01.821186 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bc56b-c437-4612-af46-9774c95a8dde None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:01.821302 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bc56b-c437-4612-af46-9774c95a8dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:01.839957 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-e45bc56b-c437-4612-af46-9774c95a8dde None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:26:01.841150 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e45bc56b-c437-4612-af46-9774c95a8dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:01.888047 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:01.899753 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1464/2876] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:26:01.909666 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376e37f-bf5b-4c3e-acd0-9c355a87f69b admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:01.911057 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-d376e37f-bf5b-4c3e-acd0-9c355a87f69b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:01.967101 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376e37f-bf5b-4c3e-acd0-9c355a87f69b admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:01.971204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41bb02-0f14-4f05-a764-6068e0486770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:01.971845 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41bb02-0f14-4f05-a764-6068e0486770 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:01.972115 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41bb02-0f14-4f05-a764-6068e0486770 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:01.972382 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41bb02-0f14-4f05-a764-6068e0486770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:01.981155 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41bb02-0f14-4f05-a764-6068e0486770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:01.982555 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41bb02-0f14-4f05-a764-6068e0486770 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:01.992619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1413/2877] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:26:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:26:02.256946 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bc56b-c437-4612-af46-9774c95a8dde None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:02.258435 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e45bc56b-c437-4612-af46-9774c95a8dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:02.273109 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bc56b-c437-4612-af46-9774c95a8dde None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:02.278125 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ac325-31b8-4668-81a0-be3fa880b7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:02.278930 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ac325-31b8-4668-81a0-be3fa880b7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:02.279208 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ac325-31b8-4668-81a0-be3fa880b7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:02.279697 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ac325-31b8-4668-81a0-be3fa880b7d9 admin admin] PATH_INFO: `/v3/projects/8d1a721fb96b42c4a9a27c27bb6e279a` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:02.280646 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ac325-31b8-4668-81a0-be3fa880b7d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d1a721fb96b42c4a9a27c27bb6e279a)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:02.282647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ac325-31b8-4668-81a0-be3fa880b7d9 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:02.328367 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9b3ac325-31b8-4668-81a0-be3fa880b7d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d1a721fb96b42c4a9a27c27bb6e279a', 'request_id': 'req-9b3ac325-31b8-4668-81a0-be3fa880b7d9'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:02.333896 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9b3ac325-31b8-4668-81a0-be3fa880b7d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d1a721fb96b42c4a9a27c27bb6e279a', 'request_id': 'req-9b3ac325-31b8-4668-81a0-be3fa880b7d9'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:02.339908 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9b3ac325-31b8-4668-81a0-be3fa880b7d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d1a721fb96b42c4a9a27c27bb6e279a', 'request_id': 'req-9b3ac325-31b8-4668-81a0-be3fa880b7d9'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:02.352760 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9b3ac325-31b8-4668-81a0-be3fa880b7d9 admin admin] The token cache is being invalidate because project 8d1a721fb96b42c4a9a27c27bb6e279a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:26:02.353126 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9b3ac325-31b8-4668-81a0-be3fa880b7d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:02.353869 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9b3ac325-31b8-4668-81a0-be3fa880b7d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:02.355322 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1465/2878] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:26:02 2022] DELETE /identity/v3/projects/8d1a721fb96b42c4a9a27c27bb6e279a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:26:02.360107 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41bb02-0f14-4f05-a764-6068e0486770 service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:02.369520 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41bb02-0f14-4f05-a764-6068e0486770 service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:02.389363 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:02.427084 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94e5f6-4d8d-4799-ab89-cee0505aa16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:02.427775 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94e5f6-4d8d-4799-ab89-cee0505aa16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:02.428039 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94e5f6-4d8d-4799-ab89-cee0505aa16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:02.428304 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94e5f6-4d8d-4799-ab89-cee0505aa16e admin admin] PATH_INFO: `/v3/users/2cbd812be6fb4394be981f1510f9c0f5` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:02.429403 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94e5f6-4d8d-4799-ab89-cee0505aa16e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cbd812be6fb4394be981f1510f9c0f5)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:02.431342 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94e5f6-4d8d-4799-ab89-cee0505aa16e admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:02.476206 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4c94e5f6-4d8d-4799-ab89-cee0505aa16e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cbd812be6fb4394be981f1510f9c0f5'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:02.489462 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4c94e5f6-4d8d-4799-ab89-cee0505aa16e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cbd812be6fb4394be981f1510f9c0f5'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:02.490122 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4c94e5f6-4d8d-4799-ab89-cee0505aa16e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cbd812be6fb4394be981f1510f9c0f5'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:02.497149 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4c94e5f6-4d8d-4799-ab89-cee0505aa16e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cbd812be6fb4394be981f1510f9c0f5'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:02.504959 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-4c94e5f6-4d8d-4799-ab89-cee0505aa16e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cbd812be6fb4394be981f1510f9c0f5'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:02.510860 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1414/2879] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:26:02 2022] DELETE /identity/v3/users/2cbd812be6fb4394be981f1510f9c0f5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:26:02.775505 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ac325-31b8-4668-81a0-be3fa880b7d9 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:02.776946 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9b3ac325-31b8-4668-81a0-be3fa880b7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:02.791591 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ac325-31b8-4668-81a0-be3fa880b7d9 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:02.848932 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7564e80-3600-4ef8-a651-e69be5996f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:02.849552 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7564e80-3600-4ef8-a651-e69be5996f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:02.849824 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7564e80-3600-4ef8-a651-e69be5996f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:02.850095 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7564e80-3600-4ef8-a651-e69be5996f02 admin admin] PATH_INFO: `/v3/projects/a095b45e33644e81834bd08e0b0ae92f` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:02.851199 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7564e80-3600-4ef8-a651-e69be5996f02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a095b45e33644e81834bd08e0b0ae92f)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:02.853116 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7564e80-3600-4ef8-a651-e69be5996f02 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:02.898718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a7564e80-3600-4ef8-a651-e69be5996f02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a095b45e33644e81834bd08e0b0ae92f', 'request_id': 'req-a7564e80-3600-4ef8-a651-e69be5996f02'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:02.904436 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a7564e80-3600-4ef8-a651-e69be5996f02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a095b45e33644e81834bd08e0b0ae92f', 'request_id': 'req-a7564e80-3600-4ef8-a651-e69be5996f02'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:02.911184 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a7564e80-3600-4ef8-a651-e69be5996f02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a095b45e33644e81834bd08e0b0ae92f', 'request_id': 'req-a7564e80-3600-4ef8-a651-e69be5996f02'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:02.925557 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a7564e80-3600-4ef8-a651-e69be5996f02 admin admin] The token cache is being invalidate because project a095b45e33644e81834bd08e0b0ae92f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:26:02.925845 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a7564e80-3600-4ef8-a651-e69be5996f02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:02.926467 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a7564e80-3600-4ef8-a651-e69be5996f02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:02.927983 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1466/2880] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:26:02 2022] DELETE /identity/v3/projects/a095b45e33644e81834bd08e0b0ae92f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:26:02.932802 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f37601-83a7-4bb2-aa86-b4a33e28a4d8 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:02.933271 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f37601-83a7-4bb2-aa86-b4a33e28a4d8 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:02.933369 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f37601-83a7-4bb2-aa86-b4a33e28a4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:02.953138 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-78f37601-83a7-4bb2-aa86-b4a33e28a4d8 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:26:02.954255 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-78f37601-83a7-4bb2-aa86-b4a33e28a4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:03.013967 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1415/2881] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:26:03.021632 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e7cc4-0f39-442a-8b8b-534cd3210262 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:03.021920 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e7cc4-0f39-442a-8b8b-534cd3210262 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:03.022193 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e7cc4-0f39-442a-8b8b-534cd3210262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:03.042143 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-1c3e7cc4-0f39-442a-8b8b-534cd3210262 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:26:03.043336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-1c3e7cc4-0f39-442a-8b8b-534cd3210262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:03.052089 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1467/2882] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:26:03.056223 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f37601-83a7-4bb2-aa86-b4a33e28a4d8 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:03.065865 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f37601-83a7-4bb2-aa86-b4a33e28a4d8 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:03.070436 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc1813-a55c-4872-8835-895f0111049b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:03.071027 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc1813-a55c-4872-8835-895f0111049b admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:03.071307 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc1813-a55c-4872-8835-895f0111049b admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:03.071619 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc1813-a55c-4872-8835-895f0111049b admin admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:03.072259 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc1813-a55c-4872-8835-895f0111049b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:26:03.072583 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc1813-a55c-4872-8835-895f0111049b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:03.074170 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc1813-a55c-4872-8835-895f0111049b admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:03.085970 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1416/2883] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:26:03.090204 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e7cc4-0f39-442a-8b8b-534cd3210262 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:03.095109 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:03.101342 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e7cc4-0f39-442a-8b8b-534cd3210262 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:03.107002 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac325e8a-3e9d-40df-922c-239926813fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:03.107660 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac325e8a-3e9d-40df-922c-239926813fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:03.107947 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac325e8a-3e9d-40df-922c-239926813fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:03.108212 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac325e8a-3e9d-40df-922c-239926813fa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:03.108901 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac325e8a-3e9d-40df-922c-239926813fa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:03.110814 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac325e8a-3e9d-40df-922c-239926813fa1 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:03.137732 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1468/2884] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:26:03 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:26:03.142363 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc1813-a55c-4872-8835-895f0111049b admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:03.152144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc1813-a55c-4872-8835-895f0111049b admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:03.180333 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:03.209115 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648fc3c-5bac-4061-b96b-40b90aa16682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:03.209639 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648fc3c-5bac-4061-b96b-40b90aa16682 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:03.209916 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648fc3c-5bac-4061-b96b-40b90aa16682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:03.210185 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648fc3c-5bac-4061-b96b-40b90aa16682 admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:03.210821 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648fc3c-5bac-4061-b96b-40b90aa16682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:03.212777 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648fc3c-5bac-4061-b96b-40b90aa16682 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:03.232599 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1417/2885] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:26:03 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:26:03.237142 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac325e8a-3e9d-40df-922c-239926813fa1 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:03.247153 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac325e8a-3e9d-40df-922c-239926813fa1 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:03.252000 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2d722-330c-4c7e-9b5e-de465af26cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:03.252586 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2d722-330c-4c7e-9b5e-de465af26cab admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:03.252862 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2d722-330c-4c7e-9b5e-de465af26cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:03.253128 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2d722-330c-4c7e-9b5e-de465af26cab admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:03.253756 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2d722-330c-4c7e-9b5e-de465af26cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:03.255325 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2d722-330c-4c7e-9b5e-de465af26cab admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:03.265816 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1469/2886] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:26:03.269672 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648fc3c-5bac-4061-b96b-40b90aa16682 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:03.279665 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648fc3c-5bac-4061-b96b-40b90aa16682 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:03.284283 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e44e9f-f30b-4b14-9b2d-3a6698c8fbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:03.284861 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e44e9f-f30b-4b14-9b2d-3a6698c8fbb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:03.285137 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e44e9f-f30b-4b14-9b2d-3a6698c8fbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:03.285395 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e44e9f-f30b-4b14-9b2d-3a6698c8fbb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:03.286029 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e44e9f-f30b-4b14-9b2d-3a6698c8fbb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:03.287626 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e44e9f-f30b-4b14-9b2d-3a6698c8fbb1 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:03.298670 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1418/2887] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:26:03.302462 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2d722-330c-4c7e-9b5e-de465af26cab admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:03.312387 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2d722-330c-4c7e-9b5e-de465af26cab admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:03.317084 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79715461-4ff0-4ff8-b202-feab1fd99186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:03.317718 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79715461-4ff0-4ff8-b202-feab1fd99186 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:03.317995 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79715461-4ff0-4ff8-b202-feab1fd99186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:03.318265 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79715461-4ff0-4ff8-b202-feab1fd99186 admin admin] PATH_INFO: `/v3/projects/5fde5a31dcee48d18fde7692127f7120/users/f57287c2e3124e5f9f8cbdba535c9d63/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:03.333318 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79715461-4ff0-4ff8-b202-feab1fd99186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fde5a31dcee48d18fde7692127f7120, user_id=f57287c2e3124e5f9f8cbdba535c9d63, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:03.336100 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79715461-4ff0-4ff8-b202-feab1fd99186 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:03.349481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1470/2888] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:26:03 2022] PUT /identity/v3/projects/5fde5a31dcee48d18fde7692127f7120/users/f57287c2e3124e5f9f8cbdba535c9d63/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:26:03.359659 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6473b7f-4d75-4d84-9c24-fd6742aa39c6 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:03.360141 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6473b7f-4d75-4d84-9c24-fd6742aa39c6 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:03.360469 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6473b7f-4d75-4d84-9c24-fd6742aa39c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:03.387391 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-b6473b7f-4d75-4d84-9c24-fd6742aa39c6 None None] MFA Rules not processed for user `f57287c2e3124e5f9f8cbdba535c9d63`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:26:03.388624 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-b6473b7f-4d75-4d84-9c24-fd6742aa39c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:03.451194 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1419/2889] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:26:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:26:03.456181 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79715461-4ff0-4ff8-b202-feab1fd99186 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:03.517711 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79715461-4ff0-4ff8-b202-feab1fd99186 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:03.522322 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a273e98-830e-4aed-af83-85827465c44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:03.522913 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a273e98-830e-4aed-af83-85827465c44a admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:03.523188 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a273e98-830e-4aed-af83-85827465c44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:03.523481 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a273e98-830e-4aed-af83-85827465c44a admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:03.524111 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a273e98-830e-4aed-af83-85827465c44a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:03.525991 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a273e98-830e-4aed-af83-85827465c44a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:03.551448 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1471/2890] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:26:03 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:26:03.555489 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6473b7f-4d75-4d84-9c24-fd6742aa39c6 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:03.567326 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6473b7f-4d75-4d84-9c24-fd6742aa39c6 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:03.622305 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7871d6b-0cae-411b-9d11-edbfebfb301c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:03.622938 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7871d6b-0cae-411b-9d11-edbfebfb301c admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:03.623521 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7871d6b-0cae-411b-9d11-edbfebfb301c admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:03.623797 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7871d6b-0cae-411b-9d11-edbfebfb301c admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:03.624963 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7871d6b-0cae-411b-9d11-edbfebfb301c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:03.627244 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7871d6b-0cae-411b-9d11-edbfebfb301c admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:03.647979 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1420/2891] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:26:03 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:26:03.652143 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a273e98-830e-4aed-af83-85827465c44a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:03.662647 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a273e98-830e-4aed-af83-85827465c44a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:03.667406 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3502535-6e1a-4d15-bf51-8148a2250398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:03.668036 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3502535-6e1a-4d15-bf51-8148a2250398 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:03.668336 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3502535-6e1a-4d15-bf51-8148a2250398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:03.668589 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3502535-6e1a-4d15-bf51-8148a2250398 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:03.669232 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3502535-6e1a-4d15-bf51-8148a2250398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:03.670813 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3502535-6e1a-4d15-bf51-8148a2250398 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:03.684710 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1472/2892] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:26:03.685664 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7871d6b-0cae-411b-9d11-edbfebfb301c admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:03.696249 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7871d6b-0cae-411b-9d11-edbfebfb301c admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:03.706207 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f89aab-9b5e-4e51-90d3-e0a333342d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:03.706952 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f89aab-9b5e-4e51-90d3-e0a333342d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:03.707146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f89aab-9b5e-4e51-90d3-e0a333342d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:03.707417 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f89aab-9b5e-4e51-90d3-e0a333342d4c admin admin] PATH_INFO: `/v3/projects/cc49f9bf03974fdd9483c1584a60859b/users/8587ba72345444c090b350f0bb2e8fcf/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:03.722531 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f89aab-9b5e-4e51-90d3-e0a333342d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc49f9bf03974fdd9483c1584a60859b, user_id=8587ba72345444c090b350f0bb2e8fcf, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:03.725208 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f89aab-9b5e-4e51-90d3-e0a333342d4c admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:03.738167 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1421/2893] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:26:03 2022] PUT /identity/v3/projects/cc49f9bf03974fdd9483c1584a60859b/users/8587ba72345444c090b350f0bb2e8fcf/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:26:03.742162 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3502535-6e1a-4d15-bf51-8148a2250398 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:03.753065 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3502535-6e1a-4d15-bf51-8148a2250398 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:03.810254 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca2008-6c2e-4ca0-98c7-202314ccbe96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:03.810783 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca2008-6c2e-4ca0-98c7-202314ccbe96 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:03.811062 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca2008-6c2e-4ca0-98c7-202314ccbe96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:03.811330 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca2008-6c2e-4ca0-98c7-202314ccbe96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:03.812036 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca2008-6c2e-4ca0-98c7-202314ccbe96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:03.813603 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca2008-6c2e-4ca0-98c7-202314ccbe96 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:03.823462 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1473/2894] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:26:03.828114 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f89aab-9b5e-4e51-90d3-e0a333342d4c admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:03.834794 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:03.838892 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f89aab-9b5e-4e51-90d3-e0a333342d4c admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:03.845249 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0ad9d-9e1d-4990-b637-755de75cc9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:03.845892 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0ad9d-9e1d-4990-b637-755de75cc9af admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:03.846169 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0ad9d-9e1d-4990-b637-755de75cc9af admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:03.846466 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0ad9d-9e1d-4990-b637-755de75cc9af admin admin] PATH_INFO: `/v3/projects/cc49f9bf03974fdd9483c1584a60859b/users/8587ba72345444c090b350f0bb2e8fcf/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:03.848444 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0ad9d-9e1d-4990-b637-755de75cc9af admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc49f9bf03974fdd9483c1584a60859b, user_id=8587ba72345444c090b350f0bb2e8fcf, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:03.851066 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0ad9d-9e1d-4990-b637-755de75cc9af admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:03.861159 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1422/2895] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:26:03 2022] PUT /identity/v3/projects/cc49f9bf03974fdd9483c1584a60859b/users/8587ba72345444c090b350f0bb2e8fcf/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:26:03.872812 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f16f3-cfb4-492c-abd8-093953103800 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:03.873562 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f16f3-cfb4-492c-abd8-093953103800 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:03.873663 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f16f3-cfb4-492c-abd8-093953103800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:03.902047 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-f28f16f3-cfb4-492c-abd8-093953103800 None None] MFA Rules not processed for user `8587ba72345444c090b350f0bb2e8fcf`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:26:03.903290 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f28f16f3-cfb4-492c-abd8-093953103800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:03.908075 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:03.972878 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1474/2896] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:26:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:26:03.984146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0ad9d-9e1d-4990-b637-755de75cc9af admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:03.985907 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-0bc0ad9d-9e1d-4990-b637-755de75cc9af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:04.044519 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0ad9d-9e1d-4990-b637-755de75cc9af admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:04.048214 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca98175-2d0e-4fb9-b2b4-68dec07206e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:04.048814 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca98175-2d0e-4fb9-b2b4-68dec07206e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:04.049093 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca98175-2d0e-4fb9-b2b4-68dec07206e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:04.049362 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca98175-2d0e-4fb9-b2b4-68dec07206e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:04.058235 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca98175-2d0e-4fb9-b2b4-68dec07206e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:04.059679 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca98175-2d0e-4fb9-b2b4-68dec07206e1 service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:04.069050 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1423/2897] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:26:03 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:26:04.152800 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f16f3-cfb4-492c-abd8-093953103800 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:04.163309 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f16f3-cfb4-492c-abd8-093953103800 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:04.166904 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba665b-311b-4479-ab42-d50a96966124 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:04.167554 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba665b-311b-4479-ab42-d50a96966124 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:04.167835 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba665b-311b-4479-ab42-d50a96966124 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:04.168104 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba665b-311b-4479-ab42-d50a96966124 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:04.223717 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba665b-311b-4479-ab42-d50a96966124 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:04.225150 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba665b-311b-4479-ab42-d50a96966124 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:04.234147 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1475/2898] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:26:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:26:08.928043 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca98175-2d0e-4fb9-b2b4-68dec07206e1 service cinder] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:08.990467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca98175-2d0e-4fb9-b2b4-68dec07206e1 service cinder] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:08.994966 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb6aa7-c957-486e-b102-e242684ef0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:08.995625 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb6aa7-c957-486e-b102-e242684ef0f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:08.995908 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb6aa7-c957-486e-b102-e242684ef0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:08.996182 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb6aa7-c957-486e-b102-e242684ef0f9 admin admin] PATH_INFO: `/v3/users/f57287c2e3124e5f9f8cbdba535c9d63` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:08.997301 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb6aa7-c957-486e-b102-e242684ef0f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f57287c2e3124e5f9f8cbdba535c9d63)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:09.000043 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb6aa7-c957-486e-b102-e242684ef0f9 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:09.046598 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-42eb6aa7-c957-486e-b102-e242684ef0f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f57287c2e3124e5f9f8cbdba535c9d63'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:09.058335 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-42eb6aa7-c957-486e-b102-e242684ef0f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f57287c2e3124e5f9f8cbdba535c9d63'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:09.059000 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-42eb6aa7-c957-486e-b102-e242684ef0f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f57287c2e3124e5f9f8cbdba535c9d63'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:09.066796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-42eb6aa7-c957-486e-b102-e242684ef0f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f57287c2e3124e5f9f8cbdba535c9d63'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:09.073719 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-42eb6aa7-c957-486e-b102-e242684ef0f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f57287c2e3124e5f9f8cbdba535c9d63'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:09.079534 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1424/2899] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:26:08 2022] DELETE /identity/v3/users/f57287c2e3124e5f9f8cbdba535c9d63 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:26:09.084028 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f78e1a-81b3-4d6c-83f8-5fd881188a49 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:09.084489 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f78e1a-81b3-4d6c-83f8-5fd881188a49 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:09.084588 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f78e1a-81b3-4d6c-83f8-5fd881188a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:09.103238 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-74f78e1a-81b3-4d6c-83f8-5fd881188a49 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:26:09.104503 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-74f78e1a-81b3-4d6c-83f8-5fd881188a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:09.162694 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1476/2900] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:26:09.172754 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb6aa7-c957-486e-b102-e242684ef0f9 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:09.174180 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-42eb6aa7-c957-486e-b102-e242684ef0f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:09.188729 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:09.231152 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb6aa7-c957-486e-b102-e242684ef0f9 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:09.235349 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36df771-c729-4383-9a54-6c14ab58c036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:09.235971 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36df771-c729-4383-9a54-6c14ab58c036 service neutron] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:09.236244 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36df771-c729-4383-9a54-6c14ab58c036 service neutron] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:09.236510 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36df771-c729-4383-9a54-6c14ab58c036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:09.245504 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36df771-c729-4383-9a54-6c14ab58c036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:09.247017 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36df771-c729-4383-9a54-6c14ab58c036 service neutron] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:09.257509 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1425/2901] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:26:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:26:09.514113 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f78e1a-81b3-4d6c-83f8-5fd881188a49 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:09.515602 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-74f78e1a-81b3-4d6c-83f8-5fd881188a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:09.529165 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f78e1a-81b3-4d6c-83f8-5fd881188a49 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:09.534304 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58364763-44f0-4fc3-a871-7cff23bb728b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:09.535485 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58364763-44f0-4fc3-a871-7cff23bb728b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:09.535942 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58364763-44f0-4fc3-a871-7cff23bb728b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:09.536225 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58364763-44f0-4fc3-a871-7cff23bb728b admin admin] PATH_INFO: `/v3/projects/5fde5a31dcee48d18fde7692127f7120` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:09.537385 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58364763-44f0-4fc3-a871-7cff23bb728b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fde5a31dcee48d18fde7692127f7120)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:09.539282 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58364763-44f0-4fc3-a871-7cff23bb728b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:09.577288 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:09.588529 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-58364763-44f0-4fc3-a871-7cff23bb728b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fde5a31dcee48d18fde7692127f7120', 'request_id': 'req-58364763-44f0-4fc3-a871-7cff23bb728b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:09.594563 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-58364763-44f0-4fc3-a871-7cff23bb728b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fde5a31dcee48d18fde7692127f7120', 'request_id': 'req-58364763-44f0-4fc3-a871-7cff23bb728b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:09.600630 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-58364763-44f0-4fc3-a871-7cff23bb728b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fde5a31dcee48d18fde7692127f7120', 'request_id': 'req-58364763-44f0-4fc3-a871-7cff23bb728b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:09.613031 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-58364763-44f0-4fc3-a871-7cff23bb728b admin admin] The token cache is being invalidate because project 5fde5a31dcee48d18fde7692127f7120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:26:09.613319 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-58364763-44f0-4fc3-a871-7cff23bb728b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:09.613930 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-58364763-44f0-4fc3-a871-7cff23bb728b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:09.615466 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1477/2902] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:26:09 2022] DELETE /identity/v3/projects/5fde5a31dcee48d18fde7692127f7120 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:26:09.619415 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36df771-c729-4383-9a54-6c14ab58c036 service neutron] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:09.629294 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36df771-c729-4383-9a54-6c14ab58c036 service neutron] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:09.683554 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b3ef8-cf67-4dfc-9655-08b9a32a878b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:09.684173 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b3ef8-cf67-4dfc-9655-08b9a32a878b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:09.684448 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b3ef8-cf67-4dfc-9655-08b9a32a878b admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:09.684719 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b3ef8-cf67-4dfc-9655-08b9a32a878b admin admin] PATH_INFO: `/v3/users/8587ba72345444c090b350f0bb2e8fcf` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:09.685814 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b3ef8-cf67-4dfc-9655-08b9a32a878b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8587ba72345444c090b350f0bb2e8fcf)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:09.688313 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b3ef8-cf67-4dfc-9655-08b9a32a878b admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:09.733102 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-512b3ef8-cf67-4dfc-9655-08b9a32a878b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8587ba72345444c090b350f0bb2e8fcf'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:09.744948 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-512b3ef8-cf67-4dfc-9655-08b9a32a878b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8587ba72345444c090b350f0bb2e8fcf'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:09.745637 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-512b3ef8-cf67-4dfc-9655-08b9a32a878b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8587ba72345444c090b350f0bb2e8fcf'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:09.753575 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-512b3ef8-cf67-4dfc-9655-08b9a32a878b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8587ba72345444c090b350f0bb2e8fcf'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:09.760621 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-512b3ef8-cf67-4dfc-9655-08b9a32a878b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8587ba72345444c090b350f0bb2e8fcf'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:09.766935 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1426/2903] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:26:09 2022] DELETE /identity/v3/users/8587ba72345444c090b350f0bb2e8fcf => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:26:10.033281 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58364763-44f0-4fc3-a871-7cff23bb728b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:10.034796 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-58364763-44f0-4fc3-a871-7cff23bb728b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:10.048315 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58364763-44f0-4fc3-a871-7cff23bb728b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:10.106102 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab41f4-55f6-4caa-b9fb-2921b894dc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:10.106790 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab41f4-55f6-4caa-b9fb-2921b894dc11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:10.106990 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab41f4-55f6-4caa-b9fb-2921b894dc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:10.107258 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab41f4-55f6-4caa-b9fb-2921b894dc11 admin admin] PATH_INFO: `/v3/projects/cc49f9bf03974fdd9483c1584a60859b` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:10.108985 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab41f4-55f6-4caa-b9fb-2921b894dc11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc49f9bf03974fdd9483c1584a60859b)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:10.110871 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab41f4-55f6-4caa-b9fb-2921b894dc11 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:10.157551 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-27ab41f4-55f6-4caa-b9fb-2921b894dc11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc49f9bf03974fdd9483c1584a60859b', 'request_id': 'req-27ab41f4-55f6-4caa-b9fb-2921b894dc11'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:10.163052 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-27ab41f4-55f6-4caa-b9fb-2921b894dc11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc49f9bf03974fdd9483c1584a60859b', 'request_id': 'req-27ab41f4-55f6-4caa-b9fb-2921b894dc11'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:10.169278 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-27ab41f4-55f6-4caa-b9fb-2921b894dc11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc49f9bf03974fdd9483c1584a60859b', 'request_id': 'req-27ab41f4-55f6-4caa-b9fb-2921b894dc11'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:10.184528 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-27ab41f4-55f6-4caa-b9fb-2921b894dc11 admin admin] The token cache is being invalidate because project cc49f9bf03974fdd9483c1584a60859b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:26:10.184813 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-27ab41f4-55f6-4caa-b9fb-2921b894dc11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:10.185512 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-27ab41f4-55f6-4caa-b9fb-2921b894dc11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:10.187563 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1478/2904] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:26:10 2022] DELETE /identity/v3/projects/cc49f9bf03974fdd9483c1584a60859b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:26:10.192629 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad6abe-e4ed-4e1d-b5dd-455b24ce7352 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:10.193387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad6abe-e4ed-4e1d-b5dd-455b24ce7352 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:10.193557 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad6abe-e4ed-4e1d-b5dd-455b24ce7352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:10.214007 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-8fad6abe-e4ed-4e1d-b5dd-455b24ce7352 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:26:10.215195 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-8fad6abe-e4ed-4e1d-b5dd-455b24ce7352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:10.244506 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:10.276696 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1427/2905] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:26:10.284744 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147733f-700e-4bc9-b92e-154e15b5e4dd None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:10.285032 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147733f-700e-4bc9-b92e-154e15b5e4dd None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:10.285306 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147733f-700e-4bc9-b92e-154e15b5e4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:10.304547 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-f147733f-700e-4bc9-b92e-154e15b5e4dd None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:26:10.305748 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f147733f-700e-4bc9-b92e-154e15b5e4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:10.314109 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1479/2906] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:26:10.318149 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad6abe-e4ed-4e1d-b5dd-455b24ce7352 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:10.328193 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad6abe-e4ed-4e1d-b5dd-455b24ce7352 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:10.332675 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bdb9c-3c92-44ce-a35d-66cdc8fbe998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:10.333261 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bdb9c-3c92-44ce-a35d-66cdc8fbe998 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:10.333537 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bdb9c-3c92-44ce-a35d-66cdc8fbe998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:10.333807 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bdb9c-3c92-44ce-a35d-66cdc8fbe998 admin admin] PATH_INFO: `/v3/domains` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:10.334445 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bdb9c-3c92-44ce-a35d-66cdc8fbe998 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81599) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:26:10.334741 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bdb9c-3c92-44ce-a35d-66cdc8fbe998 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:10.336354 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bdb9c-3c92-44ce-a35d-66cdc8fbe998 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:10.348087 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1428/2907] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 28 12:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:26:10.352309 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147733f-700e-4bc9-b92e-154e15b5e4dd None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:10.361390 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147733f-700e-4bc9-b92e-154e15b5e4dd None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:10.366001 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480062fe-40b7-419d-95df-fbaf2b1cc366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:10.366590 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480062fe-40b7-419d-95df-fbaf2b1cc366 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:10.366863 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480062fe-40b7-419d-95df-fbaf2b1cc366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:10.367134 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480062fe-40b7-419d-95df-fbaf2b1cc366 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:10.367807 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480062fe-40b7-419d-95df-fbaf2b1cc366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:10.369676 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480062fe-40b7-419d-95df-fbaf2b1cc366 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:10.396668 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1480/2908] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:26:10 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:26:10.400826 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bdb9c-3c92-44ce-a35d-66cdc8fbe998 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:10.410507 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bdb9c-3c92-44ce-a35d-66cdc8fbe998 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:10.465285 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6da3c4-7fc1-45b6-a282-d4c9c942ff7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:10.465927 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6da3c4-7fc1-45b6-a282-d4c9c942ff7e admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:10.466161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6da3c4-7fc1-45b6-a282-d4c9c942ff7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:10.466446 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6da3c4-7fc1-45b6-a282-d4c9c942ff7e admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:10.467093 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6da3c4-7fc1-45b6-a282-d4c9c942ff7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:10.469027 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6da3c4-7fc1-45b6-a282-d4c9c942ff7e admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:10.489341 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1429/2909] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:26:10 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:26:10.493559 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480062fe-40b7-419d-95df-fbaf2b1cc366 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:10.504501 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480062fe-40b7-419d-95df-fbaf2b1cc366 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:10.509000 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907dc92-d9ae-4acf-ba7b-235359e5afd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:10.509611 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907dc92-d9ae-4acf-ba7b-235359e5afd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:10.509886 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907dc92-d9ae-4acf-ba7b-235359e5afd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:10.510152 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907dc92-d9ae-4acf-ba7b-235359e5afd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:10.510778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907dc92-d9ae-4acf-ba7b-235359e5afd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:10.512387 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907dc92-d9ae-4acf-ba7b-235359e5afd2 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:10.522562 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1481/2910] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:26:10.526233 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6da3c4-7fc1-45b6-a282-d4c9c942ff7e admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:10.535872 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6da3c4-7fc1-45b6-a282-d4c9c942ff7e admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:10.540525 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46185d03-f8bb-4fed-866e-1ed6a7f7d6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:10.541139 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46185d03-f8bb-4fed-866e-1ed6a7f7d6bc admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:10.541415 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46185d03-f8bb-4fed-866e-1ed6a7f7d6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:10.541683 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46185d03-f8bb-4fed-866e-1ed6a7f7d6bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:10.542345 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46185d03-f8bb-4fed-866e-1ed6a7f7d6bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:10.543973 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46185d03-f8bb-4fed-866e-1ed6a7f7d6bc admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:10.555146 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1430/2911] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:26:10.559057 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907dc92-d9ae-4acf-ba7b-235359e5afd2 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:10.569511 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907dc92-d9ae-4acf-ba7b-235359e5afd2 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:10.574289 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330abb50-9ec1-4116-974c-a4149bd0aad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:10.574953 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330abb50-9ec1-4116-974c-a4149bd0aad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:10.575228 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330abb50-9ec1-4116-974c-a4149bd0aad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:10.575526 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330abb50-9ec1-4116-974c-a4149bd0aad2 admin admin] PATH_INFO: `/v3/projects/45fe30828469428fafae4714966e9378/users/2d1f71a999f742ab9a330c24982690f5/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:10.586778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:10.591358 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330abb50-9ec1-4116-974c-a4149bd0aad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45fe30828469428fafae4714966e9378, user_id=2d1f71a999f742ab9a330c24982690f5, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:10.594155 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330abb50-9ec1-4116-974c-a4149bd0aad2 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:10.606877 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1482/2912] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:26:10 2022] PUT /identity/v3/projects/45fe30828469428fafae4714966e9378/users/2d1f71a999f742ab9a330c24982690f5/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:26:10.618866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e131b60-3c9e-42ec-b8e4-7395374c85ff None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:10.619154 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e131b60-3c9e-42ec-b8e4-7395374c85ff None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:10.619429 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e131b60-3c9e-42ec-b8e4-7395374c85ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:10.647706 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-0e131b60-3c9e-42ec-b8e4-7395374c85ff None None] MFA Rules not processed for user `2d1f71a999f742ab9a330c24982690f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:26:10.648910 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-0e131b60-3c9e-42ec-b8e4-7395374c85ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:10.714144 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1431/2913] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:26:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:26:10.718600 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330abb50-9ec1-4116-974c-a4149bd0aad2 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:10.781245 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330abb50-9ec1-4116-974c-a4149bd0aad2 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:10.785811 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5450f-b199-4dd2-b825-ef5d2a7da60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:10.786458 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5450f-b199-4dd2-b825-ef5d2a7da60f admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:10.786676 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5450f-b199-4dd2-b825-ef5d2a7da60f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:10.786942 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5450f-b199-4dd2-b825-ef5d2a7da60f admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:10.787606 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5450f-b199-4dd2-b825-ef5d2a7da60f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:10.789473 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5450f-b199-4dd2-b825-ef5d2a7da60f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:10.815486 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1483/2914] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:26:10 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:26:10.819570 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e131b60-3c9e-42ec-b8e4-7395374c85ff None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:10.830630 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e131b60-3c9e-42ec-b8e4-7395374c85ff None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:10.859981 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:10.888493 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad997dd4-dca0-454e-b8a2-1a3b02ae28ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:10.889094 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad997dd4-dca0-454e-b8a2-1a3b02ae28ed admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:10.889399 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad997dd4-dca0-454e-b8a2-1a3b02ae28ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:10.889672 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad997dd4-dca0-454e-b8a2-1a3b02ae28ed admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:10.890301 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad997dd4-dca0-454e-b8a2-1a3b02ae28ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:10.892221 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad997dd4-dca0-454e-b8a2-1a3b02ae28ed admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:10.913480 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1432/2915] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:26:10 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:26:10.917444 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5450f-b199-4dd2-b825-ef5d2a7da60f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:10.928351 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5450f-b199-4dd2-b825-ef5d2a7da60f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:10.933993 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a3edb-62d9-434e-97cb-d8f904927a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:10.934938 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a3edb-62d9-434e-97cb-d8f904927a35 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:10.935227 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a3edb-62d9-434e-97cb-d8f904927a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:10.935542 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a3edb-62d9-434e-97cb-d8f904927a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:10.936193 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a3edb-62d9-434e-97cb-d8f904927a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:10.938652 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a3edb-62d9-434e-97cb-d8f904927a35 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:10.953989 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1484/2916] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:26:10.958030 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad997dd4-dca0-454e-b8a2-1a3b02ae28ed admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:10.968675 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad997dd4-dca0-454e-b8a2-1a3b02ae28ed admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:10.973359 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3460b5-0881-4162-8d3f-2ad20a18cf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:10.973953 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3460b5-0881-4162-8d3f-2ad20a18cf82 admin admin] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:10.974231 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3460b5-0881-4162-8d3f-2ad20a18cf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:10.974501 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3460b5-0881-4162-8d3f-2ad20a18cf82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:10.975140 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3460b5-0881-4162-8d3f-2ad20a18cf82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:10.976766 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3460b5-0881-4162-8d3f-2ad20a18cf82 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:10.987786 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1433/2917] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:26:10.991987 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a3edb-62d9-434e-97cb-d8f904927a35 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:11.002017 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a3edb-62d9-434e-97cb-d8f904927a35 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:11.006540 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd7831-d2e5-4d20-9a0e-47093b8902e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:11.007173 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd7831-d2e5-4d20-9a0e-47093b8902e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:11.007471 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd7831-d2e5-4d20-9a0e-47093b8902e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:11.007743 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd7831-d2e5-4d20-9a0e-47093b8902e3 admin admin] PATH_INFO: `/v3/projects/ac6b00e401734f02aae8c5d836ed6b56/users/4f955a399ace47ec9406e3b46aa87889/roles/9aa9b054939e4fc1ad0387e43c500693` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:11.021950 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd7831-d2e5-4d20-9a0e-47093b8902e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac6b00e401734f02aae8c5d836ed6b56, user_id=4f955a399ace47ec9406e3b46aa87889, role_id=9aa9b054939e4fc1ad0387e43c500693)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:11.024583 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd7831-d2e5-4d20-9a0e-47093b8902e3 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:11.038303 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1485/2918] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:26:10 2022] PUT /identity/v3/projects/ac6b00e401734f02aae8c5d836ed6b56/users/4f955a399ace47ec9406e3b46aa87889/roles/9aa9b054939e4fc1ad0387e43c500693 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:26:11.048892 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e5ddc-095b-415e-b97d-11966301542c None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:11.049178 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e5ddc-095b-415e-b97d-11966301542c None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:11.049451 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e5ddc-095b-415e-b97d-11966301542c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:11.077519 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-a61e5ddc-095b-415e-b97d-11966301542c None None] MFA Rules not processed for user `4f955a399ace47ec9406e3b46aa87889`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:26:11.078713 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-a61e5ddc-095b-415e-b97d-11966301542c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:11.141389 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1434/2919] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:26:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:26:11.145813 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd7831-d2e5-4d20-9a0e-47093b8902e3 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:11.205662 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd7831-d2e5-4d20-9a0e-47093b8902e3 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:11.210372 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40e9a9-f3ad-4658-8631-1180768c579c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:11.210961 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40e9a9-f3ad-4658-8631-1180768c579c admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:11.211235 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40e9a9-f3ad-4658-8631-1180768c579c admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:11.211537 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40e9a9-f3ad-4658-8631-1180768c579c admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:11.212154 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40e9a9-f3ad-4658-8631-1180768c579c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:11.214061 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40e9a9-f3ad-4658-8631-1180768c579c admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:11.240203 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1486/2920] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 28 12:26:11 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:26:11.244387 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e5ddc-095b-415e-b97d-11966301542c None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:11.255111 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e5ddc-095b-415e-b97d-11966301542c None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:11.310962 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87e83e-82d3-4bc3-b01c-fb587a62d701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:11.311694 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87e83e-82d3-4bc3-b01c-fb587a62d701 admin admin] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:11.312204 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87e83e-82d3-4bc3-b01c-fb587a62d701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:11.312687 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87e83e-82d3-4bc3-b01c-fb587a62d701 admin admin] PATH_INFO: `/v3/users` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:11.313866 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87e83e-82d3-4bc3-b01c-fb587a62d701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:11.316153 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87e83e-82d3-4bc3-b01c-fb587a62d701 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:11.338779 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1435/2921] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 28 12:26:11 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:26:11.343543 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40e9a9-f3ad-4658-8631-1180768c579c admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:11.353865 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40e9a9-f3ad-4658-8631-1180768c579c admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:11.358815 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b783e2-5b8c-4bc5-920e-b4b505282954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:11.359456 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b783e2-5b8c-4bc5-920e-b4b505282954 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:11.359752 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b783e2-5b8c-4bc5-920e-b4b505282954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:11.360014 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b783e2-5b8c-4bc5-920e-b4b505282954 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:11.360708 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b783e2-5b8c-4bc5-920e-b4b505282954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:11.363065 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b783e2-5b8c-4bc5-920e-b4b505282954 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:11.374942 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1487/2922] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:26:11.379185 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87e83e-82d3-4bc3-b01c-fb587a62d701 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:11.389075 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87e83e-82d3-4bc3-b01c-fb587a62d701 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:11.394174 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01625172-9424-4b2a-b96f-9a0fba68befc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:11.394809 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01625172-9424-4b2a-b96f-9a0fba68befc admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:11.395090 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01625172-9424-4b2a-b96f-9a0fba68befc admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:11.395363 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01625172-9424-4b2a-b96f-9a0fba68befc admin admin] PATH_INFO: `/v3/projects/c3d0c1cc34fb4e8facbb3c381b17aa50/users/d506cd782555402eb7075b73566afded/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:11.410635 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01625172-9424-4b2a-b96f-9a0fba68befc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3d0c1cc34fb4e8facbb3c381b17aa50, user_id=d506cd782555402eb7075b73566afded, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:11.413318 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01625172-9424-4b2a-b96f-9a0fba68befc admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:11.426877 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1436/2923] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:26:11 2022] PUT /identity/v3/projects/c3d0c1cc34fb4e8facbb3c381b17aa50/users/d506cd782555402eb7075b73566afded/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:26:11.430935 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b783e2-5b8c-4bc5-920e-b4b505282954 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:11.440851 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b783e2-5b8c-4bc5-920e-b4b505282954 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:11.449631 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:11.499603 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9e727-95d3-438a-9d26-9ca4e32c68fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:11.500207 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9e727-95d3-438a-9d26-9ca4e32c68fc admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:11.500486 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9e727-95d3-438a-9d26-9ca4e32c68fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:11.500759 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9e727-95d3-438a-9d26-9ca4e32c68fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:11.501398 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9e727-95d3-438a-9d26-9ca4e32c68fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:11.502991 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9e727-95d3-438a-9d26-9ca4e32c68fc admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:11.512655 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1488/2924] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 28 12:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:26:11.517407 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01625172-9424-4b2a-b96f-9a0fba68befc admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:11.523975 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:11.527751 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01625172-9424-4b2a-b96f-9a0fba68befc admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:11.533508 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ffa56-611b-4543-9a5d-e757cfbb7894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:11.534186 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ffa56-611b-4543-9a5d-e757cfbb7894 admin admin] REQUEST_METHOD: `PUT` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:11.534467 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ffa56-611b-4543-9a5d-e757cfbb7894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:11.534740 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ffa56-611b-4543-9a5d-e757cfbb7894 admin admin] PATH_INFO: `/v3/projects/c3d0c1cc34fb4e8facbb3c381b17aa50/users/d506cd782555402eb7075b73566afded/roles/66456d39fc0c496c8f290a436b726216` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:11.536680 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ffa56-611b-4543-9a5d-e757cfbb7894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3d0c1cc34fb4e8facbb3c381b17aa50, user_id=d506cd782555402eb7075b73566afded, role_id=66456d39fc0c496c8f290a436b726216)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:11.539325 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ffa56-611b-4543-9a5d-e757cfbb7894 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:11.549979 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1437/2925] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 28 12:26:11 2022] PUT /identity/v3/projects/c3d0c1cc34fb4e8facbb3c381b17aa50/users/d506cd782555402eb7075b73566afded/roles/66456d39fc0c496c8f290a436b726216 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:26:11.559961 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31d993-7559-43c5-9445-39c071a29575 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:11.560252 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31d993-7559-43c5-9445-39c071a29575 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:11.560531 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31d993-7559-43c5-9445-39c071a29575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:11.588605 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-5d31d993-7559-43c5-9445-39c071a29575 None None] MFA Rules not processed for user `d506cd782555402eb7075b73566afded`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:26:11.589741 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5d31d993-7559-43c5-9445-39c071a29575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:11.663167 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1489/2926] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:26:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:26:11.675150 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ffa56-611b-4543-9a5d-e757cfbb7894 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:11.676901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-3b2ffa56-611b-4543-9a5d-e757cfbb7894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:11.734792 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ffa56-611b-4543-9a5d-e757cfbb7894 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:11.738726 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96c084-4d4d-4916-99d0-4f1ba90c2002 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:11.739338 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96c084-4d4d-4916-99d0-4f1ba90c2002 service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:11.739641 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96c084-4d4d-4916-99d0-4f1ba90c2002 service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:11.739946 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96c084-4d4d-4916-99d0-4f1ba90c2002 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:11.796155 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96c084-4d4d-4916-99d0-4f1ba90c2002 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:11.797608 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96c084-4d4d-4916-99d0-4f1ba90c2002 service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:11.806353 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1438/2927] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:26:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:26:13.300643 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31d993-7559-43c5-9445-39c071a29575 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:13.302061 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5d31d993-7559-43c5-9445-39c071a29575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:13.314513 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31d993-7559-43c5-9445-39c071a29575 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:13.318085 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4de033-836f-488a-8b39-f7ac69ebf0a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:13.318680 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4de033-836f-488a-8b39-f7ac69ebf0a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:13.318961 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4de033-836f-488a-8b39-f7ac69ebf0a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:13.319234 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4de033-836f-488a-8b39-f7ac69ebf0a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:13.375371 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4de033-836f-488a-8b39-f7ac69ebf0a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:13.376807 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4de033-836f-488a-8b39-f7ac69ebf0a7 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:13.385588 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1490/2928] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:26:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:26:13.914970 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96c084-4d4d-4916-99d0-4f1ba90c2002 service cinder] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:13.924132 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96c084-4d4d-4916-99d0-4f1ba90c2002 service cinder] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:13.927768 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6527953-a48e-4815-bd32-b4c734491727 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09354b404d94e9db2e21292a61a06f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:13.928355 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6527953-a48e-4815-bd32-b4c734491727 service cinder] REQUEST_METHOD: `GET` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:13.928642 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6527953-a48e-4815-bd32-b4c734491727 service cinder] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:13.928901 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6527953-a48e-4815-bd32-b4c734491727 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:13.937763 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6527953-a48e-4815-bd32-b4c734491727 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:13.939157 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6527953-a48e-4815-bd32-b4c734491727 service cinder] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:13.948346 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1439/2929] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:26:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:26:17.793470 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4de033-836f-488a-8b39-f7ac69ebf0a7 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:17.826692 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:17.856474 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4de033-836f-488a-8b39-f7ac69ebf0a7 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:17.861742 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdaff5d-7e3e-4e4b-b38b-674554802c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:17.862373 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdaff5d-7e3e-4e4b-b38b-674554802c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:17.862670 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdaff5d-7e3e-4e4b-b38b-674554802c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:17.863001 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdaff5d-7e3e-4e4b-b38b-674554802c59 admin admin] PATH_INFO: `/v3/users/2d1f71a999f742ab9a330c24982690f5` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:17.864145 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdaff5d-7e3e-4e4b-b38b-674554802c59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d1f71a999f742ab9a330c24982690f5)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:17.866046 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdaff5d-7e3e-4e4b-b38b-674554802c59 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:17.911106 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5bdaff5d-7e3e-4e4b-b38b-674554802c59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d1f71a999f742ab9a330c24982690f5'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:17.911756 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5bdaff5d-7e3e-4e4b-b38b-674554802c59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d1f71a999f742ab9a330c24982690f5'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:17.918762 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5bdaff5d-7e3e-4e4b-b38b-674554802c59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d1f71a999f742ab9a330c24982690f5'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:17.926606 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5bdaff5d-7e3e-4e4b-b38b-674554802c59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d1f71a999f742ab9a330c24982690f5'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:17.927220 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5bdaff5d-7e3e-4e4b-b38b-674554802c59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d1f71a999f742ab9a330c24982690f5'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:17.944398 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1491/2930] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:26:17 2022] DELETE /identity/v3/users/2d1f71a999f742ab9a330c24982690f5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:26:17.948796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8de250-72a6-46fd-b48e-3d0ffcfd7cb2 None None] REQUEST_METHOD: `POST` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:17.949277 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8de250-72a6-46fd-b48e-3d0ffcfd7cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:17.949388 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8de250-72a6-46fd-b48e-3d0ffcfd7cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:17.968631 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.auth.core [None req-3b8de250-72a6-46fd-b48e-3d0ffcfd7cb2 None None] MFA Rules not processed for user `c57b54b073714d88bce939746c445771`. Rule list: `[]` (Enabled: `True`). {{(pid=81599) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:26:17.969811 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-3b8de250-72a6-46fd-b48e-3d0ffcfd7cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:18.033963 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1440/2931] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 28 12:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:26:18.043401 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdaff5d-7e3e-4e4b-b38b-674554802c59 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:18.044874 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5bdaff5d-7e3e-4e4b-b38b-674554802c59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:18.102247 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdaff5d-7e3e-4e4b-b38b-674554802c59 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:18.105846 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3853ea-9e2a-48c0-bb7d-66ee85e21eec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca51ff621664452db7dd991714462e3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:18.106450 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3853ea-9e2a-48c0-bb7d-66ee85e21eec service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:18.106725 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3853ea-9e2a-48c0-bb7d-66ee85e21eec service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:18.106994 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3853ea-9e2a-48c0-bb7d-66ee85e21eec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:18.115815 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3853ea-9e2a-48c0-bb7d-66ee85e21eec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:18.117221 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3853ea-9e2a-48c0-bb7d-66ee85e21eec service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:18.126663 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1492/2932] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:26:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:26:18.383375 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8de250-72a6-46fd-b48e-3d0ffcfd7cb2 None None] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:18.384796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-3b8de250-72a6-46fd-b48e-3d0ffcfd7cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:18.400426 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8de250-72a6-46fd-b48e-3d0ffcfd7cb2 None None] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:18.406328 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75550f80-6eb0-47d1-b983-8c4140d7c398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:18.407161 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75550f80-6eb0-47d1-b983-8c4140d7c398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:18.407458 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75550f80-6eb0-47d1-b983-8c4140d7c398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:18.407873 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75550f80-6eb0-47d1-b983-8c4140d7c398 admin admin] PATH_INFO: `/v3/projects/45fe30828469428fafae4714966e9378` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:18.410037 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75550f80-6eb0-47d1-b983-8c4140d7c398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45fe30828469428fafae4714966e9378)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:18.411972 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75550f80-6eb0-47d1-b983-8c4140d7c398 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:18.443841 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:18.460372 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-75550f80-6eb0-47d1-b983-8c4140d7c398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45fe30828469428fafae4714966e9378', 'request_id': 'req-75550f80-6eb0-47d1-b983-8c4140d7c398'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:18.465918 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-75550f80-6eb0-47d1-b983-8c4140d7c398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45fe30828469428fafae4714966e9378', 'request_id': 'req-75550f80-6eb0-47d1-b983-8c4140d7c398'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:18.472940 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-75550f80-6eb0-47d1-b983-8c4140d7c398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45fe30828469428fafae4714966e9378', 'request_id': 'req-75550f80-6eb0-47d1-b983-8c4140d7c398'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:18.485085 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-75550f80-6eb0-47d1-b983-8c4140d7c398 admin admin] The token cache is being invalidate because project 45fe30828469428fafae4714966e9378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:26:18.485433 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-75550f80-6eb0-47d1-b983-8c4140d7c398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:18.486449 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-75550f80-6eb0-47d1-b983-8c4140d7c398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:18.488252 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1441/2933] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:26:18 2022] DELETE /identity/v3/projects/45fe30828469428fafae4714966e9378 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:26:18.492467 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3853ea-9e2a-48c0-bb7d-66ee85e21eec service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:18.502840 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3853ea-9e2a-48c0-bb7d-66ee85e21eec service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:18.553701 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:18.562518 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15870a3c-fdf8-470a-84c2-2e9cb08d5ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:18.563166 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15870a3c-fdf8-470a-84c2-2e9cb08d5ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:18.563642 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15870a3c-fdf8-470a-84c2-2e9cb08d5ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:18.563916 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15870a3c-fdf8-470a-84c2-2e9cb08d5ad1 admin admin] PATH_INFO: `/v3/users/4f955a399ace47ec9406e3b46aa87889` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:18.565027 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15870a3c-fdf8-470a-84c2-2e9cb08d5ad1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f955a399ace47ec9406e3b46aa87889)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:18.566928 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15870a3c-fdf8-470a-84c2-2e9cb08d5ad1 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:18.611038 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-15870a3c-fdf8-470a-84c2-2e9cb08d5ad1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f955a399ace47ec9406e3b46aa87889'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:18.611715 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-15870a3c-fdf8-470a-84c2-2e9cb08d5ad1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f955a399ace47ec9406e3b46aa87889'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:18.618576 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-15870a3c-fdf8-470a-84c2-2e9cb08d5ad1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f955a399ace47ec9406e3b46aa87889'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:18.625737 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-15870a3c-fdf8-470a-84c2-2e9cb08d5ad1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f955a399ace47ec9406e3b46aa87889'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:18.626391 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-15870a3c-fdf8-470a-84c2-2e9cb08d5ad1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f955a399ace47ec9406e3b46aa87889'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:18.643963 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1493/2934] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:26:18 2022] DELETE /identity/v3/users/4f955a399ace47ec9406e3b46aa87889 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:26:18.904686 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75550f80-6eb0-47d1-b983-8c4140d7c398 admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:18.906259 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-75550f80-6eb0-47d1-b983-8c4140d7c398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:18.919746 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75550f80-6eb0-47d1-b983-8c4140d7c398 admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:18.976953 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e9de4-042f-43fb-bfce-10a97de8271c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:18.977689 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e9de4-042f-43fb-bfce-10a97de8271c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:18.977874 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e9de4-042f-43fb-bfce-10a97de8271c admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:18.978142 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e9de4-042f-43fb-bfce-10a97de8271c admin admin] PATH_INFO: `/v3/projects/ac6b00e401734f02aae8c5d836ed6b56` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:18.979248 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e9de4-042f-43fb-bfce-10a97de8271c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac6b00e401734f02aae8c5d836ed6b56)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:18.981186 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e9de4-042f-43fb-bfce-10a97de8271c admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:19.029240 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-bd9e9de4-042f-43fb-bfce-10a97de8271c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac6b00e401734f02aae8c5d836ed6b56', 'request_id': 'req-bd9e9de4-042f-43fb-bfce-10a97de8271c'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:19.034793 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-bd9e9de4-042f-43fb-bfce-10a97de8271c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac6b00e401734f02aae8c5d836ed6b56', 'request_id': 'req-bd9e9de4-042f-43fb-bfce-10a97de8271c'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:19.042282 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-bd9e9de4-042f-43fb-bfce-10a97de8271c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac6b00e401734f02aae8c5d836ed6b56', 'request_id': 'req-bd9e9de4-042f-43fb-bfce-10a97de8271c'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:19.053796 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-bd9e9de4-042f-43fb-bfce-10a97de8271c admin admin] The token cache is being invalidate because project ac6b00e401734f02aae8c5d836ed6b56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:26:19.054081 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-bd9e9de4-042f-43fb-bfce-10a97de8271c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:19.054707 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-bd9e9de4-042f-43fb-bfce-10a97de8271c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:19.056221 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1442/2935] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:26:18 2022] DELETE /identity/v3/projects/ac6b00e401734f02aae8c5d836ed6b56 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:26:19.060267 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15870a3c-fdf8-470a-84c2-2e9cb08d5ad1 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:19.062322 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-15870a3c-fdf8-470a-84c2-2e9cb08d5ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:19.074981 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15870a3c-fdf8-470a-84c2-2e9cb08d5ad1 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:19.131679 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1a1a8-03e1-4869-98cb-c2cc17141844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:19.132229 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1a1a8-03e1-4869-98cb-c2cc17141844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:19.132509 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1a1a8-03e1-4869-98cb-c2cc17141844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:19.132778 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1a1a8-03e1-4869-98cb-c2cc17141844 admin admin] PATH_INFO: `/v3/users/d506cd782555402eb7075b73566afded` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:19.133897 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1a1a8-03e1-4869-98cb-c2cc17141844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d506cd782555402eb7075b73566afded)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:19.135840 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1a1a8-03e1-4869-98cb-c2cc17141844 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:19.181785 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dde1a1a8-03e1-4869-98cb-c2cc17141844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd506cd782555402eb7075b73566afded'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:19.182426 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dde1a1a8-03e1-4869-98cb-c2cc17141844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd506cd782555402eb7075b73566afded'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:19.189298 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dde1a1a8-03e1-4869-98cb-c2cc17141844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd506cd782555402eb7075b73566afded'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:19.196406 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dde1a1a8-03e1-4869-98cb-c2cc17141844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd506cd782555402eb7075b73566afded'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:19.197053 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dde1a1a8-03e1-4869-98cb-c2cc17141844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd506cd782555402eb7075b73566afded'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:19.207154 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:19.215843 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1494/2936] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 28 12:26:19 2022] DELETE /identity/v3/users/d506cd782555402eb7075b73566afded => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:26:19.487535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e9de4-042f-43fb-bfce-10a97de8271c admin admin] Authenticating user token {{(pid=81599) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:19.489000 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.fernet_utils [None req-bd9e9de4-042f-43fb-bfce-10a97de8271c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81599) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:19.506810 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e9de4-042f-43fb-bfce-10a97de8271c admin admin] Validating token access rules against request {{(pid=81599) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:19.554861 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:19.568349 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee5311-9fee-4e51-9948-e900a0886995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c57b54b073714d88bce939746c445771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '041bf4405bd541158bdb50b4fa9874e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81599) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:19.568979 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee5311-9fee-4e51-9948-e900a0886995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:19.569261 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee5311-9fee-4e51-9948-e900a0886995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:19.569535 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee5311-9fee-4e51-9948-e900a0886995 admin admin] PATH_INFO: `/v3/projects/c3d0c1cc34fb4e8facbb3c381b17aa50` {{(pid=81599) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:19.570650 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee5311-9fee-4e51-9948-e900a0886995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3d0c1cc34fb4e8facbb3c381b17aa50)` {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:19.572581 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee5311-9fee-4e51-9948-e900a0886995 admin admin] RBAC: Authorization granted {{(pid=81599) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:19.618021 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-0fee5311-9fee-4e51-9948-e900a0886995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3d0c1cc34fb4e8facbb3c381b17aa50', 'request_id': 'req-0fee5311-9fee-4e51-9948-e900a0886995'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:19.623841 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-0fee5311-9fee-4e51-9948-e900a0886995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3d0c1cc34fb4e8facbb3c381b17aa50', 'request_id': 'req-0fee5311-9fee-4e51-9948-e900a0886995'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:19.630970 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-0fee5311-9fee-4e51-9948-e900a0886995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3d0c1cc34fb4e8facbb3c381b17aa50', 'request_id': 'req-0fee5311-9fee-4e51-9948-e900a0886995'} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:19.642252 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-0fee5311-9fee-4e51-9948-e900a0886995 admin admin] The token cache is being invalidate because project c3d0c1cc34fb4e8facbb3c381b17aa50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81599) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:26:19.642540 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-0fee5311-9fee-4e51-9948-e900a0886995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:19.643160 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG keystone.notifications [None req-0fee5311-9fee-4e51-9948-e900a0886995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81599) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:26:19.644636 dv-cinder-859193-2-smb devstack@keystone.service[81599]: [pid: 81599|app: 0|req: 1443/2937] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 28 12:26:19 2022] DELETE /identity/v3/projects/c3d0c1cc34fb4e8facbb3c381b17aa50 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:26:29.216691 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:DELETE=1,keystone:SELECT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:29.638853 dv-cinder-859193-2-smb devstack@keystone.service[81599]: DEBUG dbcounter [-] [81599] Writing DB stats keystone:SELECT=30,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:02.224378 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1a1a8-03e1-4869-98cb-c2cc17141844 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:02.225789 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-dde1a1a8-03e1-4869-98cb-c2cc17141844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:02.295854 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1a1a8-03e1-4869-98cb-c2cc17141844 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:02.354388 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd931a3-a37f-4cc3-8d78-028d4a88bb24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09e495edc6fd47c892679bb908c3f5bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c854d366f35145e8b2fadb9b014d0199', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:02.354994 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd931a3-a37f-4cc3-8d78-028d4a88bb24 service placement] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:02.355273 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd931a3-a37f-4cc3-8d78-028d4a88bb24 service placement] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:02.355582 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd931a3-a37f-4cc3-8d78-028d4a88bb24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:02.357330 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9cd931a3-a37f-4cc3-8d78-028d4a88bb24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:02.368952 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd931a3-a37f-4cc3-8d78-028d4a88bb24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:02.370499 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd931a3-a37f-4cc3-8d78-028d4a88bb24 service placement] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:02.381202 dv-cinder-859193-2-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1495/2938] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 28 12:28:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:28:12.376796 dv-cinder-859193-2-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=58 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}